-- Logs begin at Thu 2022-06-02 18:13:19 UTC, end at Thu 2022-06-02 19:39:52 UTC. -- Jun 02 19:00:52.878433 dv-cinder-797608-28-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 02 19:00:52.890805 dv-cinder-797608-28-smb devstack@keystone.service[80594]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 02 19:00:52.893854 dv-cinder-797608-28-smb devstack@keystone.service[80594]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 19:00:52 2022] *** Jun 02 19:00:52.893854 dv-cinder-797608-28-smb devstack@keystone.service[80594]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 19:00:52.893854 dv-cinder-797608-28-smb devstack@keystone.service[80594]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 19:00:52.893854 dv-cinder-797608-28-smb devstack@keystone.service[80594]: nodename: dv-cinder-797608-28-smb Jun 02 19:00:52.893854 dv-cinder-797608-28-smb devstack@keystone.service[80594]: machine: x86_64 Jun 02 19:00:52.893854 dv-cinder-797608-28-smb devstack@keystone.service[80594]: clock source: unix Jun 02 19:00:52.893854 dv-cinder-797608-28-smb devstack@keystone.service[80594]: pcre jit disabled Jun 02 19:00:52.893854 dv-cinder-797608-28-smb devstack@keystone.service[80594]: detected number of CPU cores: 4 Jun 02 19:00:52.893854 dv-cinder-797608-28-smb devstack@keystone.service[80594]: current working directory: / Jun 02 19:00:52.893854 dv-cinder-797608-28-smb devstack@keystone.service[80594]: detected binary path: /usr/bin/uwsgi-core Jun 02 19:00:52.893854 dv-cinder-797608-28-smb devstack@keystone.service[80594]: your processes number limit is 47680 Jun 02 19:00:52.893854 dv-cinder-797608-28-smb devstack@keystone.service[80594]: your memory page size is 4096 bytes Jun 02 19:00:52.895034 dv-cinder-797608-28-smb devstack@keystone.service[80594]: detected max file descriptor number: 2048 Jun 02 19:00:52.895034 dv-cinder-797608-28-smb devstack@keystone.service[80594]: lock engine: pthread robust mutexes Jun 02 19:00:52.895034 dv-cinder-797608-28-smb devstack@keystone.service[80594]: thunder lock: enabled Jun 02 19:00:52.895034 dv-cinder-797608-28-smb devstack@keystone.service[80594]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 02 19:00:52.895034 dv-cinder-797608-28-smb devstack@keystone.service[80594]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 19:00:52.940770 dv-cinder-797608-28-smb devstack@keystone.service[80594]: Python main interpreter initialized at 0x557b3c0389c0 Jun 02 19:00:52.940770 dv-cinder-797608-28-smb devstack@keystone.service[80594]: python threads support enabled Jun 02 19:00:52.940770 dv-cinder-797608-28-smb devstack@keystone.service[80594]: your server socket listen backlog is limited to 100 connections Jun 02 19:00:52.940770 dv-cinder-797608-28-smb devstack@keystone.service[80594]: your mercy for graceful operations on workers is 90 seconds Jun 02 19:00:52.941174 dv-cinder-797608-28-smb devstack@keystone.service[80594]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 19:00:52.941244 dv-cinder-797608-28-smb devstack@keystone.service[80594]: *** Operational MODE: preforking *** Jun 02 19:00:52.941516 dv-cinder-797608-28-smb devstack@keystone.service[80594]: *** uWSGI is running in multiple interpreter mode *** Jun 02 19:00:52.941516 dv-cinder-797608-28-smb devstack@keystone.service[80594]: spawned uWSGI master process (pid: 80594) Jun 02 19:00:52.941803 dv-cinder-797608-28-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 02 19:00:52.943066 dv-cinder-797608-28-smb devstack@keystone.service[80594]: spawned uWSGI worker 1 (pid: 80608, cores: 1) Jun 02 19:00:52.943066 dv-cinder-797608-28-smb devstack@keystone.service[80594]: spawned uWSGI worker 2 (pid: 80609, cores: 1) Jun 02 19:00:52.943066 dv-cinder-797608-28-smb devstack@keystone.service[80594]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 19:00:59.208812 dv-cinder-797608-28-smb devstack@keystone.service[80609]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 19:00:59.208812 dv-cinder-797608-28-smb devstack@keystone.service[80609]: from cryptography.utils import int_from_bytes Jun 02 19:00:59.210072 dv-cinder-797608-28-smb devstack@keystone.service[80609]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 19:00:59.210072 dv-cinder-797608-28-smb devstack@keystone.service[80609]: from cryptography.utils import int_from_bytes Jun 02 19:00:59.211818 dv-cinder-797608-28-smb devstack@keystone.service[80608]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 19:00:59.211818 dv-cinder-797608-28-smb devstack@keystone.service[80608]: from cryptography.utils import int_from_bytes Jun 02 19:00:59.212681 dv-cinder-797608-28-smb devstack@keystone.service[80608]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 19:00:59.212681 dv-cinder-797608-28-smb devstack@keystone.service[80608]: from cryptography.utils import int_from_bytes Jun 02 19:00:59.261196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 19:00:59.261483 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 19:00:59.261636 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 19:00:59.261636 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] command line args: [] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 19:00:59.261932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 19:00:59.262077 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 19:00:59.262212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] command line args: [] {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 19:00:59.262352 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ================================================================================ {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 19:00:59.262352 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] admin_token = **** {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.262617 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 19:00:59.262759 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] config_dir = [] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.262903 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ================================================================================ {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 19:00:59.263036 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.263036 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] config_source = [] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.263303 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] admin_token = **** {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.263502 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] debug = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.263502 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.264079 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] config_dir = [] {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.264252 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.264443 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.264624 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.264800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] config_source = [] {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.264984 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.265163 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] debug = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.265346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.265346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] list_limit = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.265674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.265900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] log_config_append = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.265900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.266238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.266413 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] log_dir = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.266413 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] log_file = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.266736 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.266911 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.266911 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.267233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.267383 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.267580 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.267723 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.267723 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.267723 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.268259 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] list_limit = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.268386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.268575 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] log_config_append = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.268716 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.268902 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.269034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.269034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.269355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] log_dir = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.269542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.270190 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] log_file = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.270387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.270524 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.270780 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.270780 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.271084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.271227 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.271471 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.271641 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.271793 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.272110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] publish_errors = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.272110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.272439 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.272582 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.272780 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.272989 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.272989 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.273248 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.273398 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.273538 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.273681 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] standard_threads = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.273681 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.273937 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.274080 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.274080 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.274340 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.274479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] use_journal = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.274479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] use_json = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.274714 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.274843 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] use_stderr = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.274843 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] use_syslog = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.275257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.275389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.275389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.275655 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.275858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.275858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.276143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.276289 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.276430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.276572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.276572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.276572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.276572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.277049 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.277192 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.277330 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] publish_errors = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.277460 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.277598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.277730 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.277730 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.277988 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.278130 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.278272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.278404 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.278600 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.278745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.278745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.278987 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.279129 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.279262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] standard_threads = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.279401 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.279401 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.279679 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.279820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.279953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.280106 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.280238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.280392 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.280521 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] use_journal = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.280647 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.280647 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.280880 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] use_json = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.281007 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.281247 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] use_stderr = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.281382 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.281514 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] use_syslog = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.281653 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.281860 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 19:00:59.281996 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.281996 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.282260 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.282388 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.282388 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.282612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.282736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.282878 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.283020 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.283020 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.283258 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.283390 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.283390 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.283653 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.283793 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.283936 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.284117 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.284117 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.284373 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.284519 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.284647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.284787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.284787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.285024 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.285167 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.285347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.286042 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.286042 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.286292 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.286432 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.286576 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.286710 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.286710 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.286950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.287082 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.287082 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.287345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.287478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.287606 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.287746 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.287746 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.288092 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.288283 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.288517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.288712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.288712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.289057 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.289234 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.289234 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.289574 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.289747 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.289950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.290095 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.290095 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.290485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.290618 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.290618 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.290922 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.291062 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.291253 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.291456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.291456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.291783 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.291919 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.291919 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.292370 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.292572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.292572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.292890 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.293025 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.293169 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.293362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.293362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.293676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.293811 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.293811 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.294132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.294317 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.294317 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.294631 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.294826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.294961 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.295153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.295153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.295395 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.295538 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.295538 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.295897 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.296061 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.296213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.296356 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.296356 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.296618 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.296746 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.296746 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.296989 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.297122 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.297122 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.297483 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.297618 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.297811 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.297950 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.297950 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.298211 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.298352 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.298352 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.298598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.298724 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.298861 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.298999 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.298999 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.299249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.299375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.299503 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.299632 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.299632 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.299888 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.300038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.300170 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.300316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.300316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.300640 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.300794 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.300925 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.301055 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] auth.external = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.301055 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.301295 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.301426 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.301575 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.301704 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.301704 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] auth.password = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.301942 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.302070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] auth.token = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.302196 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.302343 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.302343 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.302595 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.302728 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.302728 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.302980 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.303123 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.303256 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.303389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.303389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.303624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.303753 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] credential.caching = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.303894 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.304079 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.304079 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.304342 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.304476 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.304609 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.304763 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.304763 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.304991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.305115 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.305245 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.305372 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.305372 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.305624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.305752 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.305883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.306021 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.306021 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.306277 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.306404 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.306536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.306655 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.306655 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.306882 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.307036 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.307168 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.307300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] federation.caching = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.307300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.307555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.307688 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.307843 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.308012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.308012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.308247 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.308375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.308375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.308624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.308758 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.308890 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.309019 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.309019 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.309321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.309456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.309586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.309733 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.309733 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.caching = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.309989 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.310224 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.310366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.310500 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.310500 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.310758 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.310893 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.311021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.311151 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.311151 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.311466 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.311599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.311599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.311843 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.311971 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.312155 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.312401 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.312401 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.312642 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.312786 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.312920 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.313054 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.313054 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.313316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.313449 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.313449 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.313679 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.313803 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.313946 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.314084 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.314084 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.314314 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.314444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.314573 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.314715 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.314715 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.314941 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.315071 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.315071 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.315297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.315440 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.315576 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.315710 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.315710 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.315954 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.316115 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.316115 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.316378 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.316513 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.316660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.316801 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.316801 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.317052 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.317176 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.317176 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.317377 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.317498 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.317628 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.317770 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.317770 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.318010 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.318142 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.318142 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.318385 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.318540 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.318671 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.318797 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.318797 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.319045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.319200 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.319200 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.319463 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.319599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.319734 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.319868 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.319868 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.320157 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.320292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.320292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.320541 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.320677 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.320677 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.320942 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] auth.external = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.321072 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.321205 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.321351 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.321489 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.321638 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.321638 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.321879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.322012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.322012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.322228 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] auth.password = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.322374 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.322504 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] auth.token = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.322635 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.322635 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.322887 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.323021 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.323021 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.323276 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.323402 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.323531 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.323664 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.323664 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.323909 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.324179 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.324179 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.324416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.324547 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.324547 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.324795 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.324919 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.325057 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.325187 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.325187 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.325439 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] credential.caching = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.325573 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.325703 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.325829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.325829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.326067 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.326195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.326195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.326440 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.326568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.326701 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.326831 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.326831 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.327077 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.327206 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.327206 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.327510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.327650 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.327650 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.327911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.328067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.328067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.328314 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.328448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.328448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] resource.caching = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.328715 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.328849 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.328986 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.329120 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.329120 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.329345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.329491 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.329491 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.329736 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.329869 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.330001 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.330135 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.330135 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.330391 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.330525 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.330525 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] role.caching = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.330771 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.330900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] role.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.330900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.331157 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] federation.caching = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.331287 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.331432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.331564 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.331564 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.331823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.331954 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.332680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.332819 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.332969 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.333117 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.333251 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.333382 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.333510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.333647 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.333792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.333934 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.334065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.334239 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.334374 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.334499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.334685 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.334927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.335064 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.335192 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.335419 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.335554 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.335683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.335826 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.335949 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.336189 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.336327 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] identity.caching = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.336459 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.336592 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.336747 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.336926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.337066 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.337199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.337333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.337466 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.337621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.337756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.337888 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.338087 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.338224 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.338350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.338588 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.338719 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.338849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.338979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.339113 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.339241 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.339384 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.339519 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] token.caching = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.339651 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.339784 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.339960 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.340189 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.340339 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.340479 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.340603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.340737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.340871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.341004 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.341152 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.341287 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.341428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.341547 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.341665 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.341886 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.342061 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.342207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.342348 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.342499 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.342641 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.342793 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.342930 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.343069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.343252 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.343396 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.343564 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.343717 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.343854 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] database.connection = **** {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.344358 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.344523 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.344661 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.344791 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.344912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.345148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.345385 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.345601 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.345812 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.346012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.346012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.346404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.346617 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.346818 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.347026 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.347234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.347444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.347646 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.348430 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.348430 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.348825 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.349024 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.349225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.349457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.349698 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.349904 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.349904 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.350301 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.350507 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.350721 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.350934 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.350934 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 19:00:59.351321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.351321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.351321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.351321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.351321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.351321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.351321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.351321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.352542 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.352542 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.352542 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.352542 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.353302 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.353302 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.353656 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.353864 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.354045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.354288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.354568 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.user = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.354859 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.355163 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.355437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.355729 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.356069 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.356357 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.356636 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.356912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.357187 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.357469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.357749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.358026 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.358310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.358600 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.358886 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.359176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.359464 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.359837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.360066 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.360335 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.360613 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.360898 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.361176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.361466 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.361764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.362041 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.362342 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.362615 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.362905 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.363183 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.364120 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.364336 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.364604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.364893 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.365168 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.365452 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.365736 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] resource.caching = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.366031 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.366327 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.366632 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.366926 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.367222 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.367499 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.367788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.368102 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.368394 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.368675 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] role.caching = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.368973 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] role.driver = sql {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.369247 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.369545 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.369837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.370133 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.370429 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.370725 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.371022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.371315 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.371610 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.371900 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.372331 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.372694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.373053 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.373412 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.373954 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.374301 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.374664 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.375091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.375427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.375787 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.376192 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.376557 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.376920 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.377271 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.377617 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.377971 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.378316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.378677 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.379084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.379966 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.380299 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.380471 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.380610 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.380747 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.380884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.381135 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.381471 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] token.caching = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.381857 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.382195 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.382522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.382872 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.383211 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.383541 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.383882 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.384251 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.384590 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.384916 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.385245 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.385569 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.385918 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.386261 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.386581 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.386914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.387299 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.387649 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] database.connection = **** {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.388018 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.388371 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.388701 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.389031 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.389362 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.389590 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.389736 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.390070 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.390393 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.390728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.391056 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.391390 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.391725 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.392106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.392433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.392767 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.393089 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.393423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.393748 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 19:00:59.394015 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 19:00:59.419575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.419847 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.420338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.420655 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.420980 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.431243 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.454275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.454610 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.480222 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.494877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.532335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.532596 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.537477 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.537809 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.602981 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.603246 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.603369 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.603499 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.603621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.603743 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.603887 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.604075 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.604194 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.604315 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.604436 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.604436 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.629122 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.629330 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.629506 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.629620 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.629743 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.629892 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.630006 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.630268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.630387 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.630507 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.630640 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.630755 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.630755 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.630976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.642423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.642668 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.655913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.656152 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.656281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.656402 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.656548 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.656663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.656788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.656914 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.657037 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.657158 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.657297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.657414 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.657536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80608) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.657658 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 19:00:59.675314 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.675557 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 19:00:59.675677 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.675810 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 19:00:59.676553 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.676732 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 19:00:59.676850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.676996 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 19:00:59.677108 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.677232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.677354 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.677475 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.677608 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.677728 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.677850 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.677972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.688858 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.689141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.689285 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.689411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.689534 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.689656 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.689780 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.689951 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.698405 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.698761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.701758 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.702036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.702181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.702308 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.702432 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.702694 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.702810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.702982 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.703099 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.703251 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.703367 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.703522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.703638 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.703802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.703920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.704101 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.704218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.704374 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.704507 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.704625 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.704751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.704997 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.732284 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.732693 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.733899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.734179 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.734527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.734818 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.739719 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.740027 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.740313 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.740432 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.740663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.740950 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.748136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.748438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.748558 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.748848 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.753631 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.754626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.754918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.755205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.755487 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.755637 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.755761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.755950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.756096 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.756264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.756381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.756548 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.756820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.757100 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.757367 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.757633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.776045 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.777025 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.778165 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.778551 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.782488 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.783232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.787021 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.787324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.787622 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.787919 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.792934 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.793118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.796949 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.797106 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.801807 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.802156 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.802435 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.802806 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.803080 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.803448 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.803700 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.804086 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.804385 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.804686 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.804971 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.805254 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.823902 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.824328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.824597 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.824859 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.825628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.825953 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.826226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.826506 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.833467 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.835246 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.835406 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.835528 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.837179 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.837461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.838607 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.838897 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.839176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.839454 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.839726 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.840628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.840917 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.841199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.841496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.841794 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.854109 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.854409 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.854682 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.854961 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.855283 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.855564 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.855852 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.856454 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.856810 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.857098 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.857380 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.857662 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.857936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.858216 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.874602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.877101 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.877964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.880532 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.881352 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.882967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.883919 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.884638 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.884919 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.885194 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.885561 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.887251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.887538 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.887824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.892759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.894396 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.895495 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.897203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.897693 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.897984 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.898267 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.898549 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.900461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.900753 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.901037 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.901315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.907952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.908274 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.908554 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.911139 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.911442 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.911847 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.917107 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80608) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.917400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.917683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.917957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.918225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.918504 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.918774 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.919048 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.919318 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.919579 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.919854 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.920097 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 19:00:59.920255 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.920420 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.920570 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.920721 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80608) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.920873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.921025 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.921226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.921531 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.921809 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.922085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.922356 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.922626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.922898 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.923181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.923456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.923716 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 19:00:59.960082 dv-cinder-797608-28-smb devstack@keystone.service[80608]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x557b3c0389c0 pid: 80608 (default app) Jun 02 19:00:59.963304 dv-cinder-797608-28-smb devstack@keystone.service[80609]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x557b3c0389c0 pid: 80609 (default app) Jun 02 19:00:59.963755 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04580598-c4ad-462e-b32c-2ffc97759fde None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:00:59.964089 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04580598-c4ad-462e-b32c-2ffc97759fde None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:00:59.964370 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04580598-c4ad-462e-b32c-2ffc97759fde None None] PATH_INFO: `/v3` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:00:59.968771 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 791 bytes} [Thu Jun 2 19:00:59 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:09.317399 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f65a42-0478-4fb5-8cfc-054ec0a3012e None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:09.317939 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f65a42-0478-4fb5-8cfc-054ec0a3012e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:09.317939 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f65a42-0478-4fb5-8cfc-054ec0a3012e None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:09.322514 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:01:09.328527 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647db1a-bca2-45da-9606-d4105ceb512d None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:09.329294 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647db1a-bca2-45da-9606-d4105ceb512d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:09.329294 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647db1a-bca2-45da-9606-d4105ceb512d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:09.399784 dv-cinder-797608-28-smb devstack@keystone.service[80608]: INFO dbcounter [None req-4647db1a-bca2-45da-9606-d4105ceb512d None None] Registered counter for database keystone Jun 02 19:01:09.421802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG oslo_db.sqlalchemy.engines [None req-4647db1a-bca2-45da-9606-d4105ceb512d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80608) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 19:01:09.428852 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writer thread running {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 19:01:09.614418 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG passlib.handlers.bcrypt [None req-4647db1a-bca2-45da-9606-d4105ceb512d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80608) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 02 19:01:09.614831 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG passlib.handlers.bcrypt [None req-4647db1a-bca2-45da-9606-d4105ceb512d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80608) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 02 19:01:09.673098 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-4647db1a-bca2-45da-9606-d4105ceb512d None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:09.674869 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-4647db1a-bca2-45da-9606-d4105ceb512d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:09.864679 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 537 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 02 19:01:10.026454 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f65a42-0478-4fb5-8cfc-054ec0a3012e None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:10.096116 dv-cinder-797608-28-smb devstack@keystone.service[80609]: INFO dbcounter [None req-15f65a42-0478-4fb5-8cfc-054ec0a3012e None None] Registered counter for database keystone Jun 02 19:01:10.117194 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG oslo_db.sqlalchemy.engines [None req-15f65a42-0478-4fb5-8cfc-054ec0a3012e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80609) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 19:01:10.123666 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writer thread running {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 19:01:10.352234 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f65a42-0478-4fb5-8cfc-054ec0a3012e None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:10.356743 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b415cbf-689d-41ef-94f9-e064dd31dfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:10.357417 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b415cbf-689d-41ef-94f9-e064dd31dfb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:10.357705 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b415cbf-689d-41ef-94f9-e064dd31dfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:10.357980 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b415cbf-689d-41ef-94f9-e064dd31dfb7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:10.366980 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b415cbf-689d-41ef-94f9-e064dd31dfb7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:10.420775 dv-cinder-797608-28-smb devstack@keystone.service[80609]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0b415cbf-689d-41ef-94f9-e064dd31dfb7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 02 19:01:10.421024 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b415cbf-689d-41ef-94f9-e064dd31dfb7 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:10.432421 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1324 bytes} [Thu Jun 2 19:01:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 19:01:10.438988 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647db1a-bca2-45da-9606-d4105ceb512d None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:10.454773 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647db1a-bca2-45da-9606-d4105ceb512d None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:10.460295 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af40ff-60ec-49b4-a1c0-f9e66ec6a1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:10.461515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af40ff-60ec-49b4-a1c0-f9e66ec6a1db admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:10.461808 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af40ff-60ec-49b4-a1c0-f9e66ec6a1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:10.462088 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af40ff-60ec-49b4-a1c0-f9e66ec6a1db admin admin] PATH_INFO: `/v3/projects/cc622f67162c4bdeb3f3fd1a3419d2ab` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:10.463892 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af40ff-60ec-49b4-a1c0-f9e66ec6a1db admin admin] RBAC: Authorizing `identity:get_project(project_id=cc622f67162c4bdeb3f3fd1a3419d2ab)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:10.636481 dv-cinder-797608-28-smb devstack@keystone.service[80608]: WARNING keystone.common.rbac_enforcer.enforcer [None req-50af40ff-60ec-49b4-a1c0-f9e66ec6a1db admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 02 19:01:10.636823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af40ff-60ec-49b4-a1c0-f9e66ec6a1db admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:10.641823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 3/5] 10.222.0.45 () {56 vars in 1207 bytes} [Thu Jun 2 19:01:10 2022] GET /identity/v3/projects/cc622f67162c4bdeb3f3fd1a3419d2ab => generated 344 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:12.969599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd8c32-b677-4bf3-a28b-13ed69e278e8 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:12.970145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd8c32-b677-4bf3-a28b-13ed69e278e8 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:12.970261 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd8c32-b677-4bf3-a28b-13ed69e278e8 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:12.975550 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 3/6] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:01:12.982123 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde33c3-ddbb-49d0-b999-2ddb65c9d79e None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:12.982660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde33c3-ddbb-49d0-b999-2ddb65c9d79e None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:12.982660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde33c3-ddbb-49d0-b999-2ddb65c9d79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:13.004659 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-4cde33c3-ddbb-49d0-b999-2ddb65c9d79e None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:13.006347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-4cde33c3-ddbb-49d0-b999-2ddb65c9d79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:13.014848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 02 19:01:13.041068 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd8c32-b677-4bf3-a28b-13ed69e278e8 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:13.055818 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd8c32-b677-4bf3-a28b-13ed69e278e8 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:13.060422 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5a60e-1427-4da7-809e-fd032e54c160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:13.061109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5a60e-1427-4da7-809e-fd032e54c160 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:13.061397 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5a60e-1427-4da7-809e-fd032e54c160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:13.061679 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5a60e-1427-4da7-809e-fd032e54c160 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:13.072074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5a60e-1427-4da7-809e-fd032e54c160 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:13.074058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5a60e-1427-4da7-809e-fd032e54c160 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:13.084729 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1324 bytes} [Thu Jun 2 19:01:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 19:01:13.091018 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde33c3-ddbb-49d0-b999-2ddb65c9d79e None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:13.101890 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde33c3-ddbb-49d0-b999-2ddb65c9d79e None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:13.106632 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe65bc5-feb1-4bed-9d54-cf2e8eda72ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:13.107611 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe65bc5-feb1-4bed-9d54-cf2e8eda72ea admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:13.107947 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe65bc5-feb1-4bed-9d54-cf2e8eda72ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:13.108296 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe65bc5-feb1-4bed-9d54-cf2e8eda72ea admin admin] PATH_INFO: `/v3/users/1a0014c58c4c4ce1bf436c7c1e5d03c7` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:13.109922 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe65bc5-feb1-4bed-9d54-cf2e8eda72ea admin admin] RBAC: Authorizing `identity:get_user(user_id=1a0014c58c4c4ce1bf436c7c1e5d03c7)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:13.111869 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe65bc5-feb1-4bed-9d54-cf2e8eda72ea admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:13.114170 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 5/9] 10.222.0.45 () {56 vars in 1198 bytes} [Thu Jun 2 19:01:13 2022] GET /identity/v3/users/1a0014c58c4c4ce1bf436c7c1e5d03c7 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:01:15.593146 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee3b25-7035-4716-8f1a-314def3668a7 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:15.594205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee3b25-7035-4716-8f1a-314def3668a7 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:15.594205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee3b25-7035-4716-8f1a-314def3668a7 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:15.595549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:01:15.602238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a553d-20df-487a-a505-6c403373b7b8 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:15.603053 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a553d-20df-487a-a505-6c403373b7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:15.603053 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a553d-20df-487a-a505-6c403373b7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:15.622931 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-4c7a553d-20df-487a-a505-6c403373b7b8 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:15.624275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-4c7a553d-20df-487a-a505-6c403373b7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:15.722032 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 6/11] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:01:15.746999 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee3b25-7035-4716-8f1a-314def3668a7 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:15.952508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee3b25-7035-4716-8f1a-314def3668a7 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:15.993544 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a5a34-67a7-492f-bb52-995d0d32ac9c None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:15.993966 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a5a34-67a7-492f-bb52-995d0d32ac9c None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:15.994357 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a5a34-67a7-492f-bb52-995d0d32ac9c None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:15.994514 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee274266-6fc9-44f3-881b-6a1d326b5d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:15.995263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee274266-6fc9-44f3-881b-6a1d326b5d95 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:15.995519 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee274266-6fc9-44f3-881b-6a1d326b5d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:15.995796 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee274266-6fc9-44f3-881b-6a1d326b5d95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:15.996278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 7/12] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:01:16.002387 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12398aa-8fef-4d12-a895-55ab0b2e7a22 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.002809 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12398aa-8fef-4d12-a895-55ab0b2e7a22 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.003226 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12398aa-8fef-4d12-a895-55ab0b2e7a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.015535 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee274266-6fc9-44f3-881b-6a1d326b5d95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:01:16.022007 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-d12398aa-8fef-4d12-a895-55ab0b2e7a22 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:16.023248 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-d12398aa-8fef-4d12-a895-55ab0b2e7a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:16.027127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-ee274266-6fc9-44f3-881b-6a1d326b5d95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:01:16.027127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:01:16.027127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:01:16.027127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:01:16.027127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:01:16.027127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:01:16.027127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:01:16.027127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:01:16.027127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:01:16.027127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:01:16.027127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:01:16.027127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:01:16.027127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:01:16.027127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:01:16.027127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:01:16.027127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:01:16.028067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:01:16.028067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:01:16.028067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:01:16.028067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:01:16.028067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:01:16.028067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:01:16.028067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:01:16.028067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:01:16.028067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:01:16.028067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:01:16.028067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:01:16.028067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:01:16.028067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:01:16.028067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:01:16.028067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:01:16.028067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:01:16.028917 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:01:16.028917 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:01:16.028917 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:01:16.028917 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:01:16.028917 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:01:16.028917 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:01:16.028917 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:01:16.028917 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:01:16.028917 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:01:16.028917 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:01:16.028917 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:01:16.028917 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:01:16.028917 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 6/13] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:01:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:01:16.034604 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee274266-6fc9-44f3-881b-6a1d326b5d95 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.044052 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:16.076533 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:16.114771 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 8/14] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 19:01:16.154046 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12398aa-8fef-4d12-a895-55ab0b2e7a22 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.188083 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee274266-6fc9-44f3-881b-6a1d326b5d95 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.240065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40199794-2a8b-4f40-9f79-93f5f962f74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.240837 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40199794-2a8b-4f40-9f79-93f5f962f74b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.241212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40199794-2a8b-4f40-9f79-93f5f962f74b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.241581 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40199794-2a8b-4f40-9f79-93f5f962f74b None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.242606 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40199794-2a8b-4f40-9f79-93f5f962f74b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:16.243019 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40199794-2a8b-4f40-9f79-93f5f962f74b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.244900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40199794-2a8b-4f40-9f79-93f5f962f74b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.259615 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 7/15] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:01:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:01:16.265366 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40199794-2a8b-4f40-9f79-93f5f962f74b None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.319384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12398aa-8fef-4d12-a895-55ab0b2e7a22 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.371346 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779dba19-c627-4733-bf03-8db7e8a93a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.372435 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779dba19-c627-4733-bf03-8db7e8a93a24 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.372955 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779dba19-c627-4733-bf03-8db7e8a93a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.373370 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779dba19-c627-4733-bf03-8db7e8a93a24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.388912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:16.396482 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40199794-2a8b-4f40-9f79-93f5f962f74b None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.406064 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:16.444111 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e7492-8bd5-4533-a3d6-cbbb64a757e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.445127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e7492-8bd5-4533-a3d6-cbbb64a757e8 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.445499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e7492-8bd5-4533-a3d6-cbbb64a757e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.445885 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e7492-8bd5-4533-a3d6-cbbb64a757e8 None admin] PATH_INFO: `/v3/users/1a0014c58c4c4ce1bf436c7c1e5d03c7` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.447916 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e7492-8bd5-4533-a3d6-cbbb64a757e8 None admin] RBAC: Authorizing `identity:get_user(user_id=1a0014c58c4c4ce1bf436c7c1e5d03c7)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.449541 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e7492-8bd5-4533-a3d6-cbbb64a757e8 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.451669 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 8/16] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:01:16 2022] GET /identity/v3/users/1a0014c58c4c4ce1bf436c7c1e5d03c7 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:16.458427 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e7492-8bd5-4533-a3d6-cbbb64a757e8 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.469767 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779dba19-c627-4733-bf03-8db7e8a93a24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.473449 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779dba19-c627-4733-bf03-8db7e8a93a24 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.607289 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e7492-8bd5-4533-a3d6-cbbb64a757e8 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.618685 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 9/17] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:01:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 19:01:16.628386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779dba19-c627-4733-bf03-8db7e8a93a24 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.660776 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be036167-bb9e-464a-9c0c-9147172a9b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.661873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be036167-bb9e-464a-9c0c-9147172a9b99 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.662323 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be036167-bb9e-464a-9c0c-9147172a9b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.662740 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be036167-bb9e-464a-9c0c-9147172a9b99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.664334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be036167-bb9e-464a-9c0c-9147172a9b99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.666346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be036167-bb9e-464a-9c0c-9147172a9b99 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.668288 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 9/18] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:01:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:01:16.677912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be036167-bb9e-464a-9c0c-9147172a9b99 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.689749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:16.716674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:16.749952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779dba19-c627-4733-bf03-8db7e8a93a24 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.796737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad73fd-e01b-40bb-a976-163dda3a8151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.798070 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad73fd-e01b-40bb-a976-163dda3a8151 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.798524 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad73fd-e01b-40bb-a976-163dda3a8151 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.798968 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad73fd-e01b-40bb-a976-163dda3a8151 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.815759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad73fd-e01b-40bb-a976-163dda3a8151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.818946 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad73fd-e01b-40bb-a976-163dda3a8151 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.823792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be036167-bb9e-464a-9c0c-9147172a9b99 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.855443 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-d1ad73fd-e01b-40bb-a976-163dda3a8151 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:01:16.855443 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:01:16.855443 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:01:16.855443 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:01:16.855443 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:01:16.855443 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:01:16.855443 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:01:16.855443 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:01:16.855443 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:01:16.855443 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:01:16.855443 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:01:16.855443 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:01:16.855443 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:01:16.855443 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:01:16.855443 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:01:16.856939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:01:16.856939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:01:16.856939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:01:16.856939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:01:16.856939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:01:16.856939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:01:16.856939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:01:16.856939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:01:16.856939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:01:16.856939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:01:16.856939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:01:16.856939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:01:16.856939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:01:16.856939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:01:16.856939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:01:16.856939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:01:16.856939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:01:16.858519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:01:16.858519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:01:16.858519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:01:16.858519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:01:16.858519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 10/19] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:01:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:01:16.865831 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad73fd-e01b-40bb-a976-163dda3a8151 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.881572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b43c955-9874-4fcf-bbe6-34e7d3c8d47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.882268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43c955-9874-4fcf-bbe6-34e7d3c8d47e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.882562 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43c955-9874-4fcf-bbe6-34e7d3c8d47e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.882849 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43c955-9874-4fcf-bbe6-34e7d3c8d47e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.883736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b43c955-9874-4fcf-bbe6-34e7d3c8d47e None admin] RBAC: Adding query filter params (role.id=4588ca63994f4e2d9ce482d475edbabd, scope.domain.id=default, user.id=1a0014c58c4c4ce1bf436c7c1e5d03c7) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:16.884095 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b43c955-9874-4fcf-bbe6-34e7d3c8d47e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.885660 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b43c955-9874-4fcf-bbe6-34e7d3c8d47e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.895473 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 10/20] 10.222.0.45 () {56 vars in 1322 bytes} [Thu Jun 2 19:01:16 2022] GET /identity/v3/role_assignments?user.id=1a0014c58c4c4ce1bf436c7c1e5d03c7&scope.domain.id=default&role.id=4588ca63994f4e2d9ce482d475edbabd => generated 233 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:16.996176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad73fd-e01b-40bb-a976-163dda3a8151 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.999490 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:17.042278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e6a7e-11e2-4ae6-8ff8-f7eeaeaaa4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:17.043137 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e6a7e-11e2-4ae6-8ff8-f7eeaeaaa4ab None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.043531 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e6a7e-11e2-4ae6-8ff8-f7eeaeaaa4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.043931 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e6a7e-11e2-4ae6-8ff8-f7eeaeaaa4ab None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:17.044900 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e6a7e-11e2-4ae6-8ff8-f7eeaeaaa4ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:17.045323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e6a7e-11e2-4ae6-8ff8-f7eeaeaaa4ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:17.046959 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e6a7e-11e2-4ae6-8ff8-f7eeaeaaa4ab None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:17.069577 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 11/21] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:01:20.233245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d9c81-7f29-4c6c-a680-4c260e02e09e None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:20.233768 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d9c81-7f29-4c6c-a680-4c260e02e09e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:20.234218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d9c81-7f29-4c6c-a680-4c260e02e09e None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:20.237073 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 11/22] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:20.244285 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf2b4e-ce73-4a58-8527-6d3741fff689 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:20.244782 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf2b4e-ce73-4a58-8527-6d3741fff689 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:20.245283 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf2b4e-ce73-4a58-8527-6d3741fff689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:20.286750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-3ebf2b4e-ce73-4a58-8527-6d3741fff689 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:20.288837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-3ebf2b4e-ce73-4a58-8527-6d3741fff689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:20.455977 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 12/23] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:01:20.492620 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d9c81-7f29-4c6c-a680-4c260e02e09e None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:20.733886 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:20.745884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d9c81-7f29-4c6c-a680-4c260e02e09e None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:20.784465 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dce4e7-3c3f-4449-9b2a-ce03bb643045 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:20.785520 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dce4e7-3c3f-4449-9b2a-ce03bb643045 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:20.786020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dce4e7-3c3f-4449-9b2a-ce03bb643045 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:20.788739 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 13/24] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:20.796725 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a424b-4bf8-411d-af1b-aef7a63d662d None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:20.797032 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a424b-4bf8-411d-af1b-aef7a63d662d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:20.799621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a424b-4bf8-411d-af1b-aef7a63d662d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:20.799782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed678d-18bd-4e9f-b173-be1dafbcf0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:20.799782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed678d-18bd-4e9f-b173-be1dafbcf0db None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:20.799782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed678d-18bd-4e9f-b173-be1dafbcf0db None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:20.799782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed678d-18bd-4e9f-b173-be1dafbcf0db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:20.829238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed678d-18bd-4e9f-b173-be1dafbcf0db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:01:20.838161 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-47ed678d-18bd-4e9f-b173-be1dafbcf0db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:01:20.838161 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:01:20.838161 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:01:20.838161 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:01:20.838161 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:01:20.838161 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:01:20.838161 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:01:20.838161 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:01:20.838161 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:01:20.838161 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:01:20.838161 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:01:20.838161 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:01:20.838161 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:01:20.838161 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:01:20.838161 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:01:20.838161 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:01:20.839058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:01:20.839058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:01:20.839058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:01:20.839058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:01:20.839058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:01:20.839058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:01:20.839058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:01:20.839058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:01:20.839058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:01:20.839058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:01:20.839058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:01:20.839058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:01:20.839058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:01:20.839058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:01:20.839058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:01:20.839058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:01:20.839787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:01:20.839787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:01:20.839787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:01:20.839787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:01:20.839787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:01:20.839787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:01:20.839787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:01:20.839787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:01:20.839787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:01:20.839787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:01:20.839787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:01:20.839787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:01:20.848519 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 12/25] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:01:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:01:20.849532 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed678d-18bd-4e9f-b173-be1dafbcf0db None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:20.849987 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-768a424b-4bf8-411d-af1b-aef7a63d662d None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:20.852150 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-768a424b-4bf8-411d-af1b-aef7a63d662d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:21.048036 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed678d-18bd-4e9f-b173-be1dafbcf0db None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:21.078437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 14/26] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:01:21.110227 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854d301-7d7b-49b4-ac51-298653c5d72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:21.110909 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854d301-7d7b-49b4-ac51-298653c5d72a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:21.111194 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854d301-7d7b-49b4-ac51-298653c5d72a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:21.111469 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854d301-7d7b-49b4-ac51-298653c5d72a None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:21.112271 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854d301-7d7b-49b4-ac51-298653c5d72a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:21.112580 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854d301-7d7b-49b4-ac51-298653c5d72a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:21.114754 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854d301-7d7b-49b4-ac51-298653c5d72a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:21.130592 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 13/27] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:01:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:21.136492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a424b-4bf8-411d-af1b-aef7a63d662d None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:21.146108 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854d301-7d7b-49b4-ac51-298653c5d72a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:21.200792 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:21.220431 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:21.414180 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a424b-4bf8-411d-af1b-aef7a63d662d None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:21.505194 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854d301-7d7b-49b4-ac51-298653c5d72a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:21.552548 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012970ec-3a91-4f04-8da7-7f9b8e10c48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:21.554077 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012970ec-3a91-4f04-8da7-7f9b8e10c48f None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:21.554588 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012970ec-3a91-4f04-8da7-7f9b8e10c48f None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:21.555076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012970ec-3a91-4f04-8da7-7f9b8e10c48f None admin] PATH_INFO: `/v3/users/1a0014c58c4c4ce1bf436c7c1e5d03c7` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:21.559157 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012970ec-3a91-4f04-8da7-7f9b8e10c48f None admin] RBAC: Authorizing `identity:get_user(user_id=1a0014c58c4c4ce1bf436c7c1e5d03c7)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:21.561986 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012970ec-3a91-4f04-8da7-7f9b8e10c48f None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:21.565070 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 15/28] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:01:21 2022] GET /identity/v3/users/1a0014c58c4c4ce1bf436c7c1e5d03c7 => generated 247 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:21.573738 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012970ec-3a91-4f04-8da7-7f9b8e10c48f None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:21.600071 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a321e-766e-42fa-8a4a-17b75347f15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:21.600891 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a321e-766e-42fa-8a4a-17b75347f15e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:21.601176 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a321e-766e-42fa-8a4a-17b75347f15e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:21.601451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a321e-766e-42fa-8a4a-17b75347f15e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:21.632871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a321e-766e-42fa-8a4a-17b75347f15e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:21.634464 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a321e-766e-42fa-8a4a-17b75347f15e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:21.666486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-e19a321e-766e-42fa-8a4a-17b75347f15e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:01:21.666486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:01:21.666486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:01:21.666486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:01:21.666486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:01:21.666486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:01:21.666486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:01:21.666486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:01:21.666486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:01:21.666486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:01:21.666486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:01:21.666486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:01:21.666486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:01:21.666486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:01:21.666486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:01:21.667319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:01:21.667319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:01:21.667319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:01:21.667319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:01:21.667319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:01:21.667319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:01:21.667319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:01:21.667319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:01:21.667319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:01:21.667319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:01:21.667319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:01:21.667319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:01:21.667319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:01:21.667319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:01:21.667319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:01:21.667319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:01:21.667319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:01:21.668195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:01:21.668195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:01:21.668195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:01:21.668195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:01:21.668195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 14/29] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 523 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:01:21.677932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a321e-766e-42fa-8a4a-17b75347f15e None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:21.785173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:21.821328 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a321e-766e-42fa-8a4a-17b75347f15e None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:21.880439 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:21.896927 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012970ec-3a91-4f04-8da7-7f9b8e10c48f None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:21.905370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf4acd-afc6-4ee5-8ba9-a37f35c75b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:21.906060 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf4acd-afc6-4ee5-8ba9-a37f35c75b08 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:21.906348 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf4acd-afc6-4ee5-8ba9-a37f35c75b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:21.906630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf4acd-afc6-4ee5-8ba9-a37f35c75b08 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:21.907383 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf4acd-afc6-4ee5-8ba9-a37f35c75b08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:21.907699 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf4acd-afc6-4ee5-8ba9-a37f35c75b08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:21.909168 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf4acd-afc6-4ee5-8ba9-a37f35c75b08 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:21.939101 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 15/30] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:21.940427 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b640725-4e38-4e5c-ac71-0141a3e91267 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:21.940723 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b640725-4e38-4e5c-ac71-0141a3e91267 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:21.941038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b640725-4e38-4e5c-ac71-0141a3e91267 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:21.943794 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 16/31] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:21.952594 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b640725-4e38-4e5c-ac71-0141a3e91267 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:21.959779 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1e5a8-a2d3-4a3b-810c-00225992939f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:21.960630 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1e5a8-a2d3-4a3b-810c-00225992939f None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:21.960918 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1e5a8-a2d3-4a3b-810c-00225992939f None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:21.961196 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1e5a8-a2d3-4a3b-810c-00225992939f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:21.963271 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1e5a8-a2d3-4a3b-810c-00225992939f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:21.964851 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1e5a8-a2d3-4a3b-810c-00225992939f None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:21.971857 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 16/32] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:01:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:21.974862 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44032cf3-2362-4c84-a8dd-3e9bd4c3f3a0 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:21.975400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44032cf3-2362-4c84-a8dd-3e9bd4c3f3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:21.975930 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44032cf3-2362-4c84-a8dd-3e9bd4c3f3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:22.029278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-44032cf3-2362-4c84-a8dd-3e9bd4c3f3a0 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:22.030552 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-44032cf3-2362-4c84-a8dd-3e9bd4c3f3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:22.172723 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 17/33] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:01:22.173699 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44032cf3-2362-4c84-a8dd-3e9bd4c3f3a0 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:22.197297 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b640725-4e38-4e5c-ac71-0141a3e91267 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:22.260955 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:22.271467 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c4a34-7cfd-4bd5-a2ba-045f62ca8c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:22.272711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c4a34-7cfd-4bd5-a2ba-045f62ca8c78 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:22.273225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c4a34-7cfd-4bd5-a2ba-045f62ca8c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:22.273718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c4a34-7cfd-4bd5-a2ba-045f62ca8c78 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:22.276134 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c4a34-7cfd-4bd5-a2ba-045f62ca8c78 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:22.278341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c4a34-7cfd-4bd5-a2ba-045f62ca8c78 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:22.335571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:22.348498 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44032cf3-2362-4c84-a8dd-3e9bd4c3f3a0 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:22.386569 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac7a6e-c8f7-4fbe-bfbe-68ec139925f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:22.387570 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac7a6e-c8f7-4fbe-bfbe-68ec139925f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:22.387857 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac7a6e-c8f7-4fbe-bfbe-68ec139925f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:22.388177 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac7a6e-c8f7-4fbe-bfbe-68ec139925f8 None admin] PATH_INFO: `/v3/domains/default/users/1a0014c58c4c4ce1bf436c7c1e5d03c7/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:22.390665 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac7a6e-c8f7-4fbe-bfbe-68ec139925f8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1a0014c58c4c4ce1bf436c7c1e5d03c7, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:22.392255 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac7a6e-c8f7-4fbe-bfbe-68ec139925f8 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:22.532683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 17/34] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jun 2 19:01:21 2022] POST /identity/v3/projects => generated 301 bytes in 584 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:22.533587 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c4a34-7cfd-4bd5-a2ba-045f62ca8c78 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:22.645917 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 18/35] 10.222.0.45 () {58 vars in 1361 bytes} [Thu Jun 2 19:01:22 2022] PUT /identity/v3/domains/default/users/1a0014c58c4c4ce1bf436c7c1e5d03c7/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:22.650606 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4098f4a-7f18-4e34-be8e-b580c62ba60f None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:22.651175 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4098f4a-7f18-4e34-be8e-b580c62ba60f None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:22.651675 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4098f4a-7f18-4e34-be8e-b580c62ba60f None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:22.661322 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 19/36] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:22 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:22.663788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e23606-a988-4e31-8e88-59317282864c None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:22.664332 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e23606-a988-4e31-8e88-59317282864c None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:22.664842 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e23606-a988-4e31-8e88-59317282864c None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:22.667772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 20/37] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:22.677531 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02114110-c0e7-4e80-a713-30287f21db93 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:22.678013 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02114110-c0e7-4e80-a713-30287f21db93 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:22.678507 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02114110-c0e7-4e80-a713-30287f21db93 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:22.681789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 21/38] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:22 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:22.683006 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c4a34-7cfd-4bd5-a2ba-045f62ca8c78 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:22.683972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f2a38-8204-47a0-9847-06ba1cc85a4a None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:22.684476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f2a38-8204-47a0-9847-06ba1cc85a4a None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:22.684930 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f2a38-8204-47a0-9847-06ba1cc85a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:22.726722 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-240f2a38-8204-47a0-9847-06ba1cc85a4a None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:22.729673 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-240f2a38-8204-47a0-9847-06ba1cc85a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:22.748425 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf3a53-b384-462d-a876-a98a8298a95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:22.750127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf3a53-b384-462d-a876-a98a8298a95a None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:22.751053 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf3a53-b384-462d-a876-a98a8298a95a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:22.751817 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf3a53-b384-462d-a876-a98a8298a95a None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:22.754407 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf3a53-b384-462d-a876-a98a8298a95a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:22.757830 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf3a53-b384-462d-a876-a98a8298a95a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:22.881284 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 22/39] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:01:22.881523 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 18/40] 10.222.0.45 () {60 vars in 1131 bytes} [Thu Jun 2 19:01:22 2022] POST /identity/v3/roles => generated 219 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:22.882847 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7d115-9379-4dd5-9294-64b194584a22 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:22.883219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7d115-9379-4dd5-9294-64b194584a22 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:22.883580 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7d115-9379-4dd5-9294-64b194584a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:22.885447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b29594-1a5b-4f75-9fd2-df0d034850c8 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:22.886279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b29594-1a5b-4f75-9fd2-df0d034850c8 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:22.887087 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b29594-1a5b-4f75-9fd2-df0d034850c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:22.907307 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG passlib.handlers.bcrypt [None req-92b7d115-9379-4dd5-9294-64b194584a22 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80609) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 02 19:01:22.907744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG passlib.handlers.bcrypt [None req-92b7d115-9379-4dd5-9294-64b194584a22 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80609) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 02 19:01:22.922116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-c1b29594-1a5b-4f75-9fd2-df0d034850c8 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:22.924669 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c1b29594-1a5b-4f75-9fd2-df0d034850c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:22.958510 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-92b7d115-9379-4dd5-9294-64b194584a22 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:22.960265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-92b7d115-9379-4dd5-9294-64b194584a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:23.034432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 23/41] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:01:23.035945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b29594-1a5b-4f75-9fd2-df0d034850c8 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:23.060998 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:23.080685 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:23.154698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 19/42] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:01:23.156785 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7d115-9379-4dd5-9294-64b194584a22 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:23.229063 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b29594-1a5b-4f75-9fd2-df0d034850c8 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:23.290784 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfeaf6-cd00-4aa0-a4a3-47bf78f436c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:23.291774 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfeaf6-cd00-4aa0-a4a3-47bf78f436c2 None admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:23.292233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfeaf6-cd00-4aa0-a4a3-47bf78f436c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:23.292679 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfeaf6-cd00-4aa0-a4a3-47bf78f436c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:23.293612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfeaf6-cd00-4aa0-a4a3-47bf78f436c2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:23.295358 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfeaf6-cd00-4aa0-a4a3-47bf78f436c2 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:23.307461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7d115-9379-4dd5-9294-64b194584a22 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:23.349084 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61620bd6-6c80-4986-9538-7a369bd6399d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:23.350192 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61620bd6-6c80-4986-9538-7a369bd6399d None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:23.350548 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61620bd6-6c80-4986-9538-7a369bd6399d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:23.350902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61620bd6-6c80-4986-9538-7a369bd6399d None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:23.351961 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61620bd6-6c80-4986-9538-7a369bd6399d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:23.353538 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61620bd6-6c80-4986-9538-7a369bd6399d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:23.368346 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 24/43] 10.222.0.45 () {60 vars in 1131 bytes} [Thu Jun 2 19:01:23 2022] POST /identity/v3/roles => generated 223 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:23.369461 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfeaf6-cd00-4aa0-a4a3-47bf78f436c2 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:23.449243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 20/44] 10.222.0.45 () {60 vars in 1131 bytes} [Thu Jun 2 19:01:23 2022] POST /identity/v3/roles => generated 225 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:23.509187 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:23.575875 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfeaf6-cd00-4aa0-a4a3-47bf78f436c2 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:23.647359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d748461-e477-4a25-806d-b15363e7f13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:23.648730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d748461-e477-4a25-806d-b15363e7f13b None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:23.649233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d748461-e477-4a25-806d-b15363e7f13b None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:23.649801 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d748461-e477-4a25-806d-b15363e7f13b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:23.652397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d748461-e477-4a25-806d-b15363e7f13b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:23.655330 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d748461-e477-4a25-806d-b15363e7f13b None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:23.658804 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 25/45] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:01:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:23.666564 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61620bd6-6c80-4986-9538-7a369bd6399d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:23.722824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:23.834123 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61620bd6-6c80-4986-9538-7a369bd6399d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:23.896658 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d441d-355d-4e53-be42-820b37db267d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:23.897835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d441d-355d-4e53-be42-820b37db267d None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:23.898282 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d441d-355d-4e53-be42-820b37db267d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:23.898773 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d441d-355d-4e53-be42-820b37db267d None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:23.900618 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d441d-355d-4e53-be42-820b37db267d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:23.903489 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d441d-355d-4e53-be42-820b37db267d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:24.009239 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 21/46] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jun 2 19:01:23 2022] POST /identity/v3/projects => generated 312 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:25.480232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcec55-9576-4313-b9ba-e40e5270fdb2 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:25.481043 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcec55-9576-4313-b9ba-e40e5270fdb2 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:25.481043 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcec55-9576-4313-b9ba-e40e5270fdb2 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:25.482151 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 26/47] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:01:25.488877 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d1ba6-3739-4ac2-8f2b-c024488b20d1 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:25.489360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d1ba6-3739-4ac2-8f2b-c024488b20d1 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:25.489834 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d1ba6-3739-4ac2-8f2b-c024488b20d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:25.516511 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-0e1d1ba6-3739-4ac2-8f2b-c024488b20d1 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:25.518556 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0e1d1ba6-3739-4ac2-8f2b-c024488b20d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:25.636165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 22/48] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:01:25.659668 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcec55-9576-4313-b9ba-e40e5270fdb2 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:25.778731 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcec55-9576-4313-b9ba-e40e5270fdb2 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:25.821001 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081e299-5e83-48af-be31-7522e29f3b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:25.821917 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081e299-5e83-48af-be31-7522e29f3b76 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:25.822391 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081e299-5e83-48af-be31-7522e29f3b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:25.822757 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081e299-5e83-48af-be31-7522e29f3b76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:25.832307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:25.837496 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081e299-5e83-48af-be31-7522e29f3b76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:01:25.847517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-1081e299-5e83-48af-be31-7522e29f3b76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:01:25.847517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:01:25.847517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:01:25.847517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:01:25.847517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:01:25.847517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:01:25.847517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:01:25.847517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:01:25.847517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:01:25.847517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:01:25.847517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:01:25.847517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:01:25.847517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:01:25.847517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:01:25.847517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:01:25.847517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:01:25.849223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:01:25.849223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:01:25.849223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:01:25.849223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:01:25.849223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:01:25.849223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:01:25.849223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:01:25.849223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:01:25.849223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:01:25.849223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:01:25.849223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:01:25.849223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:01:25.849223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:01:25.849223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:01:25.849223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:01:25.849223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:01:25.850620 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:01:25.850620 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:01:25.850620 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:01:25.850620 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:01:25.850620 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:01:25.850620 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:01:25.850620 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:01:25.850620 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:01:25.850620 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:01:25.850620 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:01:25.850620 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:01:25.850620 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:01:25.850620 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 27/49] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:01:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:01:25.856817 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d1ba6-3739-4ac2-8f2b-c024488b20d1 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:25.874696 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:26.007527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d1ba6-3739-4ac2-8f2b-c024488b20d1 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:26.073126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c7f23-c039-4761-9b73-9aa0b66b0ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:26.074206 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c7f23-c039-4761-9b73-9aa0b66b0ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:26.074654 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c7f23-c039-4761-9b73-9aa0b66b0ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:26.075150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c7f23-c039-4761-9b73-9aa0b66b0ea7 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:26.076611 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c7f23-c039-4761-9b73-9aa0b66b0ea7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:26.077173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c7f23-c039-4761-9b73-9aa0b66b0ea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:26.079862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c7f23-c039-4761-9b73-9aa0b66b0ea7 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:26.097561 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 23/50] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:01:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:01:26.104109 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081e299-5e83-48af-be31-7522e29f3b76 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:26.220488 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081e299-5e83-48af-be31-7522e29f3b76 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:26.264999 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74487e4-4d75-42d7-8cfc-236e94de7492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:26.266048 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74487e4-4d75-42d7-8cfc-236e94de7492 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:26.266419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74487e4-4d75-42d7-8cfc-236e94de7492 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:26.266800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74487e4-4d75-42d7-8cfc-236e94de7492 None admin] PATH_INFO: `/v3/users/1a0014c58c4c4ce1bf436c7c1e5d03c7` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:26.268329 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74487e4-4d75-42d7-8cfc-236e94de7492 None admin] RBAC: Authorizing `identity:get_user(user_id=1a0014c58c4c4ce1bf436c7c1e5d03c7)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:26.270476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74487e4-4d75-42d7-8cfc-236e94de7492 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:26.272315 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 28/51] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:01:26 2022] GET /identity/v3/users/1a0014c58c4c4ce1bf436c7c1e5d03c7 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:26.280197 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c7f23-c039-4761-9b73-9aa0b66b0ea7 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:26.366828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:26.392314 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c7f23-c039-4761-9b73-9aa0b66b0ea7 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:26.407172 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04858b7-7400-481b-b537-264caf2feaca None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:26.407639 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04858b7-7400-481b-b537-264caf2feaca None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:26.408154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04858b7-7400-481b-b537-264caf2feaca None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:26.411082 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 29/52] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:26.417848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a38049-c063-4913-84fa-275150cc4e61 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:26.418147 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a38049-c063-4913-84fa-275150cc4e61 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:26.418433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a38049-c063-4913-84fa-275150cc4e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:26.435183 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-33a38049-c063-4913-84fa-275150cc4e61 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:26.436465 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-33a38049-c063-4913-84fa-275150cc4e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:26.447294 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2ebaa-d87d-4da1-87aa-df2344c5a9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:26.448680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2ebaa-d87d-4da1-87aa-df2344c5a9fd None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:26.449195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2ebaa-d87d-4da1-87aa-df2344c5a9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:26.449712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2ebaa-d87d-4da1-87aa-df2344c5a9fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:26.451970 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2ebaa-d87d-4da1-87aa-df2344c5a9fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:26.454580 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2ebaa-d87d-4da1-87aa-df2344c5a9fd None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:26.458401 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 24/53] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:01:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:01:26.464449 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2ebaa-d87d-4da1-87aa-df2344c5a9fd None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:26.506932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:26.515575 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 30/54] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 19:01:26.539284 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a38049-c063-4913-84fa-275150cc4e61 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:26.619310 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2ebaa-d87d-4da1-87aa-df2344c5a9fd None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:26.659162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfde104-b1c8-4a9c-bb2f-2f4b7697196b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:26.660359 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfde104-b1c8-4a9c-bb2f-2f4b7697196b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:26.660654 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfde104-b1c8-4a9c-bb2f-2f4b7697196b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:26.660942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfde104-b1c8-4a9c-bb2f-2f4b7697196b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:26.661792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfde104-b1c8-4a9c-bb2f-2f4b7697196b None admin] RBAC: Adding query filter params (role.id=4588ca63994f4e2d9ce482d475edbabd, scope.domain.id=default, user.id=1a0014c58c4c4ce1bf436c7c1e5d03c7) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:26.662113 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfde104-b1c8-4a9c-bb2f-2f4b7697196b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:26.663637 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfde104-b1c8-4a9c-bb2f-2f4b7697196b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:26.665033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a38049-c063-4913-84fa-275150cc4e61 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:26.670517 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 25/55] 10.222.0.45 () {56 vars in 1322 bytes} [Thu Jun 2 19:01:26 2022] GET /identity/v3/role_assignments?user.id=1a0014c58c4c4ce1bf436c7c1e5d03c7&scope.domain.id=default&role.id=4588ca63994f4e2d9ce482d475edbabd => generated 530 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:01:26.723879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a434f-6632-42a5-8a4a-1c9554878884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:26.725170 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a434f-6632-42a5-8a4a-1c9554878884 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:26.725797 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a434f-6632-42a5-8a4a-1c9554878884 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:26.726313 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a434f-6632-42a5-8a4a-1c9554878884 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:26.728309 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a434f-6632-42a5-8a4a-1c9554878884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:26.729945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a434f-6632-42a5-8a4a-1c9554878884 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:26.731841 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 31/56] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:01:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:01:26.741561 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfde104-b1c8-4a9c-bb2f-2f4b7697196b None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:26.755509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:26.868853 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfde104-b1c8-4a9c-bb2f-2f4b7697196b None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:26.926416 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb38482-c25b-4963-b43a-6d511797d0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:26.927334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb38482-c25b-4963-b43a-6d511797d0c2 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:26.927696 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb38482-c25b-4963-b43a-6d511797d0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:26.928141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb38482-c25b-4963-b43a-6d511797d0c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:26.929052 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb38482-c25b-4963-b43a-6d511797d0c2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:26.931654 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb38482-c25b-4963-b43a-6d511797d0c2 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:27.047743 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 26/57] 10.222.0.45 () {60 vars in 1140 bytes} [Thu Jun 2 19:01:26 2022] POST /identity/v3/projects => generated 298 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:01:29.384339 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c0df3-744b-49cd-a240-499fb649be75 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:29.385225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c0df3-744b-49cd-a240-499fb649be75 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:29.385225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c0df3-744b-49cd-a240-499fb649be75 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:29.386259 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 32/58] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:01:29.391938 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e3fea-7000-4384-b6c5-e1d5bdc6e774 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:29.394358 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e3fea-7000-4384-b6c5-e1d5bdc6e774 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:29.394358 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e3fea-7000-4384-b6c5-e1d5bdc6e774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:29.410641 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-c54e3fea-7000-4384-b6c5-e1d5bdc6e774 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:29.411939 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c54e3fea-7000-4384-b6c5-e1d5bdc6e774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:29.473136 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:29.484527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 27/59] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 19:01:29.527731 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c0df3-744b-49cd-a240-499fb649be75 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:29.600214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:29.639877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c0df3-744b-49cd-a240-499fb649be75 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:29.677703 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80281fa9-0f95-48a1-8111-794ef4c93647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:29.678525 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80281fa9-0f95-48a1-8111-794ef4c93647 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:29.678814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80281fa9-0f95-48a1-8111-794ef4c93647 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:29.679097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80281fa9-0f95-48a1-8111-794ef4c93647 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:29.680460 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80281fa9-0f95-48a1-8111-794ef4c93647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:29.681988 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80281fa9-0f95-48a1-8111-794ef4c93647 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:29.683740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 33/60] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:01:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:29.690549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e3fea-7000-4384-b6c5-e1d5bdc6e774 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:29.865144 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e3fea-7000-4384-b6c5-e1d5bdc6e774 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:29.901223 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd209d88-42fb-4b92-b19a-7cca79cb20b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:29.901842 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd209d88-42fb-4b92-b19a-7cca79cb20b3 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:29.902125 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd209d88-42fb-4b92-b19a-7cca79cb20b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:29.902408 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd209d88-42fb-4b92-b19a-7cca79cb20b3 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:29.903130 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd209d88-42fb-4b92-b19a-7cca79cb20b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:29.904629 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd209d88-42fb-4b92-b19a-7cca79cb20b3 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:30.023140 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 28/61] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jun 2 19:01:29 2022] POST /identity/v3/users => generated 275 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:33.894310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942100e-5d9d-4278-8300-9a2e3ccb2f6c None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:33.894310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942100e-5d9d-4278-8300-9a2e3ccb2f6c None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:33.894310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942100e-5d9d-4278-8300-9a2e3ccb2f6c None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:33.894310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 34/62] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:33.900076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b0645-c123-4777-8b95-ea99d65e28bd None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:33.900886 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b0645-c123-4777-8b95-ea99d65e28bd None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:33.901325 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b0645-c123-4777-8b95-ea99d65e28bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:33.925712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-c27b0645-c123-4777-8b95-ea99d65e28bd None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:33.927185 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c27b0645-c123-4777-8b95-ea99d65e28bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:33.989756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:34.023965 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 29/63] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:01:34.063430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942100e-5d9d-4278-8300-9a2e3ccb2f6c None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:34.235729 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca266a-25cd-4b11-9a2c-8fd4db81f893 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:34.236044 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca266a-25cd-4b11-9a2c-8fd4db81f893 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:34.236501 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca266a-25cd-4b11-9a2c-8fd4db81f893 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:34.238315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 30/64] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:34.240753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942100e-5d9d-4278-8300-9a2e3ccb2f6c None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:34.243365 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3440eb-dfca-4e96-93ef-6fc806f95864 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:34.243915 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3440eb-dfca-4e96-93ef-6fc806f95864 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:34.244433 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3440eb-dfca-4e96-93ef-6fc806f95864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:34.276070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-2d3440eb-dfca-4e96-93ef-6fc806f95864 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:34.277303 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2d3440eb-dfca-4e96-93ef-6fc806f95864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:34.300653 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:34.320997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a21ce-2136-40ae-b148-15bd3a381585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:34.320997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a21ce-2136-40ae-b148-15bd3a381585 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:34.320997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a21ce-2136-40ae-b148-15bd3a381585 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:34.320997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a21ce-2136-40ae-b148-15bd3a381585 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:34.357776 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a21ce-2136-40ae-b148-15bd3a381585 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:01:34.372868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-8e0a21ce-2136-40ae-b148-15bd3a381585 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:01:34.372868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:01:34.372868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:01:34.372868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:01:34.372868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:01:34.372868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:01:34.372868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:01:34.372868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:01:34.372868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:01:34.372868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:01:34.372868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:01:34.372868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:01:34.372868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:01:34.372868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:01:34.372868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:01:34.372868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:01:34.373879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:01:34.373879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:01:34.373879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:01:34.373879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:01:34.373879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:01:34.373879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:01:34.373879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:01:34.373879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:01:34.373879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:01:34.373879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:01:34.373879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:01:34.373879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:01:34.373879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:01:34.373879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:01:34.373879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:01:34.373879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:01:34.374660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:01:34.374660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:01:34.374660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:01:34.374660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:01:34.374660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:01:34.374660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:01:34.374660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:01:34.374660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:01:34.374660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:01:34.374660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:01:34.374660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:01:34.374660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:01:34.374660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 35/65] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:01:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:01:34.390215 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a21ce-2136-40ae-b148-15bd3a381585 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:34.482953 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 31/66] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 19:01:34.487222 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6cc8f-ea33-43fa-a2b1-35e863de304d None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:34.488639 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6cc8f-ea33-43fa-a2b1-35e863de304d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:34.489694 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6cc8f-ea33-43fa-a2b1-35e863de304d None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:34.494773 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 32/67] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:34 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:34.506883 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb337294-baf0-4796-80e1-9fa5209b1ae1 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:34.508102 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb337294-baf0-4796-80e1-9fa5209b1ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:34.508841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb337294-baf0-4796-80e1-9fa5209b1ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:34.535627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a21ce-2136-40ae-b148-15bd3a381585 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:34.543901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-cb337294-baf0-4796-80e1-9fa5209b1ae1 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:34.547254 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-cb337294-baf0-4796-80e1-9fa5209b1ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:34.578119 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a719e-569f-4823-9b8e-ab12851efd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:34.579276 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a719e-569f-4823-9b8e-ab12851efd75 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:34.579565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a719e-569f-4823-9b8e-ab12851efd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:34.579941 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a719e-569f-4823-9b8e-ab12851efd75 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:34.580764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a719e-569f-4823-9b8e-ab12851efd75 None admin] RBAC: Adding query filter params (name=member) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:34.581776 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a719e-569f-4823-9b8e-ab12851efd75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:34.583547 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a719e-569f-4823-9b8e-ab12851efd75 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:34.598327 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 36/68] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:01:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:34.599553 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a719e-569f-4823-9b8e-ab12851efd75 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:34.663552 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:34.692020 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 33/69] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 19:01:34.692020 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff998cad-cc9b-4992-94a6-830378b23bcc None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:34.692020 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff998cad-cc9b-4992-94a6-830378b23bcc None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:34.692020 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff998cad-cc9b-4992-94a6-830378b23bcc None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:34.692020 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 34/70] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:34.692020 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff998cad-cc9b-4992-94a6-830378b23bcc None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:34.742417 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a719e-569f-4823-9b8e-ab12851efd75 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:34.753029 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:34.804956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73001597-61f2-4bd8-ae9c-fdeb8c663d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:34.805779 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73001597-61f2-4bd8-ae9c-fdeb8c663d9f None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:34.806069 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73001597-61f2-4bd8-ae9c-fdeb8c663d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:34.806350 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73001597-61f2-4bd8-ae9c-fdeb8c663d9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:34.819882 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73001597-61f2-4bd8-ae9c-fdeb8c663d9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:01:34.827848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-73001597-61f2-4bd8-ae9c-fdeb8c663d9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:01:34.827848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:01:34.827848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:01:34.827848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:01:34.827848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:01:34.827848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:01:34.827848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:01:34.827848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:01:34.827848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:01:34.827848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:01:34.827848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:01:34.827848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:01:34.827848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:01:34.827848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:01:34.827848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:01:34.827848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:01:34.828835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:01:34.828835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:01:34.828835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:01:34.828835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:01:34.828835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:01:34.828835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:01:34.828835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:01:34.828835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:01:34.828835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:01:34.828835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:01:34.828835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:01:34.828835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:01:34.828835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:01:34.828835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:01:34.828835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:01:34.828835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:01:34.829629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:01:34.829629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:01:34.829629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:01:34.829629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:01:34.829629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:01:34.829629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:01:34.829629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:01:34.829629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:01:34.829629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:01:34.829629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:01:34.829629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:01:34.829629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:01:34.829629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 37/71] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:01:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:01:34.830639 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522cd1f-baa1-4a6f-9ed1-237a4da026b9 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:34.830639 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522cd1f-baa1-4a6f-9ed1-237a4da026b9 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:34.831413 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522cd1f-baa1-4a6f-9ed1-237a4da026b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:34.849339 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-9522cd1f-baa1-4a6f-9ed1-237a4da026b9 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:34.850572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-9522cd1f-baa1-4a6f-9ed1-237a4da026b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:34.854449 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff998cad-cc9b-4992-94a6-830378b23bcc None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:34.895756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edcb9c-8c39-4efb-bc7f-4dc16b65efa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:34.896675 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edcb9c-8c39-4efb-bc7f-4dc16b65efa8 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:34.896962 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edcb9c-8c39-4efb-bc7f-4dc16b65efa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:34.897229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edcb9c-8c39-4efb-bc7f-4dc16b65efa8 None admin] PATH_INFO: `/v3/users/072cdde6467a48fa9636648d08d9c3b7` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:34.913867 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8edcb9c-8c39-4efb-bc7f-4dc16b65efa8 None admin] RBAC: Authorizing `identity:get_user(user_id=072cdde6467a48fa9636648d08d9c3b7)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:34.915360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8edcb9c-8c39-4efb-bc7f-4dc16b65efa8 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:34.917143 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 35/72] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:01:34 2022] GET /identity/v3/users/072cdde6467a48fa9636648d08d9c3b7 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:34.917932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edcb9c-8c39-4efb-bc7f-4dc16b65efa8 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:34.939411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 38/73] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:01:34.940856 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12b678-bf0f-4791-bc97-c9ee28202117 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:34.941160 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12b678-bf0f-4791-bc97-c9ee28202117 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:34.941446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12b678-bf0f-4791-bc97-c9ee28202117 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:34.942758 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 39/74] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:34.943485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12b678-bf0f-4791-bc97-c9ee28202117 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:35.023503 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:35.041613 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:35.048592 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edcb9c-8c39-4efb-bc7f-4dc16b65efa8 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:35.087068 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4378d-ad06-49a2-b364-16f6ca54bf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:35.087815 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4378d-ad06-49a2-b364-16f6ca54bf61 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:35.088144 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4378d-ad06-49a2-b364-16f6ca54bf61 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:35.088422 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4378d-ad06-49a2-b364-16f6ca54bf61 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:35.099828 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12b678-bf0f-4791-bc97-c9ee28202117 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:35.100253 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4378d-ad06-49a2-b364-16f6ca54bf61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:01:35.108722 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-89f4378d-ad06-49a2-b364-16f6ca54bf61 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 19:01:35.108722 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:01:35.108722 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:01:35.108722 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:01:35.108722 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:01:35.108722 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:01:35.108722 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:01:35.108722 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:01:35.108722 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:01:35.108722 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:01:35.108722 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:01:35.108722 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:01:35.108722 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:01:35.108722 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:01:35.108722 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:01:35.108722 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:01:35.110334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:01:35.110334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:01:35.110334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:01:35.110334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:01:35.110334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:01:35.110334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:01:35.110334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:01:35.110334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:01:35.110334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:01:35.110334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:01:35.110334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:01:35.110334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:01:35.110334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:01:35.110334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:01:35.110334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:01:35.110334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:01:35.111468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:01:35.111468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:01:35.111468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:01:35.111468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:01:35.111468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:01:35.111468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:01:35.111468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:01:35.111468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:01:35.111468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:01:35.111468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:01:35.111468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 19:01:35.111468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:01:35.111468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 36/75] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jun 2 19:01:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:01:35.111468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4378d-ad06-49a2-b364-16f6ca54bf61 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:35.145682 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec17d80-f9a6-4a2e-a731-6766dd22ff7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:35.146367 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec17d80-f9a6-4a2e-a731-6766dd22ff7f None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:35.146655 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec17d80-f9a6-4a2e-a731-6766dd22ff7f None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:35.146950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec17d80-f9a6-4a2e-a731-6766dd22ff7f None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:35.147722 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec17d80-f9a6-4a2e-a731-6766dd22ff7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:35.148086 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec17d80-f9a6-4a2e-a731-6766dd22ff7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:35.149646 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec17d80-f9a6-4a2e-a731-6766dd22ff7f None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:35.168236 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 40/76] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:01:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:35.168236 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7346645-4538-4cf0-9a29-81be77ae5205 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:35.168236 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7346645-4538-4cf0-9a29-81be77ae5205 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:35.168236 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7346645-4538-4cf0-9a29-81be77ae5205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:35.191541 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-b7346645-4538-4cf0-9a29-81be77ae5205 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:35.193612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-b7346645-4538-4cf0-9a29-81be77ae5205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:35.234211 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4378d-ad06-49a2-b364-16f6ca54bf61 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:35.272603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b58450-7894-4722-9be0-b7f7c6b5d379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:35.273264 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b58450-7894-4722-9be0-b7f7c6b5d379 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:35.273550 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b58450-7894-4722-9be0-b7f7c6b5d379 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:35.273839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b58450-7894-4722-9be0-b7f7c6b5d379 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:35.281533 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 41/77] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:01:35.282412 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7346645-4538-4cf0-9a29-81be77ae5205 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:35.305717 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:35.322931 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:35.362836 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b58450-7894-4722-9be0-b7f7c6b5d379 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:35.364314 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b58450-7894-4722-9be0-b7f7c6b5d379 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:35.400107 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7346645-4538-4cf0-9a29-81be77ae5205 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:35.444192 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db8dcf-fbe4-4aac-a2a8-e3e30dbce7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:35.445004 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db8dcf-fbe4-4aac-a2a8-e3e30dbce7dc None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:35.445286 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db8dcf-fbe4-4aac-a2a8-e3e30dbce7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:35.445572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db8dcf-fbe4-4aac-a2a8-e3e30dbce7dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:35.446822 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db8dcf-fbe4-4aac-a2a8-e3e30dbce7dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:35.448345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db8dcf-fbe4-4aac-a2a8-e3e30dbce7dc None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:35.450043 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 42/78] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:01:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:35.450043 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db8dcf-fbe4-4aac-a2a8-e3e30dbce7dc None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:35.477993 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 37/79] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:01:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:35.478881 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b58450-7894-4722-9be0-b7f7c6b5d379 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:35.542918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:35.580448 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db8dcf-fbe4-4aac-a2a8-e3e30dbce7dc None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:35.585375 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:35.609981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b58450-7894-4722-9be0-b7f7c6b5d379 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:35.624290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d9480-7292-458e-a40a-587444ec3eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:35.624870 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d9480-7292-458e-a40a-587444ec3eaa None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:35.625153 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d9480-7292-458e-a40a-587444ec3eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:35.625429 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d9480-7292-458e-a40a-587444ec3eaa None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:35.626216 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d9480-7292-458e-a40a-587444ec3eaa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:35.626524 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d9480-7292-458e-a40a-587444ec3eaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:35.628466 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d9480-7292-458e-a40a-587444ec3eaa None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:35.637962 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 43/80] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:01:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:35.638862 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d9480-7292-458e-a40a-587444ec3eaa None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:35.651159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0243e25-8440-4366-9626-ee7eec997bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:35.652156 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0243e25-8440-4366-9626-ee7eec997bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:35.652885 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0243e25-8440-4366-9626-ee7eec997bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:35.652885 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0243e25-8440-4366-9626-ee7eec997bd9 None admin] PATH_INFO: `/v3/users/1a0014c58c4c4ce1bf436c7c1e5d03c7` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:35.654091 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0243e25-8440-4366-9626-ee7eec997bd9 None admin] RBAC: Authorizing `identity:get_user(user_id=1a0014c58c4c4ce1bf436c7c1e5d03c7)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:35.655614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0243e25-8440-4366-9626-ee7eec997bd9 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:35.657455 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 38/81] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:01:35 2022] GET /identity/v3/users/1a0014c58c4c4ce1bf436c7c1e5d03c7 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:35.658363 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0243e25-8440-4366-9626-ee7eec997bd9 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:35.777025 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0243e25-8440-4366-9626-ee7eec997bd9 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:35.806577 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:35.809810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d9480-7292-458e-a40a-587444ec3eaa None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:35.818692 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392fc63-cdc9-49d0-ac16-f2e1a4c618aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:35.819389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392fc63-cdc9-49d0-ac16-f2e1a4c618aa None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:35.819674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392fc63-cdc9-49d0-ac16-f2e1a4c618aa None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:35.819952 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392fc63-cdc9-49d0-ac16-f2e1a4c618aa None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:35.831517 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392fc63-cdc9-49d0-ac16-f2e1a4c618aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:35.831517 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392fc63-cdc9-49d0-ac16-f2e1a4c618aa None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:35.865347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa2607-75d8-4cad-9361-e58c1b6c184c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:35.866651 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa2607-75d8-4cad-9361-e58c1b6c184c None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:35.867129 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa2607-75d8-4cad-9361-e58c1b6c184c None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:35.867586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa2607-75d8-4cad-9361-e58c1b6c184c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:35.879547 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa2607-75d8-4cad-9361-e58c1b6c184c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:01:35.887427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-5cfa2607-75d8-4cad-9361-e58c1b6c184c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:01:35.887427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:01:35.887427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:01:35.887427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:01:35.887427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:01:35.887427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:01:35.887427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:01:35.887427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:01:35.887427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:01:35.887427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:01:35.887427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:01:35.887427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:01:35.887427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:01:35.887427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:01:35.887427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:01:35.887427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:01:35.889045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:01:35.889045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:01:35.889045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:01:35.889045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:01:35.889045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:01:35.889045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:01:35.889045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:01:35.889045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:01:35.889045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:01:35.889045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:01:35.889045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:01:35.889045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:01:35.889045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:01:35.889045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:01:35.889045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:01:35.889045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:01:35.889976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:01:35.889976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:01:35.889976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:01:35.889976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:01:35.889976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:01:35.889976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:01:35.889976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:01:35.889976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:01:35.889976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:01:35.889976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:01:35.889976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:01:35.889976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:01:35.889976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 44/82] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:01:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:01:35.889976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa2607-75d8-4cad-9361-e58c1b6c184c None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:35.901906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 39/83] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jun 2 19:01:35 2022] POST /identity/v3/users => generated 289 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:35.903449 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392fc63-cdc9-49d0-ac16-f2e1a4c618aa None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:35.935424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:36.054229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa2607-75d8-4cad-9361-e58c1b6c184c None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:36.072503 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392fc63-cdc9-49d0-ac16-f2e1a4c618aa None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:36.118546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51162135-4f46-4ba5-9b2f-a4c9161ea137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:36.120032 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51162135-4f46-4ba5-9b2f-a4c9161ea137 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:36.120460 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51162135-4f46-4ba5-9b2f-a4c9161ea137 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:36.121385 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51162135-4f46-4ba5-9b2f-a4c9161ea137 None admin] PATH_INFO: `/v3/projects/3c0517c3b0534b0499d8dae17360cb89` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:36.123055 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51162135-4f46-4ba5-9b2f-a4c9161ea137 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0517c3b0534b0499d8dae17360cb89)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:36.125656 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51162135-4f46-4ba5-9b2f-a4c9161ea137 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:36.129169 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 45/84] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:01:35 2022] GET /identity/v3/projects/3c0517c3b0534b0499d8dae17360cb89 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:36.130652 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51162135-4f46-4ba5-9b2f-a4c9161ea137 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:36.139307 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3da114-de96-4895-b4aa-2591cfcd592d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:36.140649 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3da114-de96-4895-b4aa-2591cfcd592d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:36.141091 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3da114-de96-4895-b4aa-2591cfcd592d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:36.141365 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3da114-de96-4895-b4aa-2591cfcd592d None admin] PATH_INFO: `/v3/users/072cdde6467a48fa9636648d08d9c3b7` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:36.142686 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3da114-de96-4895-b4aa-2591cfcd592d None admin] RBAC: Authorizing `identity:get_user(user_id=072cdde6467a48fa9636648d08d9c3b7)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:36.144881 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3da114-de96-4895-b4aa-2591cfcd592d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:36.146645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 40/85] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:01:35 2022] GET /identity/v3/users/072cdde6467a48fa9636648d08d9c3b7 => generated 275 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:36.147527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3da114-de96-4895-b4aa-2591cfcd592d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:36.215524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:36.309396 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3da114-de96-4895-b4aa-2591cfcd592d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:36.311313 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:36.327016 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51162135-4f46-4ba5-9b2f-a4c9161ea137 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:36.363556 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300f39e-723b-4bda-b4e4-741b50d7d028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:36.363885 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300f39e-723b-4bda-b4e4-741b50d7d028 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:36.364471 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300f39e-723b-4bda-b4e4-741b50d7d028 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:36.364795 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300f39e-723b-4bda-b4e4-741b50d7d028 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:36.365738 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300f39e-723b-4bda-b4e4-741b50d7d028 None admin] RBAC: Adding query filter params (name=member) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:36.366219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300f39e-723b-4bda-b4e4-741b50d7d028 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:36.368688 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300f39e-723b-4bda-b4e4-741b50d7d028 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:36.384936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 41/86] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:01:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:36.386277 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300f39e-723b-4bda-b4e4-741b50d7d028 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:36.405031 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b238435-58a1-415f-bd1b-356725cc8cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:36.406049 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b238435-58a1-415f-bd1b-356725cc8cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:36.406334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b238435-58a1-415f-bd1b-356725cc8cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:36.406617 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b238435-58a1-415f-bd1b-356725cc8cd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:36.506927 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b238435-58a1-415f-bd1b-356725cc8cd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:36.508587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b238435-58a1-415f-bd1b-356725cc8cd8 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:36.540130 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300f39e-723b-4bda-b4e4-741b50d7d028 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:36.549856 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:36.577621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04c64d-e10b-4321-bbae-518900e60838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:36.578742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04c64d-e10b-4321-bbae-518900e60838 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:36.579354 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04c64d-e10b-4321-bbae-518900e60838 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:36.579916 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04c64d-e10b-4321-bbae-518900e60838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:36.581106 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04c64d-e10b-4321-bbae-518900e60838 None admin] RBAC: Adding query filter params (role.id=75723f2a7ead4f5cb2885e7b63680b08, scope.project.id=3c0517c3b0534b0499d8dae17360cb89, user.id=072cdde6467a48fa9636648d08d9c3b7) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:36.581869 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04c64d-e10b-4321-bbae-518900e60838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:36.584037 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04c64d-e10b-4321-bbae-518900e60838 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:36.592487 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 42/87] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:01:36 2022] GET /identity/v3/role_assignments?user.id=072cdde6467a48fa9636648d08d9c3b7&scope.project.id=3c0517c3b0534b0499d8dae17360cb89&role.id=75723f2a7ead4f5cb2885e7b63680b08 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:36.593201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04c64d-e10b-4321-bbae-518900e60838 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:36.621326 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:36.630479 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 46/88] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:01:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:36.637850 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b238435-58a1-415f-bd1b-356725cc8cd8 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:36.742918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04c64d-e10b-4321-bbae-518900e60838 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:36.773965 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b238435-58a1-415f-bd1b-356725cc8cd8 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:36.799631 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19189a-05a6-4792-8f12-ded0ac12e77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:36.801318 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19189a-05a6-4792-8f12-ded0ac12e77c None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:36.801626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19189a-05a6-4792-8f12-ded0ac12e77c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:36.801907 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19189a-05a6-4792-8f12-ded0ac12e77c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:36.840171 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae7a26-7be1-4c4e-bfb4-c5f7ca56c59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:36.843036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae7a26-7be1-4c4e-bfb4-c5f7ca56c59f None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:36.843660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae7a26-7be1-4c4e-bfb4-c5f7ca56c59f None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:36.846478 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae7a26-7be1-4c4e-bfb4-c5f7ca56c59f None admin] PATH_INFO: `/v3/users/072cdde6467a48fa9636648d08d9c3b7` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:36.848879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae7a26-7be1-4c4e-bfb4-c5f7ca56c59f None admin] RBAC: Authorizing `identity:get_user(user_id=072cdde6467a48fa9636648d08d9c3b7)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:36.851743 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae7a26-7be1-4c4e-bfb4-c5f7ca56c59f None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:36.857036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 47/89] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:01:36 2022] GET /identity/v3/users/072cdde6467a48fa9636648d08d9c3b7 => generated 275 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:36.857999 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae7a26-7be1-4c4e-bfb4-c5f7ca56c59f None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:36.883955 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:36.946181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19189a-05a6-4792-8f12-ded0ac12e77c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:36.947612 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19189a-05a6-4792-8f12-ded0ac12e77c None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:37.024518 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:37.106340 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae7a26-7be1-4c4e-bfb4-c5f7ca56c59f None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:37.164654 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 43/90] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:01:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:37.166032 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19189a-05a6-4792-8f12-ded0ac12e77c None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:37.169859 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0eb8d-890f-411f-b6d2-edda90e58fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:37.170784 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0eb8d-890f-411f-b6d2-edda90e58fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:37.171078 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0eb8d-890f-411f-b6d2-edda90e58fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:37.171363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0eb8d-890f-411f-b6d2-edda90e58fd4 None admin] PATH_INFO: `/v3/projects/3c0517c3b0534b0499d8dae17360cb89` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:37.173216 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0eb8d-890f-411f-b6d2-edda90e58fd4 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0517c3b0534b0499d8dae17360cb89)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:37.174789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0eb8d-890f-411f-b6d2-edda90e58fd4 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:37.176891 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 48/91] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:01:36 2022] GET /identity/v3/projects/3c0517c3b0534b0499d8dae17360cb89 => generated 298 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:37.177538 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0eb8d-890f-411f-b6d2-edda90e58fd4 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:37.306136 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:37.361755 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19189a-05a6-4792-8f12-ded0ac12e77c None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:37.390666 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0eb8d-890f-411f-b6d2-edda90e58fd4 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:37.424543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e9d9f-2c63-4a17-a070-3cdc8c4b4673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:37.426016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e9d9f-2c63-4a17-a070-3cdc8c4b4673 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:37.426537 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e9d9f-2c63-4a17-a070-3cdc8c4b4673 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:37.427040 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e9d9f-2c63-4a17-a070-3cdc8c4b4673 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:37.443084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:37.457520 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc4b26-b6af-44eb-b362-d9296ec6b981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:37.458514 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc4b26-b6af-44eb-b362-d9296ec6b981 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:37.458758 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc4b26-b6af-44eb-b362-d9296ec6b981 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:37.459050 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc4b26-b6af-44eb-b362-d9296ec6b981 None admin] PATH_INFO: `/v3/projects/3c0517c3b0534b0499d8dae17360cb89` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:37.460405 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc4b26-b6af-44eb-b362-d9296ec6b981 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0517c3b0534b0499d8dae17360cb89)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:37.462043 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc4b26-b6af-44eb-b362-d9296ec6b981 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:37.464069 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 49/92] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:01:37 2022] GET /identity/v3/projects/3c0517c3b0534b0499d8dae17360cb89 => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:37.464790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc4b26-b6af-44eb-b362-d9296ec6b981 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:37.558873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e9d9f-2c63-4a17-a070-3cdc8c4b4673 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:37.561676 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e9d9f-2c63-4a17-a070-3cdc8c4b4673 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:37.726340 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:37.746141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc4b26-b6af-44eb-b362-d9296ec6b981 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:37.782730 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 44/93] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:01:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:37.790795 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e9d9f-2c63-4a17-a070-3cdc8c4b4673 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:37.864959 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424b65d-d4e2-4373-a1e5-4f680241f2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:37.865658 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424b65d-d4e2-4373-a1e5-4f680241f2cf None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:37.865944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424b65d-d4e2-4373-a1e5-4f680241f2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:37.866223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424b65d-d4e2-4373-a1e5-4f680241f2cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:37.867084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424b65d-d4e2-4373-a1e5-4f680241f2cf None admin] RBAC: Adding query filter params (role.id=4588ca63994f4e2d9ce482d475edbabd, scope.project.id=3c0517c3b0534b0499d8dae17360cb89, user.id=1a0014c58c4c4ce1bf436c7c1e5d03c7) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:37.867403 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424b65d-d4e2-4373-a1e5-4f680241f2cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:37.877081 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424b65d-d4e2-4373-a1e5-4f680241f2cf None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:37.897843 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 50/94] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:01:37 2022] GET /identity/v3/role_assignments?user.id=1a0014c58c4c4ce1bf436c7c1e5d03c7&scope.project.id=3c0517c3b0534b0499d8dae17360cb89&role.id=4588ca63994f4e2d9ce482d475edbabd => generated 259 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:37.898721 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424b65d-d4e2-4373-a1e5-4f680241f2cf None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:37.982499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e9d9f-2c63-4a17-a070-3cdc8c4b4673 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:38.075401 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ea138-8268-41a4-a254-4482f589c903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:38.076485 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ea138-8268-41a4-a254-4482f589c903 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:38.076924 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ea138-8268-41a4-a254-4482f589c903 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:38.077353 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ea138-8268-41a4-a254-4482f589c903 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:38.078770 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ea138-8268-41a4-a254-4482f589c903 None admin] RBAC: Adding query filter params (role.id=27769697518a42139af80d8b8410ca07, scope.project.id=3c0517c3b0534b0499d8dae17360cb89, user.id=072cdde6467a48fa9636648d08d9c3b7) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:38.079240 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ea138-8268-41a4-a254-4482f589c903 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:38.082653 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ea138-8268-41a4-a254-4482f589c903 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:38.100963 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 45/95] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:01:37 2022] GET /identity/v3/role_assignments?user.id=072cdde6467a48fa9636648d08d9c3b7&scope.project.id=3c0517c3b0534b0499d8dae17360cb89&role.id=27769697518a42139af80d8b8410ca07 => generated 259 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:38.124393 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:38.199309 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424b65d-d4e2-4373-a1e5-4f680241f2cf None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:38.247707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9ac06-644c-473c-8d2f-6d9bbeab0639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:38.248952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9ac06-644c-473c-8d2f-6d9bbeab0639 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:38.249434 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9ac06-644c-473c-8d2f-6d9bbeab0639 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:38.249953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9ac06-644c-473c-8d2f-6d9bbeab0639 None admin] PATH_INFO: `/v3/projects/3b458df115454031b7eced0a0315c0f7` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:38.251426 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9ac06-644c-473c-8d2f-6d9bbeab0639 None admin] RBAC: Authorizing `identity:get_project(project_id=3b458df115454031b7eced0a0315c0f7)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:38.254178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9ac06-644c-473c-8d2f-6d9bbeab0639 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:38.256843 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 51/96] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:01:37 2022] GET /identity/v3/projects/3b458df115454031b7eced0a0315c0f7 => generated 312 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:38.262971 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ea138-8268-41a4-a254-4482f589c903 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:38.316423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:38.446072 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ea138-8268-41a4-a254-4482f589c903 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:38.511319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27bcd6-7369-4d6a-8c9c-cb1a975d0545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:38.512364 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27bcd6-7369-4d6a-8c9c-cb1a975d0545 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:38.512804 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27bcd6-7369-4d6a-8c9c-cb1a975d0545 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:38.513315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27bcd6-7369-4d6a-8c9c-cb1a975d0545 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:38.515016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27bcd6-7369-4d6a-8c9c-cb1a975d0545 None admin] RBAC: Adding query filter params (role.id=75723f2a7ead4f5cb2885e7b63680b08, scope.project.id=3b458df115454031b7eced0a0315c0f7, user.id=072cdde6467a48fa9636648d08d9c3b7) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:38.515653 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27bcd6-7369-4d6a-8c9c-cb1a975d0545 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:38.518264 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27bcd6-7369-4d6a-8c9c-cb1a975d0545 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:38.530070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 46/97] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:01:38 2022] GET /identity/v3/role_assignments?user.id=072cdde6467a48fa9636648d08d9c3b7&scope.project.id=3b458df115454031b7eced0a0315c0f7&role.id=75723f2a7ead4f5cb2885e7b63680b08 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:01:39.446641 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea253f3-f026-46e2-b234-f7a259d42d80 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:39.448344 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea253f3-f026-46e2-b234-f7a259d42d80 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:39.449193 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea253f3-f026-46e2-b234-f7a259d42d80 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:39.452423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 52/98] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:39.459586 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177aa44-5958-4431-8320-0e46df45f615 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:39.461101 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177aa44-5958-4431-8320-0e46df45f615 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:39.461915 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177aa44-5958-4431-8320-0e46df45f615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:39.510048 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-5177aa44-5958-4431-8320-0e46df45f615 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:39.512901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5177aa44-5958-4431-8320-0e46df45f615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:39.630265 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac21f76-89fa-4f53-8589-a9ebed4658ec None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:39.631219 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac21f76-89fa-4f53-8589-a9ebed4658ec None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:39.632048 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac21f76-89fa-4f53-8589-a9ebed4658ec None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:39.635773 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 53/99] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:39.642055 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225aabe-960f-4246-851f-45f9a25ec7e7 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:39.642898 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225aabe-960f-4246-851f-45f9a25ec7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:39.644540 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225aabe-960f-4246-851f-45f9a25ec7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:39.676877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-5225aabe-960f-4246-851f-45f9a25ec7e7 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:39.678955 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5225aabe-960f-4246-851f-45f9a25ec7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:39.681183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 47/100] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:01:39.721730 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177aa44-5958-4431-8320-0e46df45f615 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:39.802051 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:39.875624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 54/101] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 19:01:39.912911 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177aa44-5958-4431-8320-0e46df45f615 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:39.913127 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225aabe-960f-4246-851f-45f9a25ec7e7 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:39.966791 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54f5b6-ee61-4b63-8a3d-6cfbad893a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:39.967983 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54f5b6-ee61-4b63-8a3d-6cfbad893a33 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:39.968765 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54f5b6-ee61-4b63-8a3d-6cfbad893a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:39.969227 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54f5b6-ee61-4b63-8a3d-6cfbad893a33 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:39.989879 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54f5b6-ee61-4b63-8a3d-6cfbad893a33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:01:40.007553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-4c54f5b6-ee61-4b63-8a3d-6cfbad893a33 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 19:01:40.007553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:01:40.007553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:01:40.007553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:01:40.007553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:01:40.007553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:01:40.007553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:01:40.007553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:01:40.007553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:01:40.007553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:01:40.007553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:01:40.007553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:01:40.007553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:01:40.007553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:01:40.007553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:01:40.007553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:01:40.008490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:01:40.008490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:01:40.008490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:01:40.008490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:01:40.008490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:01:40.008490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:01:40.008490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:01:40.008490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:01:40.008490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:01:40.008490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:01:40.008490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:01:40.008490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:01:40.008490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:01:40.008490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:01:40.008490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:01:40.008490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:01:40.009228 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:01:40.009228 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:01:40.009228 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:01:40.009228 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:01:40.009228 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:01:40.009228 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:01:40.009228 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:01:40.009228 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:01:40.009228 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:01:40.009228 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:01:40.009228 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 19:01:40.009228 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:01:40.011646 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 48/102] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:01:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:01:40.017651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54f5b6-ee61-4b63-8a3d-6cfbad893a33 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:40.085911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:40.182395 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225aabe-960f-4246-851f-45f9a25ec7e7 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:40.188401 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:40.199042 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54f5b6-ee61-4b63-8a3d-6cfbad893a33 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:40.269705 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d4796-b326-4cce-b78c-e6503041d899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:40.270473 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d4796-b326-4cce-b78c-e6503041d899 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:40.270759 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d4796-b326-4cce-b78c-e6503041d899 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:40.271035 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d4796-b326-4cce-b78c-e6503041d899 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:40.271846 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d4796-b326-4cce-b78c-e6503041d899 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:40.272341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d4796-b326-4cce-b78c-e6503041d899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:40.273875 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808c373-0e2b-4ccf-9fc7-0eb41a0e3bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:40.274067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d4796-b326-4cce-b78c-e6503041d899 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:40.274699 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808c373-0e2b-4ccf-9fc7-0eb41a0e3bec None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:40.274986 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808c373-0e2b-4ccf-9fc7-0eb41a0e3bec None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:40.275266 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808c373-0e2b-4ccf-9fc7-0eb41a0e3bec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:40.276602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808c373-0e2b-4ccf-9fc7-0eb41a0e3bec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:40.278105 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808c373-0e2b-4ccf-9fc7-0eb41a0e3bec None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:40.279798 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 55/103] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:01:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:01:40.289341 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808c373-0e2b-4ccf-9fc7-0eb41a0e3bec None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:40.289513 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 49/104] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:01:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:40.295710 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d4796-b326-4cce-b78c-e6503041d899 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:40.493284 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d4796-b326-4cce-b78c-e6503041d899 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:40.532853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808c373-0e2b-4ccf-9fc7-0eb41a0e3bec None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:40.540270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9459a43-382e-446f-8376-f718c77744c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:40.541182 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9459a43-382e-446f-8376-f718c77744c8 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:40.541536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9459a43-382e-446f-8376-f718c77744c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:40.541844 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9459a43-382e-446f-8376-f718c77744c8 None admin] PATH_INFO: `/v3/users/439f856d9f16433ea2b161da27907c7a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:40.576897 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9459a43-382e-446f-8376-f718c77744c8 None admin] RBAC: Authorizing `identity:get_user(user_id=439f856d9f16433ea2b161da27907c7a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:40.578506 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9459a43-382e-446f-8376-f718c77744c8 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:40.580560 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 50/105] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:01:40 2022] GET /identity/v3/users/439f856d9f16433ea2b161da27907c7a => generated 289 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:01:40.588140 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9459a43-382e-446f-8376-f718c77744c8 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:40.592391 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:40.598564 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38c1aa-fef2-4d2c-a253-f38c978863d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:40.599256 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38c1aa-fef2-4d2c-a253-f38c978863d6 None admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:40.599545 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38c1aa-fef2-4d2c-a253-f38c978863d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:40.599825 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38c1aa-fef2-4d2c-a253-f38c978863d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:40.600589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38c1aa-fef2-4d2c-a253-f38c978863d6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:40.602077 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38c1aa-fef2-4d2c-a253-f38c978863d6 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:40.613844 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:40.742902 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 56/106] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jun 2 19:01:40 2022] POST /identity/v3/projects => generated 302 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:01:40.751048 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fffa72-56e1-492e-a6e3-5ecd59e38224 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:40.751454 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fffa72-56e1-492e-a6e3-5ecd59e38224 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:40.751592 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fffa72-56e1-492e-a6e3-5ecd59e38224 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:40.760146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 57/107] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:40.766942 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c9611-2755-40f7-a760-a837d7b9bd09 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:40.767651 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c9611-2755-40f7-a760-a837d7b9bd09 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:40.768188 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c9611-2755-40f7-a760-a837d7b9bd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:40.803828 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-770c9611-2755-40f7-a760-a837d7b9bd09 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:40.805209 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-770c9611-2755-40f7-a760-a837d7b9bd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:40.811065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9459a43-382e-446f-8376-f718c77744c8 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:40.936613 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 58/108] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:01:40.951914 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d8187-e5f9-410d-97c3-8f08cc93354e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:40.952580 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d8187-e5f9-410d-97c3-8f08cc93354e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:40.952927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d8187-e5f9-410d-97c3-8f08cc93354e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:40.953215 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d8187-e5f9-410d-97c3-8f08cc93354e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:41.011345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c9611-2755-40f7-a760-a837d7b9bd09 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:41.164560 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d8187-e5f9-410d-97c3-8f08cc93354e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:41.167775 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d8187-e5f9-410d-97c3-8f08cc93354e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:41.194035 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:41.238775 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c9611-2755-40f7-a760-a837d7b9bd09 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:41.264389 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:41.328217 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021a55c-303d-4fd9-88a0-2b3d9aaa94d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:41.329034 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021a55c-303d-4fd9-88a0-2b3d9aaa94d6 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:41.329322 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021a55c-303d-4fd9-88a0-2b3d9aaa94d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:41.329598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021a55c-303d-4fd9-88a0-2b3d9aaa94d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:41.361030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021a55c-303d-4fd9-88a0-2b3d9aaa94d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:01:41.369581 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 51/109] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:01:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 782 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 19:01:41.374599 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-8021a55c-303d-4fd9-88a0-2b3d9aaa94d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:01:41.374599 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:01:41.374599 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:01:41.374599 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:01:41.374599 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:01:41.374599 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:01:41.374599 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:01:41.374599 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:01:41.374599 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:01:41.374599 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:01:41.374599 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:01:41.374599 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:01:41.374599 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:01:41.374599 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:01:41.374599 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:01:41.374599 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:01:41.375683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:01:41.375683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:01:41.375683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:01:41.375683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:01:41.375683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:01:41.375683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:01:41.375683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:01:41.375683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:01:41.375683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:01:41.375683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:01:41.375683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:01:41.375683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:01:41.375683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:01:41.375683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:01:41.375683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:01:41.375683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:01:41.376647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:01:41.376647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:01:41.376647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:01:41.376647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:01:41.376647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:01:41.376647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:01:41.376647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:01:41.376647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:01:41.376647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:01:41.376647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:01:41.376647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:01:41.376647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:01:41.379255 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 59/110] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:01:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:01:41.385631 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021a55c-303d-4fd9-88a0-2b3d9aaa94d6 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:41.385991 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d8187-e5f9-410d-97c3-8f08cc93354e None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:41.664730 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d8187-e5f9-410d-97c3-8f08cc93354e None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:41.696755 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021a55c-303d-4fd9-88a0-2b3d9aaa94d6 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:41.698131 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:41.785160 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4193fa-a9b9-4242-8836-eb8bac5fbae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:41.787066 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4193fa-a9b9-4242-8836-eb8bac5fbae6 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:41.787707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50880b58-04e2-4af2-8fd9-bf770cdf7915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:41.788134 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4193fa-a9b9-4242-8836-eb8bac5fbae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:41.788888 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4193fa-a9b9-4242-8836-eb8bac5fbae6 None admin] PATH_INFO: `/v3/projects/3c0517c3b0534b0499d8dae17360cb89` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:41.796601 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50880b58-04e2-4af2-8fd9-bf770cdf7915 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:41.796882 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50880b58-04e2-4af2-8fd9-bf770cdf7915 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:41.797364 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50880b58-04e2-4af2-8fd9-bf770cdf7915 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:41.798820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50880b58-04e2-4af2-8fd9-bf770cdf7915 None admin] RBAC: Adding query filter params (name=member) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:41.798820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50880b58-04e2-4af2-8fd9-bf770cdf7915 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:41.801815 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4193fa-a9b9-4242-8836-eb8bac5fbae6 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0517c3b0534b0499d8dae17360cb89)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:41.805023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4193fa-a9b9-4242-8836-eb8bac5fbae6 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:41.808489 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50880b58-04e2-4af2-8fd9-bf770cdf7915 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:41.808951 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 52/111] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:01:41 2022] GET /identity/v3/projects/3c0517c3b0534b0499d8dae17360cb89 => generated 298 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:41.811706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720ccf3-a25e-47aa-b3da-1e625c41fe2e None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:41.812526 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720ccf3-a25e-47aa-b3da-1e625c41fe2e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:41.813278 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720ccf3-a25e-47aa-b3da-1e625c41fe2e None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:41.816949 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 53/112] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:41.826211 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 60/113] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:01:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:01:41.827469 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bf9da-ea48-4036-98ef-de5918c81eef None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:41.827469 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bf9da-ea48-4036-98ef-de5918c81eef None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:41.831631 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bf9da-ea48-4036-98ef-de5918c81eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:41.833941 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50880b58-04e2-4af2-8fd9-bf770cdf7915 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:41.869876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-b62bf9da-ea48-4036-98ef-de5918c81eef None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:41.872445 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b62bf9da-ea48-4036-98ef-de5918c81eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:41.897049 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:42.031171 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 54/114] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 19:01:42.037997 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bf9da-ea48-4036-98ef-de5918c81eef None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:42.089150 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50880b58-04e2-4af2-8fd9-bf770cdf7915 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:42.162469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ac961-e607-452f-a186-a7546b51afd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:42.164042 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ac961-e607-452f-a186-a7546b51afd2 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:42.164570 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ac961-e607-452f-a186-a7546b51afd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:42.165088 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ac961-e607-452f-a186-a7546b51afd2 None admin] PATH_INFO: `/v3/users/072cdde6467a48fa9636648d08d9c3b7` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:42.167308 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ac961-e607-452f-a186-a7546b51afd2 None admin] RBAC: Authorizing `identity:get_user(user_id=072cdde6467a48fa9636648d08d9c3b7)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:42.170192 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ac961-e607-452f-a186-a7546b51afd2 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:42.173499 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 61/115] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:01:41 2022] GET /identity/v3/users/072cdde6467a48fa9636648d08d9c3b7 => generated 275 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:42.181680 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de983a9-6ad9-44cf-9e6d-b0ba55ab1414 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:42.182048 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de983a9-6ad9-44cf-9e6d-b0ba55ab1414 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:42.182324 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de983a9-6ad9-44cf-9e6d-b0ba55ab1414 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:42.183887 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 62/116] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:42.184883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd66d3-cd1b-49af-970e-32a99cc4fb5e None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:42.185263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd66d3-cd1b-49af-970e-32a99cc4fb5e None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:42.185452 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd66d3-cd1b-49af-970e-32a99cc4fb5e None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:42.186880 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 63/117] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:42.189138 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd66d3-cd1b-49af-970e-32a99cc4fb5e None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:42.240069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bf9da-ea48-4036-98ef-de5918c81eef None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:42.260361 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:42.310125 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bd050-529c-4313-bbe7-f5af5df571f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:42.311299 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bd050-529c-4313-bbe7-f5af5df571f6 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:42.311966 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bd050-529c-4313-bbe7-f5af5df571f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:42.312519 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bd050-529c-4313-bbe7-f5af5df571f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:42.314182 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96bd050-529c-4313-bbe7-f5af5df571f6 None admin] RBAC: Adding query filter params (role.id=a562117402dd4e099b4dcab2b24ead28, scope.project.id=3c0517c3b0534b0499d8dae17360cb89, user.id=439f856d9f16433ea2b161da27907c7a) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:42.314916 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96bd050-529c-4313-bbe7-f5af5df571f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:42.316188 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:42.317566 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96bd050-529c-4313-bbe7-f5af5df571f6 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:42.323299 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd66d3-cd1b-49af-970e-32a99cc4fb5e None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:42.327512 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 55/118] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:01:42 2022] GET /identity/v3/role_assignments?user.id=439f856d9f16433ea2b161da27907c7a&scope.project.id=3c0517c3b0534b0499d8dae17360cb89&role.id=a562117402dd4e099b4dcab2b24ead28 => generated 259 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:42.329119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bd050-529c-4313-bbe7-f5af5df571f6 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:42.378514 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fee075-4833-4850-95ee-c58e1bcb3fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:42.379686 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fee075-4833-4850-95ee-c58e1bcb3fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:42.379977 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fee075-4833-4850-95ee-c58e1bcb3fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:42.380295 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fee075-4833-4850-95ee-c58e1bcb3fc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:42.397802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fee075-4833-4850-95ee-c58e1bcb3fc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:01:42.405587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-77fee075-4833-4850-95ee-c58e1bcb3fc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:01:42.405587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:01:42.405587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:01:42.405587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:01:42.405587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:01:42.405587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:01:42.405587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:01:42.405587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:01:42.405587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:01:42.405587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:01:42.405587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:01:42.405587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:01:42.405587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:01:42.405587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:01:42.405587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:01:42.405587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:01:42.406508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:01:42.406508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:01:42.406508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:01:42.406508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:01:42.406508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:01:42.406508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:01:42.406508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:01:42.406508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:01:42.406508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:01:42.406508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:01:42.406508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:01:42.406508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:01:42.406508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:01:42.406508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:01:42.406508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:01:42.406508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:01:42.413249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:01:42.413249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:01:42.413249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:01:42.413249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:01:42.413249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:01:42.413249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:01:42.413249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:01:42.413249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:01:42.413249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:01:42.413249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:01:42.413249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:01:42.413249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:01:42.413249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 64/119] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:01:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:01:42.413249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd70cb6-f57f-43fe-af3e-5f3080778184 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:42.413958 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd70cb6-f57f-43fe-af3e-5f3080778184 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:42.413958 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd70cb6-f57f-43fe-af3e-5f3080778184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:42.432185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-5bd70cb6-f57f-43fe-af3e-5f3080778184 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:42.433477 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5bd70cb6-f57f-43fe-af3e-5f3080778184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:42.546974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bd050-529c-4313-bbe7-f5af5df571f6 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:42.548375 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 65/120] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:01:42.549536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34875210-ada2-42f5-a9ea-02f6845a2ec1 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:42.549902 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34875210-ada2-42f5-a9ea-02f6845a2ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:42.550169 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34875210-ada2-42f5-a9ea-02f6845a2ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:42.577509 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-34875210-ada2-42f5-a9ea-02f6845a2ec1 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:42.578709 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-34875210-ada2-42f5-a9ea-02f6845a2ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:42.619970 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cac068-dc86-4b18-97ba-b7eb1f1a15af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:42.621696 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cac068-dc86-4b18-97ba-b7eb1f1a15af None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:42.621986 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cac068-dc86-4b18-97ba-b7eb1f1a15af None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:42.622279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cac068-dc86-4b18-97ba-b7eb1f1a15af None admin] PATH_INFO: `/v3/projects/3c0517c3b0534b0499d8dae17360cb89` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:42.623577 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cac068-dc86-4b18-97ba-b7eb1f1a15af None admin] RBAC: Authorizing `identity:get_project(project_id=3c0517c3b0534b0499d8dae17360cb89)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:42.625414 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cac068-dc86-4b18-97ba-b7eb1f1a15af None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:42.627342 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 56/121] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:01:42 2022] GET /identity/v3/projects/3c0517c3b0534b0499d8dae17360cb89 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:42.632948 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cac068-dc86-4b18-97ba-b7eb1f1a15af None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:42.684427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 66/122] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:01:42.685319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34875210-ada2-42f5-a9ea-02f6845a2ec1 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:42.687490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:42.715866 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:42.779501 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cac068-dc86-4b18-97ba-b7eb1f1a15af None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:42.827188 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ab8dc-a065-4438-a3ab-9de45be881cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:42.828418 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ab8dc-a065-4438-a3ab-9de45be881cc None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:42.829064 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ab8dc-a065-4438-a3ab-9de45be881cc None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:42.829546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ab8dc-a065-4438-a3ab-9de45be881cc None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:42.830677 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ab8dc-a065-4438-a3ab-9de45be881cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:42.831250 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ab8dc-a065-4438-a3ab-9de45be881cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:42.832917 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ab8dc-a065-4438-a3ab-9de45be881cc None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:42.842950 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 57/123] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:01:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:42.844587 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ab8dc-a065-4438-a3ab-9de45be881cc None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:42.860428 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34875210-ada2-42f5-a9ea-02f6845a2ec1 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:42.920388 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341d929-9493-4bb7-8464-114c2482d855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:42.921486 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341d929-9493-4bb7-8464-114c2482d855 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:42.921781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341d929-9493-4bb7-8464-114c2482d855 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:42.922099 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341d929-9493-4bb7-8464-114c2482d855 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:42.936813 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341d929-9493-4bb7-8464-114c2482d855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:01:42.947438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-8341d929-9493-4bb7-8464-114c2482d855 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:01:42.947438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:01:42.947438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:01:42.947438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:01:42.947438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:01:42.947438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:01:42.947438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:01:42.947438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:01:42.947438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:01:42.947438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:01:42.947438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:01:42.947438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:01:42.947438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:01:42.947438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:01:42.947438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:01:42.947438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:01:42.948445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:01:42.948445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:01:42.948445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:01:42.948445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:01:42.948445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:01:42.948445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:01:42.948445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:01:42.948445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:01:42.948445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:01:42.948445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:01:42.948445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:01:42.948445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:01:42.948445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:01:42.948445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:01:42.948445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:01:42.948445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:01:42.949229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:01:42.949229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:01:42.949229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:01:42.949229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:01:42.949229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:01:42.949229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:01:42.949229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:01:42.949229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:01:42.949229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:01:42.949229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:01:42.949229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:01:42.949229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:01:42.950084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 67/124] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:01:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:01:42.957531 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341d929-9493-4bb7-8464-114c2482d855 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:42.978100 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ab8dc-a065-4438-a3ab-9de45be881cc None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:42.980450 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:43.017379 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce14b6f-063b-4809-8d26-abefc63fd191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:43.019189 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce14b6f-063b-4809-8d26-abefc63fd191 None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:43.019854 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce14b6f-063b-4809-8d26-abefc63fd191 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:43.020344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce14b6f-063b-4809-8d26-abefc63fd191 None admin] PATH_INFO: `/v3/projects/3c0517c3b0534b0499d8dae17360cb89/users/072cdde6467a48fa9636648d08d9c3b7/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:43.023194 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce14b6f-063b-4809-8d26-abefc63fd191 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c0517c3b0534b0499d8dae17360cb89, user_id=072cdde6467a48fa9636648d08d9c3b7, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:43.025029 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce14b6f-063b-4809-8d26-abefc63fd191 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:43.100884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 58/125] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jun 2 19:01:42 2022] PUT /identity/v3/projects/3c0517c3b0534b0499d8dae17360cb89/users/072cdde6467a48fa9636648d08d9c3b7/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:43.103118 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce14b6f-063b-4809-8d26-abefc63fd191 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:43.135975 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:43.206636 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341d929-9493-4bb7-8464-114c2482d855 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:43.298493 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc6ebb-a993-4e53-a5ff-703f70c1cbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:43.299940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc6ebb-a993-4e53-a5ff-703f70c1cbd4 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:43.300471 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc6ebb-a993-4e53-a5ff-703f70c1cbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:43.300955 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc6ebb-a993-4e53-a5ff-703f70c1cbd4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:43.327711 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc6ebb-a993-4e53-a5ff-703f70c1cbd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:01:43.342125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-8fcc6ebb-a993-4e53-a5ff-703f70c1cbd4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 19:01:43.342125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:01:43.342125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:01:43.342125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:01:43.342125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:01:43.342125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:01:43.342125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:01:43.342125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:01:43.342125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:01:43.342125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:01:43.342125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:01:43.342125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:01:43.342125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:01:43.342125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:01:43.342125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:01:43.342125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:01:43.344264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:01:43.344264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:01:43.344264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:01:43.344264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:01:43.344264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:01:43.344264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:01:43.344264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:01:43.344264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:01:43.344264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:01:43.344264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:01:43.344264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:01:43.344264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:01:43.344264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:01:43.344264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:01:43.344264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:01:43.344264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:01:43.345383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:01:43.345383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:01:43.345383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:01:43.345383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:01:43.345383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:01:43.345383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:01:43.345383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:01:43.345383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:01:43.345383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:01:43.345383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:01:43.345383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 19:01:43.345383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:01:43.345383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 68/126] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jun 2 19:01:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:01:43.346033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc6ebb-a993-4e53-a5ff-703f70c1cbd4 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:43.361214 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce14b6f-063b-4809-8d26-abefc63fd191 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:43.409458 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de55d5-a557-46e1-ba8b-a02201478bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:43.410431 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de55d5-a557-46e1-ba8b-a02201478bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:43.411957 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de55d5-a557-46e1-ba8b-a02201478bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:43.411957 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de55d5-a557-46e1-ba8b-a02201478bb0 None admin] PATH_INFO: `/v3/users/1a0014c58c4c4ce1bf436c7c1e5d03c7` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:43.413002 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de55d5-a557-46e1-ba8b-a02201478bb0 None admin] RBAC: Authorizing `identity:get_user(user_id=1a0014c58c4c4ce1bf436c7c1e5d03c7)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:43.414748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de55d5-a557-46e1-ba8b-a02201478bb0 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:43.416798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 59/127] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:01:43 2022] GET /identity/v3/users/1a0014c58c4c4ce1bf436c7c1e5d03c7 => generated 247 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:43.417877 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de55d5-a557-46e1-ba8b-a02201478bb0 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:43.461381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:43.517291 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc6ebb-a993-4e53-a5ff-703f70c1cbd4 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:43.573691 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de55d5-a557-46e1-ba8b-a02201478bb0 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:43.582608 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabfd515-1f3d-4e0b-bb5c-1fb2a6fa05ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:43.584189 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfd515-1f3d-4e0b-bb5c-1fb2a6fa05ad None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:43.584920 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfd515-1f3d-4e0b-bb5c-1fb2a6fa05ad None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:43.585619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfd515-1f3d-4e0b-bb5c-1fb2a6fa05ad None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:43.587110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabfd515-1f3d-4e0b-bb5c-1fb2a6fa05ad None admin] RBAC: Adding query filter params (name=member) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:43.587861 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabfd515-1f3d-4e0b-bb5c-1fb2a6fa05ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:43.592690 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabfd515-1f3d-4e0b-bb5c-1fb2a6fa05ad None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:43.609391 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 69/128] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:01:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:43.611372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabfd515-1f3d-4e0b-bb5c-1fb2a6fa05ad None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:43.617016 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:43.631166 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b76f5b-0691-4b75-833a-b3e06eef5069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:43.631871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b76f5b-0691-4b75-833a-b3e06eef5069 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:43.632202 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b76f5b-0691-4b75-833a-b3e06eef5069 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:43.632483 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b76f5b-0691-4b75-833a-b3e06eef5069 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:43.633272 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b76f5b-0691-4b75-833a-b3e06eef5069 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:43.633583 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b76f5b-0691-4b75-833a-b3e06eef5069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:43.635004 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b76f5b-0691-4b75-833a-b3e06eef5069 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:43.659673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 60/129] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:01:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:43.661843 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b76f5b-0691-4b75-833a-b3e06eef5069 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:43.881142 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabfd515-1f3d-4e0b-bb5c-1fb2a6fa05ad None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:43.944207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b907d9-c79e-4573-a9ea-f9f6bea9d30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:43.945299 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b907d9-c79e-4573-a9ea-f9f6bea9d30f None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:43.945614 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b907d9-c79e-4573-a9ea-f9f6bea9d30f None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:43.945898 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b907d9-c79e-4573-a9ea-f9f6bea9d30f None admin] PATH_INFO: `/v3/projects/3c0517c3b0534b0499d8dae17360cb89` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:43.947675 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b907d9-c79e-4573-a9ea-f9f6bea9d30f None admin] RBAC: Authorizing `identity:get_project(project_id=3c0517c3b0534b0499d8dae17360cb89)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:43.950640 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b907d9-c79e-4573-a9ea-f9f6bea9d30f None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:43.953403 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 70/130] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:01:43 2022] GET /identity/v3/projects/3c0517c3b0534b0499d8dae17360cb89 => generated 298 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:43.954283 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b907d9-c79e-4573-a9ea-f9f6bea9d30f None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:43.985836 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:43.999268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b76f5b-0691-4b75-833a-b3e06eef5069 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:44.089184 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda17224-c272-4940-9a51-36e1f63654bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:44.090765 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda17224-c272-4940-9a51-36e1f63654bd None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:44.091260 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda17224-c272-4940-9a51-36e1f63654bd None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:44.091760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda17224-c272-4940-9a51-36e1f63654bd None admin] PATH_INFO: `/v3/users/072cdde6467a48fa9636648d08d9c3b7` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:44.098034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda17224-c272-4940-9a51-36e1f63654bd None admin] RBAC: Authorizing `identity:get_user(user_id=072cdde6467a48fa9636648d08d9c3b7)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:44.100801 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda17224-c272-4940-9a51-36e1f63654bd None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:44.103979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 61/131] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:01:43 2022] GET /identity/v3/users/072cdde6467a48fa9636648d08d9c3b7 => generated 275 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:44.110203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda17224-c272-4940-9a51-36e1f63654bd None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:44.176476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:44.253328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b907d9-c79e-4573-a9ea-f9f6bea9d30f None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:44.298476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b63e06-9638-4a99-8b0c-315182f74abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:44.300340 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b63e06-9638-4a99-8b0c-315182f74abf None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:44.300832 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b63e06-9638-4a99-8b0c-315182f74abf None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:44.301310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b63e06-9638-4a99-8b0c-315182f74abf None admin] PATH_INFO: `/v3/users/072cdde6467a48fa9636648d08d9c3b7` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:44.302799 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b63e06-9638-4a99-8b0c-315182f74abf None admin] RBAC: Authorizing `identity:get_user(user_id=072cdde6467a48fa9636648d08d9c3b7)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:44.304541 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b63e06-9638-4a99-8b0c-315182f74abf None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:44.307286 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 71/132] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:01:43 2022] GET /identity/v3/users/072cdde6467a48fa9636648d08d9c3b7 => generated 275 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:44.308462 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b63e06-9638-4a99-8b0c-315182f74abf None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:44.356704 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda17224-c272-4940-9a51-36e1f63654bd None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:44.420683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa40d4-bb29-47c9-bcd8-b890ca4afc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:44.422821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa40d4-bb29-47c9-bcd8-b890ca4afc17 None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:44.423052 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa40d4-bb29-47c9-bcd8-b890ca4afc17 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:44.423548 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa40d4-bb29-47c9-bcd8-b890ca4afc17 None admin] PATH_INFO: `/v3/projects/3c0517c3b0534b0499d8dae17360cb89/users/1a0014c58c4c4ce1bf436c7c1e5d03c7/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:44.428812 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa40d4-bb29-47c9-bcd8-b890ca4afc17 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c0517c3b0534b0499d8dae17360cb89, user_id=1a0014c58c4c4ce1bf436c7c1e5d03c7, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:44.431837 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa40d4-bb29-47c9-bcd8-b890ca4afc17 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:44.440228 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b63e06-9638-4a99-8b0c-315182f74abf None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:44.491781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24577f55-bc33-4210-9f66-6fb1ac4016c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:44.492986 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24577f55-bc33-4210-9f66-6fb1ac4016c5 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:44.493400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24577f55-bc33-4210-9f66-6fb1ac4016c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:44.493778 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24577f55-bc33-4210-9f66-6fb1ac4016c5 None admin] PATH_INFO: `/v3/projects/3b458df115454031b7eced0a0315c0f7` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:44.495299 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24577f55-bc33-4210-9f66-6fb1ac4016c5 None admin] RBAC: Authorizing `identity:get_project(project_id=3b458df115454031b7eced0a0315c0f7)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:44.497344 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24577f55-bc33-4210-9f66-6fb1ac4016c5 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:44.505058 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 72/133] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:01:44 2022] GET /identity/v3/projects/3b458df115454031b7eced0a0315c0f7 => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:44.505058 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4f838-6df5-4d2b-9c35-b1cd09acf3c1 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:44.505058 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4f838-6df5-4d2b-9c35-b1cd09acf3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:44.505058 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4f838-6df5-4d2b-9c35-b1cd09acf3c1 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:44.505058 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 73/134] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:44.505058 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4f838-6df5-4d2b-9c35-b1cd09acf3c1 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:44.526383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:44.545015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 62/135] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jun 2 19:01:44 2022] PUT /identity/v3/projects/3c0517c3b0534b0499d8dae17360cb89/users/1a0014c58c4c4ce1bf436c7c1e5d03c7/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:44.546232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa40d4-bb29-47c9-bcd8-b890ca4afc17 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:44.581014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:44.726226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa40d4-bb29-47c9-bcd8-b890ca4afc17 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:44.774603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bf542-366c-49e9-b2b3-0d0cf770229d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:44.776065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bf542-366c-49e9-b2b3-0d0cf770229d None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:44.776557 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bf542-366c-49e9-b2b3-0d0cf770229d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:44.777036 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bf542-366c-49e9-b2b3-0d0cf770229d None admin] PATH_INFO: `/v3/projects/3b458df115454031b7eced0a0315c0f7/users/072cdde6467a48fa9636648d08d9c3b7/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:44.780710 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bf542-366c-49e9-b2b3-0d0cf770229d None admin] RBAC: Authorizing `identity:create_grant(project_id=3b458df115454031b7eced0a0315c0f7, user_id=072cdde6467a48fa9636648d08d9c3b7, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:44.788023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bf542-366c-49e9-b2b3-0d0cf770229d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:44.805179 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4f838-6df5-4d2b-9c35-b1cd09acf3c1 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:44.851472 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b6e04-b098-405e-aafc-ed63c4295812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:44.852415 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b6e04-b098-405e-aafc-ed63c4295812 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:44.852971 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b6e04-b098-405e-aafc-ed63c4295812 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:44.861472 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b6e04-b098-405e-aafc-ed63c4295812 None admin] PATH_INFO: `/v3/projects/3c0517c3b0534b0499d8dae17360cb89` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:44.871161 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 63/136] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jun 2 19:01:44 2022] PUT /identity/v3/projects/3b458df115454031b7eced0a0315c0f7/users/072cdde6467a48fa9636648d08d9c3b7/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:44.872901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26a549-be55-43a2-a315-5e6b2ad4e1cb None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:44.873260 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26a549-be55-43a2-a315-5e6b2ad4e1cb None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:44.873532 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26a549-be55-43a2-a315-5e6b2ad4e1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:44.876559 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b6e04-b098-405e-aafc-ed63c4295812 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0517c3b0534b0499d8dae17360cb89)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:44.879106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b6e04-b098-405e-aafc-ed63c4295812 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:44.881786 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 74/137] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:01:44 2022] GET /identity/v3/projects/3c0517c3b0534b0499d8dae17360cb89 => generated 298 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:44.891055 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b6e04-b098-405e-aafc-ed63c4295812 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:44.906842 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-ee26a549-be55-43a2-a315-5e6b2ad4e1cb None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:44.908606 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ee26a549-be55-43a2-a315-5e6b2ad4e1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:45.006602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:45.011861 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 64/138] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:01:45.046116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b6e04-b098-405e-aafc-ed63c4295812 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:45.094148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26a549-be55-43a2-a315-5e6b2ad4e1cb None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:45.113406 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:45.118026 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056cdaf-709b-4919-81b4-860f65cf678c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:45.119872 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056cdaf-709b-4919-81b4-860f65cf678c None admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:45.120652 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056cdaf-709b-4919-81b4-860f65cf678c None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:45.121364 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056cdaf-709b-4919-81b4-860f65cf678c None admin] PATH_INFO: `/v3/projects/3c0517c3b0534b0499d8dae17360cb89/users/072cdde6467a48fa9636648d08d9c3b7/roles/27769697518a42139af80d8b8410ca07` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:45.125444 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056cdaf-709b-4919-81b4-860f65cf678c None admin] RBAC: Authorizing `identity:create_grant(project_id=3c0517c3b0534b0499d8dae17360cb89, user_id=072cdde6467a48fa9636648d08d9c3b7, role_id=27769697518a42139af80d8b8410ca07)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:45.128536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056cdaf-709b-4919-81b4-860f65cf678c None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:45.216142 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 75/139] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jun 2 19:01:44 2022] PUT /identity/v3/projects/3c0517c3b0534b0499d8dae17360cb89/users/072cdde6467a48fa9636648d08d9c3b7/roles/27769697518a42139af80d8b8410ca07 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:45.226150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26a549-be55-43a2-a315-5e6b2ad4e1cb None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:45.269374 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007acce7-f08d-4148-88d5-094a1671196e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:45.270133 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007acce7-f08d-4148-88d5-094a1671196e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:45.270413 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007acce7-f08d-4148-88d5-094a1671196e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:45.270683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007acce7-f08d-4148-88d5-094a1671196e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:45.272118 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007acce7-f08d-4148-88d5-094a1671196e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:45.273767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007acce7-f08d-4148-88d5-094a1671196e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:45.276024 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 65/140] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:01:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:45.281231 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056cdaf-709b-4919-81b4-860f65cf678c None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:45.405348 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb97a0e-4a78-4bd3-8d61-708bcd4c193b None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:45.406387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb97a0e-4a78-4bd3-8d61-708bcd4c193b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:45.407140 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb97a0e-4a78-4bd3-8d61-708bcd4c193b None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:45.410707 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 66/141] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:45.417411 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04c8c8-a54c-40d1-b2d1-ebd8f3d4be2c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:45.418279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04c8c8-a54c-40d1-b2d1-ebd8f3d4be2c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:45.419069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04c8c8-a54c-40d1-b2d1-ebd8f3d4be2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:45.469408 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-4c04c8c8-a54c-40d1-b2d1-ebd8f3d4be2c None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:45.473352 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4c04c8c8-a54c-40d1-b2d1-ebd8f3d4be2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:45.513315 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056cdaf-709b-4919-81b4-860f65cf678c None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:45.618861 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3829f3f-dbd0-4e38-98ac-a7d0248d636e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:45.619592 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3829f3f-dbd0-4e38-98ac-a7d0248d636e None admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:45.619917 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3829f3f-dbd0-4e38-98ac-a7d0248d636e None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:45.620201 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3829f3f-dbd0-4e38-98ac-a7d0248d636e None admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:45.620956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3829f3f-dbd0-4e38-98ac-a7d0248d636e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:45.622506 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3829f3f-dbd0-4e38-98ac-a7d0248d636e None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:45.622876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 67/142] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 19:01:45.645878 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:45.665440 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04c8c8-a54c-40d1-b2d1-ebd8f3d4be2c None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:45.682685 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:45.803729 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 76/143] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jun 2 19:01:45 2022] POST /identity/v3/users => generated 283 bytes in 523 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:45.826301 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04c8c8-a54c-40d1-b2d1-ebd8f3d4be2c None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:45.880161 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f6f5b-a864-4452-be88-e27aacf0bbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:45.880987 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f6f5b-a864-4452-be88-e27aacf0bbcb None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:45.881279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f6f5b-a864-4452-be88-e27aacf0bbcb None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:45.881560 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f6f5b-a864-4452-be88-e27aacf0bbcb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:45.895637 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f6f5b-a864-4452-be88-e27aacf0bbcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:01:45.904030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-a49f6f5b-a864-4452-be88-e27aacf0bbcb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 19:01:45.904030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:01:45.904030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:01:45.904030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:01:45.904030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:01:45.904030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:01:45.904030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:01:45.904030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:01:45.904030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:01:45.904030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:01:45.904030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:01:45.904030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:01:45.904030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:01:45.904030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:01:45.904030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:01:45.904030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:01:45.905245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:01:45.905245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:01:45.905245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:01:45.905245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:01:45.905245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:01:45.905245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:01:45.905245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:01:45.905245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:01:45.905245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:01:45.905245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:01:45.905245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:01:45.905245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:01:45.905245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:01:45.905245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:01:45.905245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:01:45.905245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:01:45.906453 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:01:45.906453 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:01:45.906453 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:01:45.906453 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:01:45.906453 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:01:45.906453 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:01:45.906453 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:01:45.906453 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:01:45.906453 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:01:45.906453 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:01:45.906453 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 19:01:45.906453 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:01:45.906453 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 68/144] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:01:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:01:45.914947 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3829f3f-dbd0-4e38-98ac-a7d0248d636e None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:46.128488 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3829f3f-dbd0-4e38-98ac-a7d0248d636e None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:46.135430 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e5306-9c7a-4fc5-afd1-28194592330d None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:46.135915 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e5306-9c7a-4fc5-afd1-28194592330d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:46.135915 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e5306-9c7a-4fc5-afd1-28194592330d None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:46.137538 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 69/145] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:01:46.151032 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc623f9-4454-4eea-9ebd-a5fdbda8b1b8 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:46.151641 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc623f9-4454-4eea-9ebd-a5fdbda8b1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:46.152343 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc623f9-4454-4eea-9ebd-a5fdbda8b1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:46.174832 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-5bc623f9-4454-4eea-9ebd-a5fdbda8b1b8 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:46.177806 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5bc623f9-4454-4eea-9ebd-a5fdbda8b1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:46.192022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a41573-c6cf-438c-b0c0-c1fe8d9d863f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:46.192022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a41573-c6cf-438c-b0c0-c1fe8d9d863f None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:46.192022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a41573-c6cf-438c-b0c0-c1fe8d9d863f None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:46.192022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a41573-c6cf-438c-b0c0-c1fe8d9d863f None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:46.192386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a41573-c6cf-438c-b0c0-c1fe8d9d863f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:46.192386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a41573-c6cf-438c-b0c0-c1fe8d9d863f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:46.192386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a41573-c6cf-438c-b0c0-c1fe8d9d863f None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:46.201851 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 77/146] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:01:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:46.208484 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a41573-c6cf-438c-b0c0-c1fe8d9d863f None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:46.302553 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:46.315660 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:46.321777 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 70/147] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 19:01:46.348300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc623f9-4454-4eea-9ebd-a5fdbda8b1b8 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:46.396858 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a41573-c6cf-438c-b0c0-c1fe8d9d863f None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:46.474570 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc623f9-4454-4eea-9ebd-a5fdbda8b1b8 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:46.477211 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa2b6f-1dc4-4b4a-8179-b542fd2f00ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:46.478762 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa2b6f-1dc4-4b4a-8179-b542fd2f00ef None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:46.479270 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa2b6f-1dc4-4b4a-8179-b542fd2f00ef None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:46.479736 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa2b6f-1dc4-4b4a-8179-b542fd2f00ef None admin] PATH_INFO: `/v3/users/439f856d9f16433ea2b161da27907c7a` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:46.483173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa2b6f-1dc4-4b4a-8179-b542fd2f00ef None admin] RBAC: Authorizing `identity:get_user(user_id=439f856d9f16433ea2b161da27907c7a)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:46.485399 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa2b6f-1dc4-4b4a-8179-b542fd2f00ef None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:46.489544 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 78/148] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:01:46 2022] GET /identity/v3/users/439f856d9f16433ea2b161da27907c7a => generated 289 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:01:46.494806 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa2b6f-1dc4-4b4a-8179-b542fd2f00ef None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:46.599936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d349a-9f8f-4e42-8c0e-30979deff773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:46.601276 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d349a-9f8f-4e42-8c0e-30979deff773 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:46.601746 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d349a-9f8f-4e42-8c0e-30979deff773 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:46.602202 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d349a-9f8f-4e42-8c0e-30979deff773 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:46.643783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d349a-9f8f-4e42-8c0e-30979deff773 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:01:46.666732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-542d349a-9f8f-4e42-8c0e-30979deff773 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:01:46.666732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:01:46.666732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:01:46.666732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:01:46.666732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:01:46.666732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:01:46.666732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:01:46.666732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:01:46.666732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:01:46.666732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:01:46.666732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:01:46.666732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:01:46.666732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:01:46.666732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:01:46.666732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:01:46.666732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:01:46.667614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:01:46.667614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:01:46.667614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:01:46.667614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:01:46.667614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:01:46.667614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:01:46.667614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:01:46.667614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:01:46.667614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:01:46.667614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:01:46.667614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:01:46.667614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:01:46.667614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:01:46.667614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:01:46.667614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:01:46.667614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:01:46.668428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:01:46.668428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:01:46.668428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:01:46.668428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:01:46.668428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:01:46.668428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:01:46.668428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:01:46.668428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:01:46.668428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:01:46.668428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:01:46.668428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:01:46.668428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:01:46.670797 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 71/149] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:01:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:01:46.683858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d349a-9f8f-4e42-8c0e-30979deff773 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:46.834347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa2b6f-1dc4-4b4a-8179-b542fd2f00ef None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:46.856432 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:46.890952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:46.923151 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b9d75-5e6f-4841-a99a-24c86039268f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:46.925355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b9d75-5e6f-4841-a99a-24c86039268f None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:46.927101 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b9d75-5e6f-4841-a99a-24c86039268f None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:46.927583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b9d75-5e6f-4841-a99a-24c86039268f None admin] PATH_INFO: `/v3/projects/3c0517c3b0534b0499d8dae17360cb89` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:46.929957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b9d75-5e6f-4841-a99a-24c86039268f None admin] RBAC: Authorizing `identity:get_project(project_id=3c0517c3b0534b0499d8dae17360cb89)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:46.931648 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b9d75-5e6f-4841-a99a-24c86039268f None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:46.935349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 79/150] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:01:46 2022] GET /identity/v3/projects/3c0517c3b0534b0499d8dae17360cb89 => generated 298 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:46.943172 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b9d75-5e6f-4841-a99a-24c86039268f None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:46.945093 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d349a-9f8f-4e42-8c0e-30979deff773 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:47.012797 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff73fd5-e935-42a3-bbbf-a03ed995076b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:47.013519 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff73fd5-e935-42a3-bbbf-a03ed995076b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:47.014693 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff73fd5-e935-42a3-bbbf-a03ed995076b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:47.014972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff73fd5-e935-42a3-bbbf-a03ed995076b None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:47.015774 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff73fd5-e935-42a3-bbbf-a03ed995076b None admin] RBAC: Adding query filter params (name=member) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:47.019899 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff73fd5-e935-42a3-bbbf-a03ed995076b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:47.023329 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff73fd5-e935-42a3-bbbf-a03ed995076b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:47.046480 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 72/151] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:01:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:47.049585 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff73fd5-e935-42a3-bbbf-a03ed995076b None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:47.138276 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b9d75-5e6f-4841-a99a-24c86039268f None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:47.200950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73758efd-447f-4294-a96b-fbac0c0daceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:47.201815 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73758efd-447f-4294-a96b-fbac0c0daceb None admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:47.202104 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73758efd-447f-4294-a96b-fbac0c0daceb None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:47.202389 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73758efd-447f-4294-a96b-fbac0c0daceb None admin] PATH_INFO: `/v3/projects/3c0517c3b0534b0499d8dae17360cb89/users/439f856d9f16433ea2b161da27907c7a/roles/a562117402dd4e099b4dcab2b24ead28` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:47.204638 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73758efd-447f-4294-a96b-fbac0c0daceb None admin] RBAC: Authorizing `identity:create_grant(project_id=3c0517c3b0534b0499d8dae17360cb89, user_id=439f856d9f16433ea2b161da27907c7a, role_id=a562117402dd4e099b4dcab2b24ead28)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:47.206732 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73758efd-447f-4294-a96b-fbac0c0daceb None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:47.289082 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff73fd5-e935-42a3-bbbf-a03ed995076b None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:47.317738 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:47.335317 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc106f84-039d-4ded-a6a8-fa20a94cfe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:47.336502 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc106f84-039d-4ded-a6a8-fa20a94cfe36 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:47.336786 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc106f84-039d-4ded-a6a8-fa20a94cfe36 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:47.337101 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc106f84-039d-4ded-a6a8-fa20a94cfe36 None admin] PATH_INFO: `/v3/users/072cdde6467a48fa9636648d08d9c3b7` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:47.338472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc106f84-039d-4ded-a6a8-fa20a94cfe36 None admin] RBAC: Authorizing `identity:get_user(user_id=072cdde6467a48fa9636648d08d9c3b7)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:47.340456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc106f84-039d-4ded-a6a8-fa20a94cfe36 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:47.342391 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 80/152] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jun 2 19:01:46 2022] PUT /identity/v3/projects/3c0517c3b0534b0499d8dae17360cb89/users/439f856d9f16433ea2b161da27907c7a/roles/a562117402dd4e099b4dcab2b24ead28 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:01:47.343341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 73/153] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:01:47 2022] GET /identity/v3/users/072cdde6467a48fa9636648d08d9c3b7 => generated 275 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:47.354132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73758efd-447f-4294-a96b-fbac0c0daceb None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:47.429211 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:47.502436 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73758efd-447f-4294-a96b-fbac0c0daceb None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:47.544982 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65d23d-d6fe-45da-a4ce-1dd208b1b663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:47.545664 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65d23d-d6fe-45da-a4ce-1dd208b1b663 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:47.545954 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65d23d-d6fe-45da-a4ce-1dd208b1b663 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:47.546236 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65d23d-d6fe-45da-a4ce-1dd208b1b663 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:47.629936 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65d23d-d6fe-45da-a4ce-1dd208b1b663 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:47.631517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65d23d-d6fe-45da-a4ce-1dd208b1b663 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:47.688489 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:47.751964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 81/154] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:01:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:47.759544 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc106f84-039d-4ded-a6a8-fa20a94cfe36 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:47.910559 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc106f84-039d-4ded-a6a8-fa20a94cfe36 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:47.962846 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c6387-bdee-470c-a0b0-f8e8f7d32ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:47.963726 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c6387-bdee-470c-a0b0-f8e8f7d32ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:47.964023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c6387-bdee-470c-a0b0-f8e8f7d32ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:47.964301 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c6387-bdee-470c-a0b0-f8e8f7d32ee7 None admin] PATH_INFO: `/v3/projects/3c0517c3b0534b0499d8dae17360cb89` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:47.969168 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c6387-bdee-470c-a0b0-f8e8f7d32ee7 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0517c3b0534b0499d8dae17360cb89)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:47.970675 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c6387-bdee-470c-a0b0-f8e8f7d32ee7 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:47.972597 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 74/155] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:01:47 2022] GET /identity/v3/projects/3c0517c3b0534b0499d8dae17360cb89 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:01:47.982875 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65d23d-d6fe-45da-a4ce-1dd208b1b663 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:48.204274 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65d23d-d6fe-45da-a4ce-1dd208b1b663 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:48.269231 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecc1b7-c821-4a30-89ce-0ac81a369686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:48.270587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecc1b7-c821-4a30-89ce-0ac81a369686 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:48.271208 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecc1b7-c821-4a30-89ce-0ac81a369686 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:48.271795 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecc1b7-c821-4a30-89ce-0ac81a369686 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:48.273357 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecc1b7-c821-4a30-89ce-0ac81a369686 None admin] RBAC: Adding query filter params (role.id=75723f2a7ead4f5cb2885e7b63680b08, scope.project.id=3c0517c3b0534b0499d8dae17360cb89, user.id=072cdde6467a48fa9636648d08d9c3b7) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:48.274018 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecc1b7-c821-4a30-89ce-0ac81a369686 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:48.277028 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecc1b7-c821-4a30-89ce-0ac81a369686 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:48.290274 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 82/156] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:01:47 2022] GET /identity/v3/role_assignments?user.id=072cdde6467a48fa9636648d08d9c3b7&scope.project.id=3c0517c3b0534b0499d8dae17360cb89&role.id=75723f2a7ead4f5cb2885e7b63680b08 => generated 608 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:48.362974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28c0ae-4aa3-433e-b46a-444fb2414504 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:48.363744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28c0ae-4aa3-433e-b46a-444fb2414504 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:48.363744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28c0ae-4aa3-433e-b46a-444fb2414504 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:48.365269 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 75/157] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:01:48.372101 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5151a1-623b-4a56-8c8e-b9eebc25781f None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:48.372893 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5151a1-623b-4a56-8c8e-b9eebc25781f None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:48.373588 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5151a1-623b-4a56-8c8e-b9eebc25781f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:48.404721 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-8e5151a1-623b-4a56-8c8e-b9eebc25781f None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:48.407239 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-8e5151a1-623b-4a56-8c8e-b9eebc25781f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:48.423391 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:48.551675 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 83/158] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:01:48.591613 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28c0ae-4aa3-433e-b46a-444fb2414504 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:48.678165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:48.738045 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28c0ae-4aa3-433e-b46a-444fb2414504 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:48.785514 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acd05b-ed29-4580-99de-6b940f6a702f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:48.786324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acd05b-ed29-4580-99de-6b940f6a702f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:48.786604 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acd05b-ed29-4580-99de-6b940f6a702f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:48.786880 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acd05b-ed29-4580-99de-6b940f6a702f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:48.812211 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acd05b-ed29-4580-99de-6b940f6a702f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:01:48.820940 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-49acd05b-ed29-4580-99de-6b940f6a702f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:01:48.820940 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:01:48.820940 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:01:48.820940 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:01:48.820940 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:01:48.820940 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:01:48.820940 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:01:48.820940 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:01:48.820940 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:01:48.820940 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:01:48.820940 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:01:48.820940 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:01:48.820940 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:01:48.820940 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:01:48.820940 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:01:48.820940 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:01:48.823150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:01:48.823150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:01:48.823150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:01:48.823150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:01:48.823150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:01:48.823150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:01:48.823150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:01:48.823150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:01:48.823150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:01:48.823150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:01:48.823150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:01:48.823150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:01:48.823150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:01:48.823150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:01:48.823150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:01:48.823150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:01:48.824942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:01:48.824942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:01:48.824942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:01:48.824942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:01:48.824942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:01:48.824942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:01:48.824942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:01:48.824942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:01:48.824942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:01:48.824942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:01:48.824942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:01:48.824942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:01:48.824942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 76/159] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:01:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:01:48.832064 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5151a1-623b-4a56-8c8e-b9eebc25781f None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:48.978210 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5151a1-623b-4a56-8c8e-b9eebc25781f None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:49.017074 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322391f5-0943-4157-ac53-b711318e9029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:49.019216 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322391f5-0943-4157-ac53-b711318e9029 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:49.019704 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322391f5-0943-4157-ac53-b711318e9029 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:49.020230 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322391f5-0943-4157-ac53-b711318e9029 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:49.021206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322391f5-0943-4157-ac53-b711318e9029 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:49.021738 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322391f5-0943-4157-ac53-b711318e9029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:49.023403 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322391f5-0943-4157-ac53-b711318e9029 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:49.033256 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 84/160] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:01:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:49.039476 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acd05b-ed29-4580-99de-6b940f6a702f None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:49.162941 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acd05b-ed29-4580-99de-6b940f6a702f None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:49.182076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:49.184495 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c38bc-7a84-435d-8dd5-5fc0d90b0ceb None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:49.185064 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c38bc-7a84-435d-8dd5-5fc0d90b0ceb None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:49.185553 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c38bc-7a84-435d-8dd5-5fc0d90b0ceb None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:49.187183 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 85/161] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:49.193539 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad1b02-0644-4e36-a32f-b103910a6e7f None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:49.194162 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad1b02-0644-4e36-a32f-b103910a6e7f None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:49.194664 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad1b02-0644-4e36-a32f-b103910a6e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:49.203905 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:49.223944 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c19950-6674-4da3-a7fe-b727f19bc402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:49.224839 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-89ad1b02-0644-4e36-a32f-b103910a6e7f None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:49.225541 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c19950-6674-4da3-a7fe-b727f19bc402 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:49.226325 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c19950-6674-4da3-a7fe-b727f19bc402 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:49.226601 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c19950-6674-4da3-a7fe-b727f19bc402 None admin] PATH_INFO: `/v3/users/1a0014c58c4c4ce1bf436c7c1e5d03c7` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:49.227372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-89ad1b02-0644-4e36-a32f-b103910a6e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:49.227902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c19950-6674-4da3-a7fe-b727f19bc402 None admin] RBAC: Authorizing `identity:get_user(user_id=1a0014c58c4c4ce1bf436c7c1e5d03c7)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:49.229430 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c19950-6674-4da3-a7fe-b727f19bc402 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:49.232685 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 77/162] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:01:49 2022] GET /identity/v3/users/1a0014c58c4c4ce1bf436c7c1e5d03c7 => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:49.238626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c19950-6674-4da3-a7fe-b727f19bc402 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:49.328429 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 86/163] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 19:01:49.392891 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad1b02-0644-4e36-a32f-b103910a6e7f None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:49.465896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c19950-6674-4da3-a7fe-b727f19bc402 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:49.564316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994ba0b-20c2-4c2f-943a-faef8a25ba9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:49.565731 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994ba0b-20c2-4c2f-943a-faef8a25ba9c None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:49.566491 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994ba0b-20c2-4c2f-943a-faef8a25ba9c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:49.566602 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994ba0b-20c2-4c2f-943a-faef8a25ba9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:49.592586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad1b02-0644-4e36-a32f-b103910a6e7f None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:49.639724 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcfaf0-6bcf-4ade-9372-c6f3b8d5f332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:49.641000 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcfaf0-6bcf-4ade-9372-c6f3b8d5f332 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:49.642226 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcfaf0-6bcf-4ade-9372-c6f3b8d5f332 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:49.642758 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcfaf0-6bcf-4ade-9372-c6f3b8d5f332 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:49.646434 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:49.659426 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befcfaf0-6bcf-4ade-9372-c6f3b8d5f332 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:01:49.670496 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-befcfaf0-6bcf-4ade-9372-c6f3b8d5f332 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:01:49.670496 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:01:49.670496 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:01:49.670496 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:01:49.670496 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:01:49.670496 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:01:49.670496 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:01:49.670496 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:01:49.670496 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:01:49.670496 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:01:49.670496 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:01:49.670496 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:01:49.670496 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:01:49.670496 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:01:49.670496 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:01:49.670496 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:01:49.671442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:01:49.671442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:01:49.671442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:01:49.671442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:01:49.671442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:01:49.671442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:01:49.671442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:01:49.671442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:01:49.671442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:01:49.671442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:01:49.671442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:01:49.671442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:01:49.671442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:01:49.671442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:01:49.671442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:01:49.671442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:01:49.672258 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:01:49.672258 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:01:49.672258 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:01:49.672258 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:01:49.672258 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:01:49.672258 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:01:49.672258 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:01:49.672258 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:01:49.672258 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:01:49.672258 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:01:49.672258 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:01:49.672258 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:01:49.675885 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 87/164] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:01:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:01:49.685775 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcfaf0-6bcf-4ade-9372-c6f3b8d5f332 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:49.752090 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:49.827198 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3994ba0b-20c2-4c2f-943a-faef8a25ba9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:49.830030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3994ba0b-20c2-4c2f-943a-faef8a25ba9c None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:49.927974 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcfaf0-6bcf-4ade-9372-c6f3b8d5f332 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:50.061338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea8beb-d394-4be0-b81a-1b99080a8125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:50.063822 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea8beb-d394-4be0-b81a-1b99080a8125 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:50.064677 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea8beb-d394-4be0-b81a-1b99080a8125 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:50.065501 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea8beb-d394-4be0-b81a-1b99080a8125 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:50.067323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea8beb-d394-4be0-b81a-1b99080a8125 None admin] RBAC: Adding query filter params (name=member) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:50.068184 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea8beb-d394-4be0-b81a-1b99080a8125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:50.071111 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea8beb-d394-4be0-b81a-1b99080a8125 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:50.098818 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 88/165] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:01:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:50.101753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366be55-54e7-4eb3-80b7-01ac90244cb8 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:50.102683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366be55-54e7-4eb3-80b7-01ac90244cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:50.108956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366be55-54e7-4eb3-80b7-01ac90244cb8 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:50.112713 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 89/166] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:50 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:50.116030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 78/167] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:01:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 876 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 19:01:50.121865 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae9818-c397-4110-8974-ef6e5aeb3308 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:50.122811 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae9818-c397-4110-8974-ef6e5aeb3308 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:50.123599 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae9818-c397-4110-8974-ef6e5aeb3308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:50.130283 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994ba0b-20c2-4c2f-943a-faef8a25ba9c None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:50.177822 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-1eae9818-c397-4110-8974-ef6e5aeb3308 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:50.180907 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-1eae9818-c397-4110-8974-ef6e5aeb3308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:50.325750 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:50.366464 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:50.370656 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994ba0b-20c2-4c2f-943a-faef8a25ba9c None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:50.394520 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 90/168] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:01:50.397110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae9818-c397-4110-8974-ef6e5aeb3308 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:50.461618 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79849182-9a72-4bda-ad64-8fb1413deb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:50.463327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79849182-9a72-4bda-ad64-8fb1413deb71 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:50.463835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79849182-9a72-4bda-ad64-8fb1413deb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:50.464351 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79849182-9a72-4bda-ad64-8fb1413deb71 None admin] PATH_INFO: `/v3/projects/3c0517c3b0534b0499d8dae17360cb89` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:50.469265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79849182-9a72-4bda-ad64-8fb1413deb71 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0517c3b0534b0499d8dae17360cb89)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:50.470763 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79849182-9a72-4bda-ad64-8fb1413deb71 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:50.473524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 79/169] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:01:50 2022] GET /identity/v3/projects/3c0517c3b0534b0499d8dae17360cb89 => generated 298 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:01:50.474363 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79849182-9a72-4bda-ad64-8fb1413deb71 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:50.544259 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae9818-c397-4110-8974-ef6e5aeb3308 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:50.587218 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff446b9-f34b-4fdb-b00e-f6c0951679d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:50.588222 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff446b9-f34b-4fdb-b00e-f6c0951679d9 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:50.588507 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff446b9-f34b-4fdb-b00e-f6c0951679d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:50.588790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff446b9-f34b-4fdb-b00e-f6c0951679d9 None admin] PATH_INFO: `/v3/users/072cdde6467a48fa9636648d08d9c3b7` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:50.590102 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff446b9-f34b-4fdb-b00e-f6c0951679d9 None admin] RBAC: Authorizing `identity:get_user(user_id=072cdde6467a48fa9636648d08d9c3b7)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:50.591877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff446b9-f34b-4fdb-b00e-f6c0951679d9 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:50.595341 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 91/170] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:01:50 2022] GET /identity/v3/users/072cdde6467a48fa9636648d08d9c3b7 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:50.596746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff446b9-f34b-4fdb-b00e-f6c0951679d9 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:50.663320 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:50.716603 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff446b9-f34b-4fdb-b00e-f6c0951679d9 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:50.758272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3c49f-9e86-4084-952a-a6d545f30e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:50.758962 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3c49f-9e86-4084-952a-a6d545f30e3a None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:50.759430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3c49f-9e86-4084-952a-a6d545f30e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:50.759723 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3c49f-9e86-4084-952a-a6d545f30e3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:50.760617 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3c49f-9e86-4084-952a-a6d545f30e3a None admin] RBAC: Adding query filter params (role.id=4588ca63994f4e2d9ce482d475edbabd, scope.project.id=3c0517c3b0534b0499d8dae17360cb89, user.id=1a0014c58c4c4ce1bf436c7c1e5d03c7) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:50.760943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3c49f-9e86-4084-952a-a6d545f30e3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:50.762505 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3c49f-9e86-4084-952a-a6d545f30e3a None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:50.770424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 92/171] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:01:50 2022] GET /identity/v3/role_assignments?user.id=1a0014c58c4c4ce1bf436c7c1e5d03c7&scope.project.id=3c0517c3b0534b0499d8dae17360cb89&role.id=4588ca63994f4e2d9ce482d475edbabd => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:50.771322 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3c49f-9e86-4084-952a-a6d545f30e3a None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:50.863707 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79849182-9a72-4bda-ad64-8fb1413deb71 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:50.910629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3c49f-9e86-4084-952a-a6d545f30e3a None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:50.944561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:50.961494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf2a61-6dc2-48e1-9bd5-9db69ce4f39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:50.962161 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf2a61-6dc2-48e1-9bd5-9db69ce4f39a None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:50.962512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf2a61-6dc2-48e1-9bd5-9db69ce4f39a None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:50.962759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf2a61-6dc2-48e1-9bd5-9db69ce4f39a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:51.025157 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09e354-17f6-4865-a88a-67f2ee554280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:51.026004 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09e354-17f6-4865-a88a-67f2ee554280 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:51.026288 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09e354-17f6-4865-a88a-67f2ee554280 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:51.026561 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09e354-17f6-4865-a88a-67f2ee554280 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:51.050474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf2a61-6dc2-48e1-9bd5-9db69ce4f39a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:51.052463 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf2a61-6dc2-48e1-9bd5-9db69ce4f39a None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:51.060682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09e354-17f6-4865-a88a-67f2ee554280 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:01:51.069650 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-6f09e354-17f6-4865-a88a-67f2ee554280 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 19:01:51.069650 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:01:51.069650 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:01:51.069650 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:01:51.069650 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:01:51.069650 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:01:51.069650 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:01:51.069650 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:01:51.069650 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:01:51.069650 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:01:51.069650 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:01:51.069650 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:01:51.069650 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:01:51.069650 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:01:51.069650 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:01:51.069650 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:01:51.070651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:01:51.070651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:01:51.070651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:01:51.070651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:01:51.070651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:01:51.070651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:01:51.070651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:01:51.070651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:01:51.070651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:01:51.070651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:01:51.070651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:01:51.070651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:01:51.070651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:01:51.070651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:01:51.070651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:01:51.070651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:01:51.071433 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:01:51.071433 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:01:51.071433 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:01:51.071433 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:01:51.071433 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:01:51.071433 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:01:51.071433 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:01:51.071433 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:01:51.071433 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:01:51.071433 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:01:51.071433 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 19:01:51.071433 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:01:51.071433 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 80/172] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jun 2 19:01:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 597 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:01:51.076929 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09e354-17f6-4865-a88a-67f2ee554280 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:51.118157 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:51.178169 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 93/173] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:01:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:51.184790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf2a61-6dc2-48e1-9bd5-9db69ce4f39a None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:51.240404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:51.264532 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09e354-17f6-4865-a88a-67f2ee554280 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:51.331740 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d01e1-be33-4228-b06e-aed35dd02cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:51.332473 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d01e1-be33-4228-b06e-aed35dd02cbc None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:51.332754 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d01e1-be33-4228-b06e-aed35dd02cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:51.333044 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d01e1-be33-4228-b06e-aed35dd02cbc None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:51.333801 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d01e1-be33-4228-b06e-aed35dd02cbc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:51.334144 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d01e1-be33-4228-b06e-aed35dd02cbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:51.335542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d01e1-be33-4228-b06e-aed35dd02cbc None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:51.336733 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf2a61-6dc2-48e1-9bd5-9db69ce4f39a None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:51.358296 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 81/174] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:01:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:51.366265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d01e1-be33-4228-b06e-aed35dd02cbc None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:51.394234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52859340-3120-4037-ad6a-960bb821bd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:51.394934 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52859340-3120-4037-ad6a-960bb821bd72 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:51.395222 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52859340-3120-4037-ad6a-960bb821bd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:51.395500 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52859340-3120-4037-ad6a-960bb821bd72 None admin] PATH_INFO: `/v3/projects/3b458df115454031b7eced0a0315c0f7` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:51.400879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52859340-3120-4037-ad6a-960bb821bd72 None admin] RBAC: Authorizing `identity:get_project(project_id=3b458df115454031b7eced0a0315c0f7)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:51.402405 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52859340-3120-4037-ad6a-960bb821bd72 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:51.404629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 94/175] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:01:51 2022] GET /identity/v3/projects/3b458df115454031b7eced0a0315c0f7 => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:51.410972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52859340-3120-4037-ad6a-960bb821bd72 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:51.506756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:51.552390 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d01e1-be33-4228-b06e-aed35dd02cbc None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:51.600442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:51.607468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d813eb-0938-4dd4-b1ac-3fb79441deeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:51.608430 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d813eb-0938-4dd4-b1ac-3fb79441deeb None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:51.608721 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d813eb-0938-4dd4-b1ac-3fb79441deeb None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:51.609008 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d813eb-0938-4dd4-b1ac-3fb79441deeb None admin] PATH_INFO: `/v3/users/072cdde6467a48fa9636648d08d9c3b7` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:51.610414 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d813eb-0938-4dd4-b1ac-3fb79441deeb None admin] RBAC: Authorizing `identity:get_user(user_id=072cdde6467a48fa9636648d08d9c3b7)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:51.618303 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52859340-3120-4037-ad6a-960bb821bd72 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:51.624111 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d813eb-0938-4dd4-b1ac-3fb79441deeb None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:51.624111 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 82/176] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:01:51 2022] GET /identity/v3/users/072cdde6467a48fa9636648d08d9c3b7 => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:01:51.624111 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabd7b4-f7d1-4fd1-8c46-5e1d5885b382 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:51.624415 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabd7b4-f7d1-4fd1-8c46-5e1d5885b382 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:51.624655 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabd7b4-f7d1-4fd1-8c46-5e1d5885b382 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:51.625908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 83/177] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:51.633099 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabd7b4-f7d1-4fd1-8c46-5e1d5885b382 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:51.677725 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5e68f-1a2b-4dc0-9d2e-176e91e60935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:51.679800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5e68f-1a2b-4dc0-9d2e-176e91e60935 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:51.680138 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5e68f-1a2b-4dc0-9d2e-176e91e60935 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:51.680418 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5e68f-1a2b-4dc0-9d2e-176e91e60935 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:51.681430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5e68f-1a2b-4dc0-9d2e-176e91e60935 None admin] RBAC: Adding query filter params (role.id=75723f2a7ead4f5cb2885e7b63680b08, scope.project.id=3b458df115454031b7eced0a0315c0f7, user.id=072cdde6467a48fa9636648d08d9c3b7) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:51.681754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5e68f-1a2b-4dc0-9d2e-176e91e60935 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:51.685335 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5e68f-1a2b-4dc0-9d2e-176e91e60935 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:51.708531 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 95/178] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:01:51 2022] GET /identity/v3/role_assignments?user.id=072cdde6467a48fa9636648d08d9c3b7&scope.project.id=3b458df115454031b7eced0a0315c0f7&role.id=75723f2a7ead4f5cb2885e7b63680b08 => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:51.710396 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923fa02-41c4-427a-a5fd-93b8428a5f3f None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:51.710688 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923fa02-41c4-427a-a5fd-93b8428a5f3f None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:51.710968 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923fa02-41c4-427a-a5fd-93b8428a5f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:51.769791 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-e923fa02-41c4-427a-a5fd-93b8428a5f3f None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:51.772326 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-e923fa02-41c4-427a-a5fd-93b8428a5f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:51.917987 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabd7b4-f7d1-4fd1-8c46-5e1d5885b382 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:51.986454 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1df01-e8be-47b0-88be-bc5de52ac0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:51.988478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1df01-e8be-47b0-88be-bc5de52ac0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:51.988959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1df01-e8be-47b0-88be-bc5de52ac0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:51.989335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1df01-e8be-47b0-88be-bc5de52ac0f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.010535 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 96/179] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:01:52.014455 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:52.037510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d84a2-071d-4690-a186-642aed709ba5 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.037844 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d84a2-071d-4690-a186-642aed709ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.038137 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d84a2-071d-4690-a186-642aed709ba5 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.040828 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 97/180] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:52.046471 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970a2c4-7d8f-45f8-8335-b90d1fccaf04 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.046799 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970a2c4-7d8f-45f8-8335-b90d1fccaf04 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.047035 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970a2c4-7d8f-45f8-8335-b90d1fccaf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.077245 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-1970a2c4-7d8f-45f8-8335-b90d1fccaf04 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:52.079202 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-1970a2c4-7d8f-45f8-8335-b90d1fccaf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:52.120682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1df01-e8be-47b0-88be-bc5de52ac0f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:52.122169 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1df01-e8be-47b0-88be-bc5de52ac0f4 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:52.192528 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 98/181] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 19:01:52.192528 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970a2c4-7d8f-45f8-8335-b90d1fccaf04 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:52.209781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:52.270546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 84/182] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:01:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:52.271881 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e88cd-5642-4e1b-8f0b-6208b94750d4 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.272238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e88cd-5642-4e1b-8f0b-6208b94750d4 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.272517 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e88cd-5642-4e1b-8f0b-6208b94750d4 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.274059 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 85/183] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:52.274645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e88cd-5642-4e1b-8f0b-6208b94750d4 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:52.330379 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:52.336755 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970a2c4-7d8f-45f8-8335-b90d1fccaf04 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:52.379779 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8736f4-0dc5-48aa-95a2-ebe6378f5b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:52.380616 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8736f4-0dc5-48aa-95a2-ebe6378f5b9a None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.381001 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8736f4-0dc5-48aa-95a2-ebe6378f5b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.381170 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8736f4-0dc5-48aa-95a2-ebe6378f5b9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.394222 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8736f4-0dc5-48aa-95a2-ebe6378f5b9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:01:52.400342 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e88cd-5642-4e1b-8f0b-6208b94750d4 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:52.402411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-0c8736f4-0dc5-48aa-95a2-ebe6378f5b9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:01:52.402411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:01:52.402411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:01:52.402411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:01:52.402411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:01:52.402411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:01:52.402411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:01:52.402411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:01:52.402411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:01:52.402411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:01:52.402411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:01:52.402411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:01:52.402411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:01:52.402411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:01:52.402411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:01:52.402411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:01:52.403275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:01:52.403275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:01:52.403275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:01:52.403275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:01:52.403275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:01:52.403275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:01:52.403275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:01:52.403275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:01:52.403275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:01:52.403275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:01:52.403275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:01:52.403275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:01:52.403275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:01:52.403275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:01:52.403275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:01:52.403275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:01:52.405621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:01:52.405621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:01:52.405621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:01:52.405621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:01:52.405621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:01:52.405621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:01:52.405621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:01:52.405621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:01:52.405621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:01:52.405621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:01:52.405621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:01:52.405621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:01:52.405621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 99/184] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:01:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:01:52.405621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8736f4-0dc5-48aa-95a2-ebe6378f5b9a None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:52.440909 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130f4ba-c150-4d48-9093-4141720b3b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:52.441721 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130f4ba-c150-4d48-9093-4141720b3b39 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.442004 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130f4ba-c150-4d48-9093-4141720b3b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.442275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130f4ba-c150-4d48-9093-4141720b3b39 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.456829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130f4ba-c150-4d48-9093-4141720b3b39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:01:52.466159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-b130f4ba-c150-4d48-9093-4141720b3b39 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 19:01:52.466159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:01:52.466159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:01:52.466159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:01:52.466159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:01:52.466159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:01:52.466159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:01:52.466159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:01:52.466159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:01:52.466159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:01:52.466159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:01:52.466159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:01:52.466159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:01:52.466159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:01:52.466159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:01:52.466159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:01:52.467251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:01:52.467251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:01:52.467251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:01:52.467251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:01:52.467251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:01:52.467251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:01:52.467251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:01:52.467251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:01:52.467251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:01:52.467251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:01:52.467251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:01:52.467251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:01:52.467251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:01:52.467251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:01:52.467251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:01:52.467251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:01:52.469047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:01:52.469047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:01:52.469047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:01:52.469047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:01:52.469047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:01:52.469047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:01:52.469047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:01:52.469047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:01:52.469047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:01:52.469047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:01:52.469047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 19:01:52.469047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:01:52.469047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 86/185] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jun 2 19:01:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:01:52.469047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76683b2f-7fec-44fe-9797-1e101ca1c28f None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.469748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76683b2f-7fec-44fe-9797-1e101ca1c28f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.469748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76683b2f-7fec-44fe-9797-1e101ca1c28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.488666 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-76683b2f-7fec-44fe-9797-1e101ca1c28f None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:52.489972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-76683b2f-7fec-44fe-9797-1e101ca1c28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:52.492546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:52.525947 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8736f4-0dc5-48aa-95a2-ebe6378f5b9a None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:52.566542 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c3820-5480-4f7d-aa8b-6a1f89ade987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:52.567409 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c3820-5480-4f7d-aa8b-6a1f89ade987 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.567851 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 87/186] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:01:52.568311 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c3820-5480-4f7d-aa8b-6a1f89ade987 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.568510 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76683b2f-7fec-44fe-9797-1e101ca1c28f None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:52.576399 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c3820-5480-4f7d-aa8b-6a1f89ade987 None admin] PATH_INFO: `/v3/projects/3c0517c3b0534b0499d8dae17360cb89` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.588096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c3820-5480-4f7d-aa8b-6a1f89ade987 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0517c3b0534b0499d8dae17360cb89)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:52.588096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c3820-5480-4f7d-aa8b-6a1f89ade987 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:52.588096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 100/187] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:01:52 2022] GET /identity/v3/projects/3c0517c3b0534b0499d8dae17360cb89 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:52.588096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c3820-5480-4f7d-aa8b-6a1f89ade987 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:52.616014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:52.693473 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76683b2f-7fec-44fe-9797-1e101ca1c28f None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:52.698622 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c3820-5480-4f7d-aa8b-6a1f89ade987 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:52.731768 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec776e-64cb-4517-b9c6-a98852fbe891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:52.732483 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec776e-64cb-4517-b9c6-a98852fbe891 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.732764 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec776e-64cb-4517-b9c6-a98852fbe891 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.733051 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec776e-64cb-4517-b9c6-a98852fbe891 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.733813 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec776e-64cb-4517-b9c6-a98852fbe891 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:52.734124 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec776e-64cb-4517-b9c6-a98852fbe891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:52.734218 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc4229-b70e-4f4c-8db3-f9cb36490ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:52.734838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc4229-b70e-4f4c-8db3-f9cb36490ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.735120 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc4229-b70e-4f4c-8db3-f9cb36490ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.735394 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc4229-b70e-4f4c-8db3-f9cb36490ee7 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.735569 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec776e-64cb-4517-b9c6-a98852fbe891 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:52.736174 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc4229-b70e-4f4c-8db3-f9cb36490ee7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:52.736484 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc4229-b70e-4f4c-8db3-f9cb36490ee7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:52.738526 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc4229-b70e-4f4c-8db3-f9cb36490ee7 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:52.743885 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:52.744927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 88/188] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:01:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:52.745770 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec776e-64cb-4517-b9c6-a98852fbe891 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:52.756078 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 101/189] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:01:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:52.756078 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc4229-b70e-4f4c-8db3-f9cb36490ee7 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:52.847917 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:52.854710 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec776e-64cb-4517-b9c6-a98852fbe891 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:52.872382 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc4229-b70e-4f4c-8db3-f9cb36490ee7 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:52.890235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e442f5-63a2-4662-9c76-1dffde2bea2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:52.890897 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e442f5-63a2-4662-9c76-1dffde2bea2a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.891177 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e442f5-63a2-4662-9c76-1dffde2bea2a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.891442 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e442f5-63a2-4662-9c76-1dffde2bea2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.892310 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e442f5-63a2-4662-9c76-1dffde2bea2a None admin] RBAC: Adding query filter params (role.id=27769697518a42139af80d8b8410ca07, scope.project.id=3c0517c3b0534b0499d8dae17360cb89, user.id=072cdde6467a48fa9636648d08d9c3b7) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:52.892641 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e442f5-63a2-4662-9c76-1dffde2bea2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:52.894164 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e442f5-63a2-4662-9c76-1dffde2bea2a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:52.900393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 89/190] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:01:52 2022] GET /identity/v3/role_assignments?user.id=072cdde6467a48fa9636648d08d9c3b7&scope.project.id=3c0517c3b0534b0499d8dae17360cb89&role.id=27769697518a42139af80d8b8410ca07 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:52.901701 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26195d89-58d1-473d-8f2e-5ed97d2b9158 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.901990 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26195d89-58d1-473d-8f2e-5ed97d2b9158 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.902262 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26195d89-58d1-473d-8f2e-5ed97d2b9158 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.903568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 90/191] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:52.907271 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26195d89-58d1-473d-8f2e-5ed97d2b9158 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:52.916229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19e0c6-30bf-47f8-bc50-d59f4674f1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:52.917064 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19e0c6-30bf-47f8-bc50-d59f4674f1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.917346 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19e0c6-30bf-47f8-bc50-d59f4674f1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.917624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19e0c6-30bf-47f8-bc50-d59f4674f1e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.931879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19e0c6-30bf-47f8-bc50-d59f4674f1e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:01:52.941290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-5a19e0c6-30bf-47f8-bc50-d59f4674f1e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 19:01:52.941290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:01:52.941290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:01:52.941290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:01:52.941290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:01:52.941290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:01:52.941290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:01:52.941290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:01:52.941290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:01:52.941290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:01:52.941290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:01:52.941290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:01:52.941290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:01:52.941290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:01:52.941290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:01:52.941290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:01:52.942293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:01:52.942293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:01:52.942293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:01:52.942293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:01:52.942293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:01:52.942293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:01:52.942293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:01:52.942293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:01:52.942293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:01:52.942293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:01:52.942293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:01:52.942293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:01:52.942293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:01:52.942293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:01:52.942293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:01:52.942293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:01:52.943077 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:01:52.943077 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:01:52.943077 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:01:52.943077 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:01:52.943077 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:01:52.943077 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:01:52.943077 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:01:52.943077 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:01:52.943077 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:01:52.943077 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:01:52.943077 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 19:01:52.943077 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:01:52.943077 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 102/192] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:01:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:01:52.944708 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19e0c6-30bf-47f8-bc50-d59f4674f1e9 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:53.028820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:53.054058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26195d89-58d1-473d-8f2e-5ed97d2b9158 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:53.098004 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19e0c6-30bf-47f8-bc50-d59f4674f1e9 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:53.103446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f28ae-e635-400e-b837-8c9bace0852a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:53.104376 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f28ae-e635-400e-b837-8c9bace0852a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:53.104658 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f28ae-e635-400e-b837-8c9bace0852a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:53.104931 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f28ae-e635-400e-b837-8c9bace0852a None admin] PATH_INFO: `/v3/users/4abdea0cc0504daeb081321347dbeed7` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:53.121972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f28ae-e635-400e-b837-8c9bace0852a None admin] RBAC: Authorizing `identity:get_user(user_id=4abdea0cc0504daeb081321347dbeed7)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:53.123485 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f28ae-e635-400e-b837-8c9bace0852a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:53.125920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 91/193] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:01:52 2022] GET /identity/v3/users/4abdea0cc0504daeb081321347dbeed7 => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:53.127211 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e1a56-fc0f-4e1e-89f9-4ea464cadec7 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:53.128185 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e1a56-fc0f-4e1e-89f9-4ea464cadec7 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:53.128470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e1a56-fc0f-4e1e-89f9-4ea464cadec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:53.148223 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-7d7e1a56-fc0f-4e1e-89f9-4ea464cadec7 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:53.148568 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b263d-8d01-4d74-b2cb-6b3d5e1ea21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:53.149434 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7d7e1a56-fc0f-4e1e-89f9-4ea464cadec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:53.149670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b263d-8d01-4d74-b2cb-6b3d5e1ea21d None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:53.149954 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b263d-8d01-4d74-b2cb-6b3d5e1ea21d None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:53.150321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b263d-8d01-4d74-b2cb-6b3d5e1ea21d None admin] PATH_INFO: `/v3/users/4abdea0cc0504daeb081321347dbeed7` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:53.151565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b263d-8d01-4d74-b2cb-6b3d5e1ea21d None admin] RBAC: Authorizing `identity:get_user(user_id=4abdea0cc0504daeb081321347dbeed7)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:53.153111 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b263d-8d01-4d74-b2cb-6b3d5e1ea21d None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:53.154787 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 103/194] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:01:52 2022] GET /identity/v3/users/4abdea0cc0504daeb081321347dbeed7 => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:53.159707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b263d-8d01-4d74-b2cb-6b3d5e1ea21d None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:53.163987 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:53.227283 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 92/195] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:01:53.231925 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e1a56-fc0f-4e1e-89f9-4ea464cadec7 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:53.272187 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b263d-8d01-4d74-b2cb-6b3d5e1ea21d None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:53.299184 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:53.307789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3c555-d7cf-4a85-996f-d761efdd3071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:53.308439 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3c555-d7cf-4a85-996f-d761efdd3071 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:53.308719 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3c555-d7cf-4a85-996f-d761efdd3071 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:53.309199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3c555-d7cf-4a85-996f-d761efdd3071 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:53.309809 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3c555-d7cf-4a85-996f-d761efdd3071 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:53.310114 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3c555-d7cf-4a85-996f-d761efdd3071 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:53.311557 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3c555-d7cf-4a85-996f-d761efdd3071 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:53.322096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 104/196] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:01:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:53.322907 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3c555-d7cf-4a85-996f-d761efdd3071 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:53.363864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e1a56-fc0f-4e1e-89f9-4ea464cadec7 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:53.400558 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462be3f-2d19-46c9-96ab-ca8de2e653e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:53.401246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462be3f-2d19-46c9-96ab-ca8de2e653e8 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:53.401532 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462be3f-2d19-46c9-96ab-ca8de2e653e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:53.401808 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462be3f-2d19-46c9-96ab-ca8de2e653e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:53.419028 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:53.438506 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3c555-d7cf-4a85-996f-d761efdd3071 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:53.481468 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59e4e6-4669-4b54-a650-66ac95d9e6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:53.482121 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59e4e6-4669-4b54-a650-66ac95d9e6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:53.482417 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59e4e6-4669-4b54-a650-66ac95d9e6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:53.482690 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59e4e6-4669-4b54-a650-66ac95d9e6a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:53.483408 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462be3f-2d19-46c9-96ab-ca8de2e653e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:53.484998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462be3f-2d19-46c9-96ab-ca8de2e653e8 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:53.550487 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:53.561017 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59e4e6-4669-4b54-a650-66ac95d9e6a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:53.562297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59e4e6-4669-4b54-a650-66ac95d9e6a3 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:53.589791 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 93/197] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:01:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:53.590658 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462be3f-2d19-46c9-96ab-ca8de2e653e8 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:53.640679 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:53.673465 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 105/198] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:01:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:53.674361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59e4e6-4669-4b54-a650-66ac95d9e6a3 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:53.698575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462be3f-2d19-46c9-96ab-ca8de2e653e8 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:53.738254 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6408ac-ef06-4f2a-8c47-0365b1bf12d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:53.739056 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6408ac-ef06-4f2a-8c47-0365b1bf12d4 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:53.739340 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6408ac-ef06-4f2a-8c47-0365b1bf12d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:53.739619 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6408ac-ef06-4f2a-8c47-0365b1bf12d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:53.740909 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6408ac-ef06-4f2a-8c47-0365b1bf12d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:53.742396 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6408ac-ef06-4f2a-8c47-0365b1bf12d4 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:53.744088 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 94/199] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:01:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:53.744869 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6408ac-ef06-4f2a-8c47-0365b1bf12d4 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:53.780849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:53.791058 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59e4e6-4669-4b54-a650-66ac95d9e6a3 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:53.826402 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b7b00-3f26-4fea-b8d9-816b8733591f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:53.827192 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b7b00-3f26-4fea-b8d9-816b8733591f None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:53.827475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b7b00-3f26-4fea-b8d9-816b8733591f None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:53.827749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b7b00-3f26-4fea-b8d9-816b8733591f None admin] PATH_INFO: `/v3/users/439f856d9f16433ea2b161da27907c7a` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:53.828998 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b7b00-3f26-4fea-b8d9-816b8733591f None admin] RBAC: Authorizing `identity:get_user(user_id=439f856d9f16433ea2b161da27907c7a)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:53.830489 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b7b00-3f26-4fea-b8d9-816b8733591f None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:53.832124 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 106/200] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:01:53 2022] GET /identity/v3/users/439f856d9f16433ea2b161da27907c7a => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:53.832893 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b7b00-3f26-4fea-b8d9-816b8733591f None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:53.855487 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6408ac-ef06-4f2a-8c47-0365b1bf12d4 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:53.872342 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:53.894826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451e08e-9f56-47a1-a26f-4778150d1551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:53.895711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451e08e-9f56-47a1-a26f-4778150d1551 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:53.896016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451e08e-9f56-47a1-a26f-4778150d1551 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:53.896291 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451e08e-9f56-47a1-a26f-4778150d1551 None admin] PATH_INFO: `/v3/projects/8de22bd0413a4a049d4de3e1b38ac903` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:53.897638 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451e08e-9f56-47a1-a26f-4778150d1551 None admin] RBAC: Authorizing `identity:get_project(project_id=8de22bd0413a4a049d4de3e1b38ac903)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:53.899148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451e08e-9f56-47a1-a26f-4778150d1551 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:53.905754 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 95/201] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:01:53 2022] GET /identity/v3/projects/8de22bd0413a4a049d4de3e1b38ac903 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:53.905754 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451e08e-9f56-47a1-a26f-4778150d1551 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:53.942343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b7b00-3f26-4fea-b8d9-816b8733591f None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:53.979451 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd32cc-ef3f-4770-af21-720bc3ba04b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:53.980367 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd32cc-ef3f-4770-af21-720bc3ba04b7 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:53.980650 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd32cc-ef3f-4770-af21-720bc3ba04b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:53.981123 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd32cc-ef3f-4770-af21-720bc3ba04b7 None admin] PATH_INFO: `/v3/projects/8de22bd0413a4a049d4de3e1b38ac903` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:53.983614 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd32cc-ef3f-4770-af21-720bc3ba04b7 None admin] RBAC: Authorizing `identity:get_project(project_id=8de22bd0413a4a049d4de3e1b38ac903)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:53.985142 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd32cc-ef3f-4770-af21-720bc3ba04b7 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:53.987498 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 107/202] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:01:53 2022] GET /identity/v3/projects/8de22bd0413a4a049d4de3e1b38ac903 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:53.989345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd32cc-ef3f-4770-af21-720bc3ba04b7 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:54.013599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451e08e-9f56-47a1-a26f-4778150d1551 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:54.019301 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:54.049775 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de50f4-c953-4be2-b98a-7d17a9f432ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:54.050464 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de50f4-c953-4be2-b98a-7d17a9f432ea None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:54.050744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de50f4-c953-4be2-b98a-7d17a9f432ea None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:54.051015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de50f4-c953-4be2-b98a-7d17a9f432ea None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:54.051735 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de50f4-c953-4be2-b98a-7d17a9f432ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:54.053267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de50f4-c953-4be2-b98a-7d17a9f432ea None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:54.096521 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd32cc-ef3f-4770-af21-720bc3ba04b7 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:54.126638 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 96/203] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jun 2 19:01:53 2022] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:54.131575 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287504e-23a5-446f-bc46-1d6f9de96abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:54.133496 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287504e-23a5-446f-bc46-1d6f9de96abd None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:54.133496 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287504e-23a5-446f-bc46-1d6f9de96abd None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:54.133496 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287504e-23a5-446f-bc46-1d6f9de96abd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:54.133829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de50f4-c953-4be2-b98a-7d17a9f432ea None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:54.182973 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:54.219389 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287504e-23a5-446f-bc46-1d6f9de96abd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:54.221010 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287504e-23a5-446f-bc46-1d6f9de96abd None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:54.253635 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de50f4-c953-4be2-b98a-7d17a9f432ea None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:54.256364 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:54.296282 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e73ddb-7bd5-4fd8-a972-1f2162024bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:54.296960 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e73ddb-7bd5-4fd8-a972-1f2162024bfb None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:54.297272 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e73ddb-7bd5-4fd8-a972-1f2162024bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:54.297523 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e73ddb-7bd5-4fd8-a972-1f2162024bfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:54.298400 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e73ddb-7bd5-4fd8-a972-1f2162024bfb None admin] RBAC: Adding query filter params (role.id=4588ca63994f4e2d9ce482d475edbabd, scope.project.id=8de22bd0413a4a049d4de3e1b38ac903, user.id=4abdea0cc0504daeb081321347dbeed7) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:54.298715 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e73ddb-7bd5-4fd8-a972-1f2162024bfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:54.300316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e73ddb-7bd5-4fd8-a972-1f2162024bfb None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:54.306940 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 97/204] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:01:54 2022] GET /identity/v3/role_assignments?user.id=4abdea0cc0504daeb081321347dbeed7&scope.project.id=8de22bd0413a4a049d4de3e1b38ac903&role.id=4588ca63994f4e2d9ce482d475edbabd => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:54.307905 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e73ddb-7bd5-4fd8-a972-1f2162024bfb None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:54.377236 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 108/205] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:01:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:54.387901 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287504e-23a5-446f-bc46-1d6f9de96abd None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:54.500083 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e73ddb-7bd5-4fd8-a972-1f2162024bfb None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:54.504298 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:54.546120 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06eb06d-b0f0-49cf-b3e7-08e4ede952c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:54.546794 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06eb06d-b0f0-49cf-b3e7-08e4ede952c9 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:54.547226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06eb06d-b0f0-49cf-b3e7-08e4ede952c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:54.547449 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06eb06d-b0f0-49cf-b3e7-08e4ede952c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:54.548589 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06eb06d-b0f0-49cf-b3e7-08e4ede952c9 None admin] RBAC: Adding query filter params (role.id=27769697518a42139af80d8b8410ca07, scope.project.id=8de22bd0413a4a049d4de3e1b38ac903, user.id=4abdea0cc0504daeb081321347dbeed7) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:54.548905 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06eb06d-b0f0-49cf-b3e7-08e4ede952c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:54.550474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06eb06d-b0f0-49cf-b3e7-08e4ede952c9 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:54.561826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 98/206] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:01:54 2022] GET /identity/v3/role_assignments?user.id=4abdea0cc0504daeb081321347dbeed7&scope.project.id=8de22bd0413a4a049d4de3e1b38ac903&role.id=27769697518a42139af80d8b8410ca07 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:54.601710 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287504e-23a5-446f-bc46-1d6f9de96abd None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:54.647197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:54.662856 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b2db1-e645-4295-9662-822a7831402b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:54.663753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b2db1-e645-4295-9662-822a7831402b None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:54.664081 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b2db1-e645-4295-9662-822a7831402b None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:54.664369 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b2db1-e645-4295-9662-822a7831402b None admin] PATH_INFO: `/v3/projects/3c0517c3b0534b0499d8dae17360cb89` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:54.665693 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b2db1-e645-4295-9662-822a7831402b None admin] RBAC: Authorizing `identity:get_project(project_id=3c0517c3b0534b0499d8dae17360cb89)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:54.667349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b2db1-e645-4295-9662-822a7831402b None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:54.669550 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 109/207] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:01:54 2022] GET /identity/v3/projects/3c0517c3b0534b0499d8dae17360cb89 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:54.676491 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06eb06d-b0f0-49cf-b3e7-08e4ede952c9 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:54.797188 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06eb06d-b0f0-49cf-b3e7-08e4ede952c9 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:54.838004 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f79721-e2d8-48a7-886b-3779225b5c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:54.838685 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f79721-e2d8-48a7-886b-3779225b5c15 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:54.838973 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f79721-e2d8-48a7-886b-3779225b5c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:54.839248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f79721-e2d8-48a7-886b-3779225b5c15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:54.840158 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f79721-e2d8-48a7-886b-3779225b5c15 None admin] RBAC: Adding query filter params (role.id=a562117402dd4e099b4dcab2b24ead28, scope.project.id=3c0517c3b0534b0499d8dae17360cb89, user.id=439f856d9f16433ea2b161da27907c7a) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:54.840475 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f79721-e2d8-48a7-886b-3779225b5c15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:54.841982 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f79721-e2d8-48a7-886b-3779225b5c15 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:54.849821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 99/208] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:01:54 2022] GET /identity/v3/role_assignments?user.id=439f856d9f16433ea2b161da27907c7a&scope.project.id=3c0517c3b0534b0499d8dae17360cb89&role.id=a562117402dd4e099b4dcab2b24ead28 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:56.789982 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc445ad-c367-4e20-84f7-c5dc16a136a3 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:56.789982 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc445ad-c367-4e20-84f7-c5dc16a136a3 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:56.789982 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc445ad-c367-4e20-84f7-c5dc16a136a3 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:56.789982 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 110/209] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:56.797493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86496df9-d872-41e0-a11c-79d6d9bb20a4 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:56.798340 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86496df9-d872-41e0-a11c-79d6d9bb20a4 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:56.798833 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86496df9-d872-41e0-a11c-79d6d9bb20a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:56.818286 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-86496df9-d872-41e0-a11c-79d6d9bb20a4 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:56.819839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-86496df9-d872-41e0-a11c-79d6d9bb20a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:56.847174 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:56.894417 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 100/210] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:01:56.917778 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc445ad-c367-4e20-84f7-c5dc16a136a3 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:57.031019 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc445ad-c367-4e20-84f7-c5dc16a136a3 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:57.067978 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74c3aa-5a4e-4a10-981f-b23393f296cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:57.068741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74c3aa-5a4e-4a10-981f-b23393f296cb None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:57.069321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74c3aa-5a4e-4a10-981f-b23393f296cb None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:57.069593 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74c3aa-5a4e-4a10-981f-b23393f296cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:57.071773 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce06c3-e9f7-4673-9c25-5e69b5d3f0bc None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:57.072308 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce06c3-e9f7-4673-9c25-5e69b5d3f0bc None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:57.072814 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce06c3-e9f7-4673-9c25-5e69b5d3f0bc None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:57.075127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 101/211] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:57.081641 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b439e-633e-44c1-bb52-a0f1faff1a54 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:57.082256 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b439e-633e-44c1-bb52-a0f1faff1a54 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:57.082781 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b439e-633e-44c1-bb52-a0f1faff1a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:57.083553 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74c3aa-5a4e-4a10-981f-b23393f296cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:01:57.093474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-6c74c3aa-5a4e-4a10-981f-b23393f296cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:01:57.093474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:01:57.093474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:01:57.093474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:01:57.093474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:01:57.093474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:01:57.093474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:01:57.093474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:01:57.093474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:01:57.093474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:01:57.093474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:01:57.093474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:01:57.093474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:01:57.093474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:01:57.093474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:01:57.093474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:01:57.094437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:01:57.094437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:01:57.094437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:01:57.094437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:01:57.094437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:01:57.094437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:01:57.094437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:01:57.094437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:01:57.094437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:01:57.094437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:01:57.094437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:01:57.094437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:01:57.094437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:01:57.094437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:01:57.094437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:01:57.094437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:01:57.095223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:01:57.095223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:01:57.095223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:01:57.095223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:01:57.095223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:01:57.095223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:01:57.095223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:01:57.095223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:01:57.095223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:01:57.095223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:01:57.095223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:01:57.095223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:01:57.095223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 111/212] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:01:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:01:57.101913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74c3aa-5a4e-4a10-981f-b23393f296cb None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:57.106794 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-7b7b439e-633e-44c1-bb52-a0f1faff1a54 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:57.108357 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7b7b439e-633e-44c1-bb52-a0f1faff1a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:57.188972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:57.211320 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 102/213] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 19:01:57.212637 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51ea11-e3df-4ace-922b-980cf01c1dfc None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:57.212931 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51ea11-e3df-4ace-922b-980cf01c1dfc None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:57.213206 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51ea11-e3df-4ace-922b-980cf01c1dfc None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:57.214742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 103/214] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:57.220441 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24731dfc-b0e6-4498-83bf-fa020e0b20d7 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:57.220732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24731dfc-b0e6-4498-83bf-fa020e0b20d7 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:57.221011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24731dfc-b0e6-4498-83bf-fa020e0b20d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:57.239494 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-24731dfc-b0e6-4498-83bf-fa020e0b20d7 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:57.240716 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-24731dfc-b0e6-4498-83bf-fa020e0b20d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:57.270474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74c3aa-5a4e-4a10-981f-b23393f296cb None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:57.308990 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fbf29-4479-405f-93b1-49a7a337b0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:57.309824 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fbf29-4479-405f-93b1-49a7a337b0fd None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:57.310172 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fbf29-4479-405f-93b1-49a7a337b0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:57.310531 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fbf29-4479-405f-93b1-49a7a337b0fd None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:57.311481 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fbf29-4479-405f-93b1-49a7a337b0fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:57.311985 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fbf29-4479-405f-93b1-49a7a337b0fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:57.313637 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fbf29-4479-405f-93b1-49a7a337b0fd None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:57.317524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 104/215] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 19:01:57.318352 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24731dfc-b0e6-4498-83bf-fa020e0b20d7 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:57.323317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 112/216] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:01:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:57.324670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2be253-accc-493e-84e2-e122d120e274 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:57.324953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2be253-accc-493e-84e2-e122d120e274 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:57.325228 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2be253-accc-493e-84e2-e122d120e274 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:57.326593 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 113/217] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:57.332196 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa194d62-009c-42c1-ac1a-83b7b14a851d None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:57.332578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa194d62-009c-42c1-ac1a-83b7b14a851d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:57.332754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa194d62-009c-42c1-ac1a-83b7b14a851d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:57.351340 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-fa194d62-009c-42c1-ac1a-83b7b14a851d None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:57.352615 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-fa194d62-009c-42c1-ac1a-83b7b14a851d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:57.366809 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:57.445285 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 114/218] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 19:01:57.445285 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa194d62-009c-42c1-ac1a-83b7b14a851d None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:57.467185 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24731dfc-b0e6-4498-83bf-fa020e0b20d7 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:57.505341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bebc3-c318-42fb-a50e-c9b8ba24951a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:57.506283 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bebc3-c318-42fb-a50e-c9b8ba24951a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:57.506566 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bebc3-c318-42fb-a50e-c9b8ba24951a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:57.506843 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bebc3-c318-42fb-a50e-c9b8ba24951a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:57.508181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9bebc3-c318-42fb-a50e-c9b8ba24951a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:57.508420 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:57.509689 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9bebc3-c318-42fb-a50e-c9b8ba24951a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:57.511462 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 105/219] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:01:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:57.512328 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bebc3-c318-42fb-a50e-c9b8ba24951a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:57.585206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa194d62-009c-42c1-ac1a-83b7b14a851d None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:57.615386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:57.626629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3bcad-5ad8-4b50-a34a-be49e414ceb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:57.627607 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3bcad-5ad8-4b50-a34a-be49e414ceb3 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:57.627887 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3bcad-5ad8-4b50-a34a-be49e414ceb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:57.628193 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3bcad-5ad8-4b50-a34a-be49e414ceb3 None admin] PATH_INFO: `/v3/users/4abdea0cc0504daeb081321347dbeed7` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:57.629198 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bebc3-c318-42fb-a50e-c9b8ba24951a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:57.629530 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3bcad-5ad8-4b50-a34a-be49e414ceb3 None admin] RBAC: Authorizing `identity:get_user(user_id=4abdea0cc0504daeb081321347dbeed7)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:57.631127 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3bcad-5ad8-4b50-a34a-be49e414ceb3 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:57.632897 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 115/220] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:01:57 2022] GET /identity/v3/users/4abdea0cc0504daeb081321347dbeed7 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:57.633717 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3bcad-5ad8-4b50-a34a-be49e414ceb3 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:57.668894 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177be3ef-1573-4fe9-aa50-ffcf6b03641a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:57.669725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177be3ef-1573-4fe9-aa50-ffcf6b03641a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:57.670001 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177be3ef-1573-4fe9-aa50-ffcf6b03641a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:57.670297 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177be3ef-1573-4fe9-aa50-ffcf6b03641a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:57.682960 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177be3ef-1573-4fe9-aa50-ffcf6b03641a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:01:57.691043 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-177be3ef-1573-4fe9-aa50-ffcf6b03641a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:01:57.691043 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:01:57.691043 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:01:57.691043 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:01:57.691043 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:01:57.691043 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:01:57.691043 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:01:57.691043 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:01:57.691043 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:01:57.691043 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:01:57.691043 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:01:57.691043 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:01:57.691043 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:01:57.691043 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:01:57.691043 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:01:57.691043 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:01:57.692245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:01:57.692245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:01:57.692245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:01:57.692245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:01:57.692245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:01:57.692245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:01:57.692245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:01:57.692245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:01:57.692245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:01:57.692245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:01:57.692245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:01:57.692245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:01:57.692245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:01:57.692245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:01:57.692245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:01:57.692245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:01:57.693117 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:01:57.693117 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:01:57.693117 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:01:57.693117 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:01:57.693117 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:01:57.693117 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:01:57.693117 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:01:57.693117 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:01:57.693117 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:01:57.693117 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:01:57.693117 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:01:57.693117 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:01:57.693117 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 106/221] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:01:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:01:57.693953 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177be3ef-1573-4fe9-aa50-ffcf6b03641a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:57.754146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3bcad-5ad8-4b50-a34a-be49e414ceb3 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:57.779705 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:57.807804 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177be3ef-1573-4fe9-aa50-ffcf6b03641a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:57.811514 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01958002-882c-4417-a71f-a819bf13c33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:57.813201 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01958002-882c-4417-a71f-a819bf13c33c None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:57.813721 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01958002-882c-4417-a71f-a819bf13c33c None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:57.814270 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01958002-882c-4417-a71f-a819bf13c33c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:57.826956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01958002-882c-4417-a71f-a819bf13c33c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:01:57.836378 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-01958002-882c-4417-a71f-a819bf13c33c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 19:01:57.836378 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:01:57.836378 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:01:57.836378 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:01:57.836378 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:01:57.836378 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:01:57.836378 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:01:57.836378 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:01:57.836378 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:01:57.836378 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:01:57.836378 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:01:57.836378 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:01:57.836378 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:01:57.836378 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:01:57.836378 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:01:57.836378 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:01:57.837494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:01:57.837494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:01:57.837494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:01:57.837494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:01:57.837494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:01:57.837494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:01:57.837494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:01:57.837494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:01:57.837494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:01:57.837494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:01:57.837494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:01:57.837494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:01:57.837494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:01:57.837494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:01:57.837494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:01:57.837494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:01:57.838432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:01:57.838432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:01:57.838432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:01:57.838432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:01:57.838432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:01:57.838432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:01:57.838432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:01:57.838432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:01:57.838432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:01:57.838432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:01:57.838432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 19:01:57.838432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:01:57.838432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 116/222] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jun 2 19:01:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:01:57.838432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01958002-882c-4417-a71f-a819bf13c33c None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:57.852479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e0bc4-854b-4d51-b45c-df30cfe28354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:57.854003 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e0bc4-854b-4d51-b45c-df30cfe28354 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:57.854535 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e0bc4-854b-4d51-b45c-df30cfe28354 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:57.854824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e0bc4-854b-4d51-b45c-df30cfe28354 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:57.855568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e0bc4-854b-4d51-b45c-df30cfe28354 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:57.857152 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e0bc4-854b-4d51-b45c-df30cfe28354 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:57.951444 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01958002-882c-4417-a71f-a819bf13c33c None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:57.961267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 107/223] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jun 2 19:01:57 2022] POST /identity/v3/users => generated 297 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:57.967083 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e0bc4-854b-4d51-b45c-df30cfe28354 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:57.967462 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:58.008723 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc78007-992c-46f9-bcac-dbd7c374a804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:58.009799 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc78007-992c-46f9-bcac-dbd7c374a804 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:58.010124 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc78007-992c-46f9-bcac-dbd7c374a804 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:58.010438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc78007-992c-46f9-bcac-dbd7c374a804 None admin] PATH_INFO: `/v3/projects/8de22bd0413a4a049d4de3e1b38ac903` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:58.011868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc78007-992c-46f9-bcac-dbd7c374a804 None admin] RBAC: Authorizing `identity:get_project(project_id=8de22bd0413a4a049d4de3e1b38ac903)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:58.013477 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc78007-992c-46f9-bcac-dbd7c374a804 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:58.015584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 117/224] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:01:57 2022] GET /identity/v3/projects/8de22bd0413a4a049d4de3e1b38ac903 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:58.017041 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc78007-992c-46f9-bcac-dbd7c374a804 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:58.079871 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:58.125784 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e0bc4-854b-4d51-b45c-df30cfe28354 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:58.165406 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc78007-992c-46f9-bcac-dbd7c374a804 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:58.167793 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb023d4-b287-4c1d-bf32-c4c0bad3ec33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:58.168516 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb023d4-b287-4c1d-bf32-c4c0bad3ec33 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:58.168799 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb023d4-b287-4c1d-bf32-c4c0bad3ec33 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:58.169072 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb023d4-b287-4c1d-bf32-c4c0bad3ec33 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:58.169852 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb023d4-b287-4c1d-bf32-c4c0bad3ec33 None admin] RBAC: Adding query filter params (name=member) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:58.170155 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb023d4-b287-4c1d-bf32-c4c0bad3ec33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:58.171614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb023d4-b287-4c1d-bf32-c4c0bad3ec33 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:58.182112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 108/225] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:01:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:58.182964 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb023d4-b287-4c1d-bf32-c4c0bad3ec33 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:58.212832 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61831512-6c3c-43b6-a0d3-3fd7a5f730f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:58.213626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61831512-6c3c-43b6-a0d3-3fd7a5f730f9 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:58.213903 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61831512-6c3c-43b6-a0d3-3fd7a5f730f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:58.214186 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61831512-6c3c-43b6-a0d3-3fd7a5f730f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:58.214963 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61831512-6c3c-43b6-a0d3-3fd7a5f730f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:58.215295 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61831512-6c3c-43b6-a0d3-3fd7a5f730f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:58.216782 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61831512-6c3c-43b6-a0d3-3fd7a5f730f9 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:58.231888 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 118/226] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:01:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:58.231888 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61831512-6c3c-43b6-a0d3-3fd7a5f730f9 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:58.273923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:58.327008 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb023d4-b287-4c1d-bf32-c4c0bad3ec33 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:58.382161 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c92e35-f2e0-4322-b5d5-fb8e7eac2514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:58.382352 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c92e35-f2e0-4322-b5d5-fb8e7eac2514 None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:58.382622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c92e35-f2e0-4322-b5d5-fb8e7eac2514 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:58.382875 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c92e35-f2e0-4322-b5d5-fb8e7eac2514 None admin] PATH_INFO: `/v3/projects/8de22bd0413a4a049d4de3e1b38ac903/users/4abdea0cc0504daeb081321347dbeed7/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:58.386602 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c92e35-f2e0-4322-b5d5-fb8e7eac2514 None admin] RBAC: Authorizing `identity:create_grant(project_id=8de22bd0413a4a049d4de3e1b38ac903, user_id=4abdea0cc0504daeb081321347dbeed7, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:58.388514 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c92e35-f2e0-4322-b5d5-fb8e7eac2514 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:58.392396 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61831512-6c3c-43b6-a0d3-3fd7a5f730f9 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:58.400527 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:58.457634 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22050b0d-cba6-40b9-8bbc-2e27985027ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:58.458675 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22050b0d-cba6-40b9-8bbc-2e27985027ee None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:58.458830 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22050b0d-cba6-40b9-8bbc-2e27985027ee None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:58.459158 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22050b0d-cba6-40b9-8bbc-2e27985027ee None admin] PATH_INFO: `/v3/users/eacd028742b048af9668e790667a9db6` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:58.476714 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22050b0d-cba6-40b9-8bbc-2e27985027ee None admin] RBAC: Authorizing `identity:get_user(user_id=eacd028742b048af9668e790667a9db6)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:58.478728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22050b0d-cba6-40b9-8bbc-2e27985027ee None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:58.481188 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 119/227] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:01:58 2022] GET /identity/v3/users/eacd028742b048af9668e790667a9db6 => generated 297 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:58.482486 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22050b0d-cba6-40b9-8bbc-2e27985027ee None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:58.487151 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 109/228] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jun 2 19:01:58 2022] PUT /identity/v3/projects/8de22bd0413a4a049d4de3e1b38ac903/users/4abdea0cc0504daeb081321347dbeed7/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:58.488388 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c92e35-f2e0-4322-b5d5-fb8e7eac2514 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:58.630959 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22050b0d-cba6-40b9-8bbc-2e27985027ee None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:58.641836 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c92e35-f2e0-4322-b5d5-fb8e7eac2514 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:58.674835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817af49-d34f-4202-aa0a-84cbfd14cf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:58.675802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817af49-d34f-4202-aa0a-84cbfd14cf06 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:58.676241 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817af49-d34f-4202-aa0a-84cbfd14cf06 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:58.676516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817af49-d34f-4202-aa0a-84cbfd14cf06 None admin] PATH_INFO: `/v3/users/4abdea0cc0504daeb081321347dbeed7` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:58.678215 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817af49-d34f-4202-aa0a-84cbfd14cf06 None admin] RBAC: Authorizing `identity:get_user(user_id=4abdea0cc0504daeb081321347dbeed7)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:58.679948 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:58.681287 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817af49-d34f-4202-aa0a-84cbfd14cf06 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:58.683078 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 120/229] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:01:58 2022] GET /identity/v3/users/4abdea0cc0504daeb081321347dbeed7 => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:58.688880 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817af49-d34f-4202-aa0a-84cbfd14cf06 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:58.690370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d28a9c-f696-4665-925e-f858dac72093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:58.691137 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d28a9c-f696-4665-925e-f858dac72093 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:58.691491 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d28a9c-f696-4665-925e-f858dac72093 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:58.691844 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d28a9c-f696-4665-925e-f858dac72093 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:58.729602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:58.786007 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d28a9c-f696-4665-925e-f858dac72093 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:58.787691 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d28a9c-f696-4665-925e-f858dac72093 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:58.834099 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817af49-d34f-4202-aa0a-84cbfd14cf06 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:58.897119 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37419c8d-6e71-4e47-8565-87e2078a7460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:58.898208 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37419c8d-6e71-4e47-8565-87e2078a7460 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:58.898493 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37419c8d-6e71-4e47-8565-87e2078a7460 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:58.898772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37419c8d-6e71-4e47-8565-87e2078a7460 None admin] PATH_INFO: `/v3/projects/8de22bd0413a4a049d4de3e1b38ac903` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:58.905277 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37419c8d-6e71-4e47-8565-87e2078a7460 None admin] RBAC: Authorizing `identity:get_project(project_id=8de22bd0413a4a049d4de3e1b38ac903)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:58.906742 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37419c8d-6e71-4e47-8565-87e2078a7460 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:58.913256 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 121/230] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:01:58 2022] GET /identity/v3/projects/8de22bd0413a4a049d4de3e1b38ac903 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:58.919073 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37419c8d-6e71-4e47-8565-87e2078a7460 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:58.963494 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 110/231] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:01:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:01:58.969196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d28a9c-f696-4665-925e-f858dac72093 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:59.038658 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:59.042979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37419c8d-6e71-4e47-8565-87e2078a7460 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:59.050170 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:59.088620 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cc330-18be-490f-a849-b7d973f8feb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:59.089532 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cc330-18be-490f-a849-b7d973f8feb4 None admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:59.089817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cc330-18be-490f-a849-b7d973f8feb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:59.090093 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cc330-18be-490f-a849-b7d973f8feb4 None admin] PATH_INFO: `/v3/projects/8de22bd0413a4a049d4de3e1b38ac903/users/4abdea0cc0504daeb081321347dbeed7/roles/27769697518a42139af80d8b8410ca07` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:59.096739 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cc330-18be-490f-a849-b7d973f8feb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=8de22bd0413a4a049d4de3e1b38ac903, user_id=4abdea0cc0504daeb081321347dbeed7, role_id=27769697518a42139af80d8b8410ca07)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:59.098222 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cc330-18be-490f-a849-b7d973f8feb4 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:59.166268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d28a9c-f696-4665-925e-f858dac72093 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:59.206863 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 122/232] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jun 2 19:01:58 2022] PUT /identity/v3/projects/8de22bd0413a4a049d4de3e1b38ac903/users/4abdea0cc0504daeb081321347dbeed7/roles/27769697518a42139af80d8b8410ca07 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:01:59.210553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005404d-2cfa-4179-a7aa-ac09fe05a9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:59.214710 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005404d-2cfa-4179-a7aa-ac09fe05a9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:59.214710 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005404d-2cfa-4179-a7aa-ac09fe05a9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:59.214710 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005404d-2cfa-4179-a7aa-ac09fe05a9d5 None admin] PATH_INFO: `/v3/projects/8de22bd0413a4a049d4de3e1b38ac903` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:59.214710 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005404d-2cfa-4179-a7aa-ac09fe05a9d5 None admin] RBAC: Authorizing `identity:get_project(project_id=8de22bd0413a4a049d4de3e1b38ac903)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:59.215330 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005404d-2cfa-4179-a7aa-ac09fe05a9d5 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:59.216934 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 111/233] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:01:58 2022] GET /identity/v3/projects/8de22bd0413a4a049d4de3e1b38ac903 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:59.223446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cc330-18be-490f-a849-b7d973f8feb4 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:59.367916 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cc330-18be-490f-a849-b7d973f8feb4 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:59.426946 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd2c9e-861f-4189-910b-fe52ae665ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:59.428052 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd2c9e-861f-4189-910b-fe52ae665ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:59.428433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd2c9e-861f-4189-910b-fe52ae665ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:59.428810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd2c9e-861f-4189-910b-fe52ae665ac6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:59.429780 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd2c9e-861f-4189-910b-fe52ae665ac6 None admin] RBAC: Adding query filter params (role.id=75723f2a7ead4f5cb2885e7b63680b08, scope.project.id=8de22bd0413a4a049d4de3e1b38ac903, user.id=eacd028742b048af9668e790667a9db6) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:59.430197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd2c9e-861f-4189-910b-fe52ae665ac6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:59.431805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd2c9e-861f-4189-910b-fe52ae665ac6 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:59.443308 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 123/234] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:01:59 2022] GET /identity/v3/role_assignments?user.id=eacd028742b048af9668e790667a9db6&scope.project.id=8de22bd0413a4a049d4de3e1b38ac903&role.id=75723f2a7ead4f5cb2885e7b63680b08 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:02:00.987318 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f35eac-ab80-4fb0-8a4d-4eb83d18724f None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:00.987939 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f35eac-ab80-4fb0-8a4d-4eb83d18724f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:00.987939 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f35eac-ab80-4fb0-8a4d-4eb83d18724f None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:00.989621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 112/235] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:00.997839 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d515c9f-5301-419c-a523-2054b05aded0 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:00.998375 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d515c9f-5301-419c-a523-2054b05aded0 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:00.998637 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d515c9f-5301-419c-a523-2054b05aded0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:01.018090 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-2d515c9f-5301-419c-a523-2054b05aded0 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:01.019314 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-2d515c9f-5301-419c-a523-2054b05aded0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:01.050123 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:01.065334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4525d-537a-40b0-b40d-3f34d607b90e None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:01.065826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4525d-537a-40b0-b40d-3f34d607b90e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:01.065917 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4525d-537a-40b0-b40d-3f34d607b90e None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:01.067277 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 113/236] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:02:01.082854 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8931d-f78f-4577-b7a2-5eb434583315 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:01.083164 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8931d-f78f-4577-b7a2-5eb434583315 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:01.083412 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8931d-f78f-4577-b7a2-5eb434583315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:01.111513 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-c9d8931d-f78f-4577-b7a2-5eb434583315 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:01.113336 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c9d8931d-f78f-4577-b7a2-5eb434583315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:01.157795 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 124/237] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:01.206501 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 114/238] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 02 19:02:01.218821 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d515c9f-5301-419c-a523-2054b05aded0 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:01.262326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8931d-f78f-4577-b7a2-5eb434583315 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:01.303686 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:01.364578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d515c9f-5301-419c-a523-2054b05aded0 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:01.387959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8931d-f78f-4577-b7a2-5eb434583315 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:01.403750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fb5bf-2d8c-4fa2-a288-bcc4050ade9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:01.404678 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fb5bf-2d8c-4fa2-a288-bcc4050ade9a None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:01.405029 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fb5bf-2d8c-4fa2-a288-bcc4050ade9a None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:01.405377 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fb5bf-2d8c-4fa2-a288-bcc4050ade9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:01.406643 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6fb5bf-2d8c-4fa2-a288-bcc4050ade9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:01.408201 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6fb5bf-2d8c-4fa2-a288-bcc4050ade9a None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:01.410085 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 125/239] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:01.414572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaee7d8-8542-443a-9e87-71cb4616bdff None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:01.414572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaee7d8-8542-443a-9e87-71cb4616bdff None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:01.414572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaee7d8-8542-443a-9e87-71cb4616bdff None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:01.415001 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 126/240] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:01.416530 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaee7d8-8542-443a-9e87-71cb4616bdff None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:01.456218 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:01.473824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80b5f7-8753-4d68-aeb1-b61c137a9d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:01.478082 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80b5f7-8753-4d68-aeb1-b61c137a9d37 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:01.478082 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80b5f7-8753-4d68-aeb1-b61c137a9d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:01.478082 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80b5f7-8753-4d68-aeb1-b61c137a9d37 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:01.488872 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80b5f7-8753-4d68-aeb1-b61c137a9d37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:01.497553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-4c80b5f7-8753-4d68-aeb1-b61c137a9d37 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 19:02:01.497553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:01.497553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:01.497553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:01.497553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:01.497553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:01.497553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:01.497553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:01.497553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:01.497553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:01.497553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:01.497553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:01.497553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:01.497553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:01.497553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:01.497553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:01.498484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:01.498484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:01.498484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:01.498484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:01.498484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:01.498484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:01.498484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:01.498484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:01.498484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:01.498484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:01.498484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:01.498484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:01.498484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:01.498484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:01.498484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:01.498484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:01.499335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:01.499335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:01.499335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:01.499335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:01.499335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:01.499335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:01.499335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:01.499335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:01.499335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:01.499335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:01.499335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 19:02:01.499335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:01.507824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 115/241] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:01.509721 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622c3e7-a2b5-48ad-a86c-dea80bea6472 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:01.510329 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622c3e7-a2b5-48ad-a86c-dea80bea6472 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:01.510821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622c3e7-a2b5-48ad-a86c-dea80bea6472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:01.529107 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-1622c3e7-a2b5-48ad-a86c-dea80bea6472 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:01.530634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1622c3e7-a2b5-48ad-a86c-dea80bea6472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:01.542833 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaee7d8-8542-443a-9e87-71cb4616bdff None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:01.583341 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc592276-9725-43ce-8b12-0c481dbbc8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:01.584778 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc592276-9725-43ce-8b12-0c481dbbc8ce None admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:01.585237 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc592276-9725-43ce-8b12-0c481dbbc8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:01.585530 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc592276-9725-43ce-8b12-0c481dbbc8ce None admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:01.586369 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc592276-9725-43ce-8b12-0c481dbbc8ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:01.587983 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc592276-9725-43ce-8b12-0c481dbbc8ce None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:01.610336 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 116/242] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:01.612081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622c3e7-a2b5-48ad-a86c-dea80bea6472 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:01.628465 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:01.677066 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 127/243] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jun 2 19:02:01 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:01.678422 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc592276-9725-43ce-8b12-0c481dbbc8ce None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:01.736505 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622c3e7-a2b5-48ad-a86c-dea80bea6472 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:01.784293 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e2105-acfc-4ca7-b5e5-2f5adc340aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:01.784985 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e2105-acfc-4ca7-b5e5-2f5adc340aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:01.785268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e2105-acfc-4ca7-b5e5-2f5adc340aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:01.785542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e2105-acfc-4ca7-b5e5-2f5adc340aa3 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:01.787420 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e2105-acfc-4ca7-b5e5-2f5adc340aa3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:01.787732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e2105-acfc-4ca7-b5e5-2f5adc340aa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:01.789309 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e2105-acfc-4ca7-b5e5-2f5adc340aa3 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:01.800641 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 117/244] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:02:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:01.809333 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e2105-acfc-4ca7-b5e5-2f5adc340aa3 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:01.820479 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:01.865510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc592276-9725-43ce-8b12-0c481dbbc8ce None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:01.916023 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d061e-0e2c-4205-ab99-98b35c7e6a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:01.916890 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d061e-0e2c-4205-ab99-98b35c7e6a28 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:01.917179 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d061e-0e2c-4205-ab99-98b35c7e6a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:01.917459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d061e-0e2c-4205-ab99-98b35c7e6a28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:01.927370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:01.942350 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d061e-0e2c-4205-ab99-98b35c7e6a28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:01.951214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-a40d061e-0e2c-4205-ab99-98b35c7e6a28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:02:01.951214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:01.951214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:01.951214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:01.951214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:01.951214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:01.951214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:01.951214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:01.951214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:01.951214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:01.951214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:01.951214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:01.951214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:01.951214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:01.951214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:01.951214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:01.952272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:01.952272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:01.952272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:01.952272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:01.952272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:01.952272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:01.952272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:01.952272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:01.952272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:01.952272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:01.952272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:01.952272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:01.952272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:01.952272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:01.952272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:01.952272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:01.953052 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:01.953052 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:01.953052 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:01.953052 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:01.953052 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:01.953052 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:01.953052 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:01.953052 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:01.953052 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:01.953052 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:01.953052 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:02:01.953052 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:01.953052 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 128/245] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:02:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:01.961094 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d061e-0e2c-4205-ab99-98b35c7e6a28 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:01.965796 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e2105-acfc-4ca7-b5e5-2f5adc340aa3 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:02.002756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05d88a-14af-4dae-bce9-5f1400d37217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:02.003689 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05d88a-14af-4dae-bce9-5f1400d37217 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:02.004049 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05d88a-14af-4dae-bce9-5f1400d37217 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:02.004391 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05d88a-14af-4dae-bce9-5f1400d37217 None admin] PATH_INFO: `/v3/users/b0c585156935498a8667deaa265751a5` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:02.020179 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05d88a-14af-4dae-bce9-5f1400d37217 None admin] RBAC: Authorizing `identity:get_user(user_id=b0c585156935498a8667deaa265751a5)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:02.021716 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05d88a-14af-4dae-bce9-5f1400d37217 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:02.023760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 118/246] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:02:01 2022] GET /identity/v3/users/b0c585156935498a8667deaa265751a5 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:02.029610 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05d88a-14af-4dae-bce9-5f1400d37217 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:02.138903 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d061e-0e2c-4205-ab99-98b35c7e6a28 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:02.143930 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05d88a-14af-4dae-bce9-5f1400d37217 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:02.179185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44666481-7e7f-49f2-8d57-9e53a7309615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:02.179868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44666481-7e7f-49f2-8d57-9e53a7309615 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:02.180209 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44666481-7e7f-49f2-8d57-9e53a7309615 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:02.180496 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44666481-7e7f-49f2-8d57-9e53a7309615 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:02.181265 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44666481-7e7f-49f2-8d57-9e53a7309615 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:02.181576 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44666481-7e7f-49f2-8d57-9e53a7309615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:02.182107 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658fe3e-a64b-46a3-8772-56a50eee4bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:02.182938 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658fe3e-a64b-46a3-8772-56a50eee4bcf None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:02.183051 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44666481-7e7f-49f2-8d57-9e53a7309615 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:02.183474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658fe3e-a64b-46a3-8772-56a50eee4bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:02.183892 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658fe3e-a64b-46a3-8772-56a50eee4bcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:02.186499 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:02.187343 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:02.196790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 129/247] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:02.203001 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fb714-50a9-498e-85a6-28a27fca7421 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:02.203366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fb714-50a9-498e-85a6-28a27fca7421 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:02.203720 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fb714-50a9-498e-85a6-28a27fca7421 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:02.206086 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 130/248] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:02.206840 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fb714-50a9-498e-85a6-28a27fca7421 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:02.274986 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658fe3e-a64b-46a3-8772-56a50eee4bcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:02.276856 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658fe3e-a64b-46a3-8772-56a50eee4bcf None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:02.333946 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fb714-50a9-498e-85a6-28a27fca7421 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:02.374330 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3813a4-28b0-4bd6-bcd2-f502f4a2a272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:02.375592 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3813a4-28b0-4bd6-bcd2-f502f4a2a272 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:02.375710 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3813a4-28b0-4bd6-bcd2-f502f4a2a272 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:02.375914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3813a4-28b0-4bd6-bcd2-f502f4a2a272 None admin] PATH_INFO: `/v3/users/4abdea0cc0504daeb081321347dbeed7` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:02.377852 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3813a4-28b0-4bd6-bcd2-f502f4a2a272 None admin] RBAC: Authorizing `identity:get_user(user_id=4abdea0cc0504daeb081321347dbeed7)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:02.379419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3813a4-28b0-4bd6-bcd2-f502f4a2a272 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:02.381205 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 131/249] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:02:02 2022] GET /identity/v3/users/4abdea0cc0504daeb081321347dbeed7 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:02.382477 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17269f-5e90-48bd-b730-07c62f9b34eb None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:02.382770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17269f-5e90-48bd-b730-07c62f9b34eb None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:02.383050 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17269f-5e90-48bd-b730-07c62f9b34eb None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:02.384650 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 132/250] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:02.391065 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267fd01-ccc3-4772-99f3-fd312cc635d8 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:02.391065 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267fd01-ccc3-4772-99f3-fd312cc635d8 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:02.391065 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267fd01-ccc3-4772-99f3-fd312cc635d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:02.402599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 119/251] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:02:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 19:02:02.403698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658fe3e-a64b-46a3-8772-56a50eee4bcf None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:02.404371 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-7267fd01-ccc3-4772-99f3-fd312cc635d8 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:02.405727 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-7267fd01-ccc3-4772-99f3-fd312cc635d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:02.441068 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:02.473962 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:02.483274 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 133/252] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:02.484741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b6f07-3ec8-45b7-9f9d-e7e5f07d45c7 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:02.485039 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b6f07-3ec8-45b7-9f9d-e7e5f07d45c7 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:02.485373 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b6f07-3ec8-45b7-9f9d-e7e5f07d45c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:02.504446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-7e1b6f07-3ec8-45b7-9f9d-e7e5f07d45c7 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:02.505709 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-7e1b6f07-3ec8-45b7-9f9d-e7e5f07d45c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:02.517169 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658fe3e-a64b-46a3-8772-56a50eee4bcf None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:02.553915 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d2d1e-b2be-49c0-b374-cef5301b4ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:02.554928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d2d1e-b2be-49c0-b374-cef5301b4ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:02.555410 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d2d1e-b2be-49c0-b374-cef5301b4ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:02.555875 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d2d1e-b2be-49c0-b374-cef5301b4ae1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:02.588448 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 134/253] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:02.596395 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b6f07-3ec8-45b7-9f9d-e7e5f07d45c7 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:02.656421 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d2d1e-b2be-49c0-b374-cef5301b4ae1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:02.658241 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d2d1e-b2be-49c0-b374-cef5301b4ae1 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:02.694727 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:02.726374 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b6f07-3ec8-45b7-9f9d-e7e5f07d45c7 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:02.765847 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:02.775511 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 120/254] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:02:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:02.776443 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d2d1e-b2be-49c0-b374-cef5301b4ae1 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:02.778824 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d69de-6ba7-4457-a9b2-59c5409e38ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:02.778824 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d69de-6ba7-4457-a9b2-59c5409e38ed None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:02.778824 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d69de-6ba7-4457-a9b2-59c5409e38ed None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:02.778824 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d69de-6ba7-4457-a9b2-59c5409e38ed None admin] PATH_INFO: `/v3/projects/8de22bd0413a4a049d4de3e1b38ac903` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:02.779939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d69de-6ba7-4457-a9b2-59c5409e38ed None admin] RBAC: Authorizing `identity:get_project(project_id=8de22bd0413a4a049d4de3e1b38ac903)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:02.781759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d69de-6ba7-4457-a9b2-59c5409e38ed None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:02.784381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 135/255] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:02:02 2022] GET /identity/v3/projects/8de22bd0413a4a049d4de3e1b38ac903 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:02.785421 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d69de-6ba7-4457-a9b2-59c5409e38ed None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:02.902668 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d2d1e-b2be-49c0-b374-cef5301b4ae1 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:02.925273 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d69de-6ba7-4457-a9b2-59c5409e38ed None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:02.948113 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abe304-c07c-401f-b414-014dc9bf4474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:02.949494 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abe304-c07c-401f-b414-014dc9bf4474 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:02.949787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abe304-c07c-401f-b414-014dc9bf4474 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:02.950071 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abe304-c07c-401f-b414-014dc9bf4474 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:02.952692 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:02.965614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abe304-c07c-401f-b414-014dc9bf4474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:02.966181 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8fe3a-5ee4-4087-81ba-1f818f2b158e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:02.968160 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8fe3a-5ee4-4087-81ba-1f818f2b158e None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:02.968160 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8fe3a-5ee4-4087-81ba-1f818f2b158e None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:02.968160 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8fe3a-5ee4-4087-81ba-1f818f2b158e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:02.975959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-64abe304-c07c-401f-b414-014dc9bf4474 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 19:02:02.975959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:02.975959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:02.975959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:02.975959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:02.975959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:02.975959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:02.975959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:02.975959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:02.975959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:02.975959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:02.975959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:02.975959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:02.975959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:02.975959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:02.975959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:02.976932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:02.976932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:02.976932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:02.976932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:02.976932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:02.976932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:02.976932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:02.976932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:02.976932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:02.976932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:02.976932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:02.976932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:02.976932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:02.976932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:02.976932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:02.976932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:02.977714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:02.977714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:02.977714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:02.977714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:02.977714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:02.977714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:02.977714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:02.977714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:02.977714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:02.977714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:02.977714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 19:02:02.977714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:02.977714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 121/256] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jun 2 19:02:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:02.980653 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abe304-c07c-401f-b414-014dc9bf4474 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:02.989010 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8fe3a-5ee4-4087-81ba-1f818f2b158e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:02.999084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-03a8fe3a-5ee4-4087-81ba-1f818f2b158e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:02:02.999084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:02.999084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:02.999084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:02.999084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:02.999084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:02.999084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:02.999084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:02.999084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:02.999084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:02.999084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:02.999084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:02.999084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:02.999084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:02.999084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:02.999084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:02.999979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:02.999979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:02.999979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:02.999979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:02.999979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:02.999979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:02.999979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:02.999979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:02.999979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:02.999979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:02.999979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:02.999979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:02.999979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:02.999979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:02.999979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:02.999979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:03.000814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:03.000814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:03.000814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:03.000814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:03.000814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:03.000814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:03.000814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:03.000814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:03.000814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:03.000814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:03.000814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:02:03.000814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:03.000814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 136/257] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:03.001510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8fe3a-5ee4-4087-81ba-1f818f2b158e None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:03.079247 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:03.112683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abe304-c07c-401f-b414-014dc9bf4474 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:03.127378 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8fe3a-5ee4-4087-81ba-1f818f2b158e None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:03.160013 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4941f-c097-4ff5-8ba9-00c568a33af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:03.161295 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4941f-c097-4ff5-8ba9-00c568a33af8 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:03.161657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4941f-c097-4ff5-8ba9-00c568a33af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:03.162006 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4941f-c097-4ff5-8ba9-00c568a33af8 None admin] PATH_INFO: `/v3/projects/8de22bd0413a4a049d4de3e1b38ac903` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:03.163292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4941f-c097-4ff5-8ba9-00c568a33af8 None admin] RBAC: Authorizing `identity:get_project(project_id=8de22bd0413a4a049d4de3e1b38ac903)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:03.164859 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4941f-c097-4ff5-8ba9-00c568a33af8 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:03.165908 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297997ac-7a6f-4c59-ad7a-dc2e54b0af6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:03.166733 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 122/258] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:02:02 2022] GET /identity/v3/projects/8de22bd0413a4a049d4de3e1b38ac903 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:03.167281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297997ac-7a6f-4c59-ad7a-dc2e54b0af6c None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:03.167656 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4941f-c097-4ff5-8ba9-00c568a33af8 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:03.167912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297997ac-7a6f-4c59-ad7a-dc2e54b0af6c None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:03.168393 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297997ac-7a6f-4c59-ad7a-dc2e54b0af6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:03.169454 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297997ac-7a6f-4c59-ad7a-dc2e54b0af6c None admin] RBAC: Adding query filter params (role.id=a562117402dd4e099b4dcab2b24ead28, scope.project.id=8de22bd0413a4a049d4de3e1b38ac903, user.id=b0c585156935498a8667deaa265751a5) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:03.169936 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297997ac-7a6f-4c59-ad7a-dc2e54b0af6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:03.171853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297997ac-7a6f-4c59-ad7a-dc2e54b0af6c None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:03.178170 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 137/259] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:02:03 2022] GET /identity/v3/role_assignments?user.id=b0c585156935498a8667deaa265751a5&scope.project.id=8de22bd0413a4a049d4de3e1b38ac903&role.id=a562117402dd4e099b4dcab2b24ead28 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:03.179316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297997ac-7a6f-4c59-ad7a-dc2e54b0af6c None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:03.261658 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:03.311726 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4941f-c097-4ff5-8ba9-00c568a33af8 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:03.320315 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297997ac-7a6f-4c59-ad7a-dc2e54b0af6c None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:03.348300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:03.355960 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab40e5b-e4e5-4992-9c2b-839cf47d2e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:03.357078 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab40e5b-e4e5-4992-9c2b-839cf47d2e6a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:03.357557 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab40e5b-e4e5-4992-9c2b-839cf47d2e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:03.358029 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab40e5b-e4e5-4992-9c2b-839cf47d2e6a None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:03.358997 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab40e5b-e4e5-4992-9c2b-839cf47d2e6a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:03.359524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab40e5b-e4e5-4992-9c2b-839cf47d2e6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:03.361334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab40e5b-e4e5-4992-9c2b-839cf47d2e6a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:03.377748 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30decce-07ef-46a3-b32b-6a6f369bc039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:03.378519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30decce-07ef-46a3-b32b-6a6f369bc039 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:03.378810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30decce-07ef-46a3-b32b-6a6f369bc039 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:03.379088 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30decce-07ef-46a3-b32b-6a6f369bc039 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:03.379877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30decce-07ef-46a3-b32b-6a6f369bc039 None admin] RBAC: Adding query filter params (name=member) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:03.380224 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30decce-07ef-46a3-b32b-6a6f369bc039 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:03.382934 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 123/260] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:02:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:03.384415 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30decce-07ef-46a3-b32b-6a6f369bc039 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:03.386858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab40e5b-e4e5-4992-9c2b-839cf47d2e6a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:03.404343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 138/261] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:02:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:03.407950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30decce-07ef-46a3-b32b-6a6f369bc039 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:03.536706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab40e5b-e4e5-4992-9c2b-839cf47d2e6a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:03.566260 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:03.581413 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb4d9d-ac22-4845-b9df-f125e26589ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:03.582212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb4d9d-ac22-4845-b9df-f125e26589ec None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:03.582617 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb4d9d-ac22-4845-b9df-f125e26589ec None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:03.582908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb4d9d-ac22-4845-b9df-f125e26589ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:03.583755 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb4d9d-ac22-4845-b9df-f125e26589ec None admin] RBAC: Adding query filter params (role.id=4588ca63994f4e2d9ce482d475edbabd, scope.project.id=8de22bd0413a4a049d4de3e1b38ac903, user.id=4abdea0cc0504daeb081321347dbeed7) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:03.584107 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb4d9d-ac22-4845-b9df-f125e26589ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:03.586070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb4d9d-ac22-4845-b9df-f125e26589ec None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:03.596366 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 124/262] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:02:03 2022] GET /identity/v3/role_assignments?user.id=4abdea0cc0504daeb081321347dbeed7&scope.project.id=8de22bd0413a4a049d4de3e1b38ac903&role.id=4588ca63994f4e2d9ce482d475edbabd => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:03.603224 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb4d9d-ac22-4845-b9df-f125e26589ec None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:03.605578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30decce-07ef-46a3-b32b-6a6f369bc039 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:03.708181 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a39612-9a59-44ca-a567-cababbf85ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:03.709458 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a39612-9a59-44ca-a567-cababbf85ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:03.709750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a39612-9a59-44ca-a567-cababbf85ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:03.710032 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a39612-9a59-44ca-a567-cababbf85ce0 None admin] PATH_INFO: `/v3/users/4abdea0cc0504daeb081321347dbeed7` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:03.717346 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a39612-9a59-44ca-a567-cababbf85ce0 None admin] RBAC: Authorizing `identity:get_user(user_id=4abdea0cc0504daeb081321347dbeed7)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:03.721030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a39612-9a59-44ca-a567-cababbf85ce0 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:03.721030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 139/263] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:02:03 2022] GET /identity/v3/users/4abdea0cc0504daeb081321347dbeed7 => generated 283 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:03.726810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a39612-9a59-44ca-a567-cababbf85ce0 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:03.880687 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb4d9d-ac22-4845-b9df-f125e26589ec None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:03.888375 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:03.985786 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86030f0c-b1a7-4239-a581-47db29fa349d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:03.987228 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86030f0c-b1a7-4239-a581-47db29fa349d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:03.987508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86030f0c-b1a7-4239-a581-47db29fa349d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:03.988178 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86030f0c-b1a7-4239-a581-47db29fa349d None admin] PATH_INFO: `/v3/users/eacd028742b048af9668e790667a9db6` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:03.992908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86030f0c-b1a7-4239-a581-47db29fa349d None admin] RBAC: Authorizing `identity:get_user(user_id=eacd028742b048af9668e790667a9db6)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:03.994401 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86030f0c-b1a7-4239-a581-47db29fa349d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:03.996335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 125/264] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:02:03 2022] GET /identity/v3/users/eacd028742b048af9668e790667a9db6 => generated 297 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:04.002845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86030f0c-b1a7-4239-a581-47db29fa349d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:04.038793 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a39612-9a59-44ca-a567-cababbf85ce0 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:04.107884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51b3e9-5b67-4728-90d7-143e32fec588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:04.108592 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51b3e9-5b67-4728-90d7-143e32fec588 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:04.108945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51b3e9-5b67-4728-90d7-143e32fec588 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:04.109220 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51b3e9-5b67-4728-90d7-143e32fec588 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:04.125101 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:04.207920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86030f0c-b1a7-4239-a581-47db29fa349d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:04.234072 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b51b3e9-5b67-4728-90d7-143e32fec588 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:04.235576 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b51b3e9-5b67-4728-90d7-143e32fec588 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:04.275098 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204d405-1ef6-4bce-b99c-96b266d90db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:04.276007 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204d405-1ef6-4bce-b99c-96b266d90db2 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:04.276294 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204d405-1ef6-4bce-b99c-96b266d90db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:04.276564 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204d405-1ef6-4bce-b99c-96b266d90db2 None admin] PATH_INFO: `/v3/projects/8de22bd0413a4a049d4de3e1b38ac903` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:04.278974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204d405-1ef6-4bce-b99c-96b266d90db2 None admin] RBAC: Authorizing `identity:get_project(project_id=8de22bd0413a4a049d4de3e1b38ac903)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:04.280502 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204d405-1ef6-4bce-b99c-96b266d90db2 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:04.282562 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 126/265] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:02:04 2022] GET /identity/v3/projects/8de22bd0413a4a049d4de3e1b38ac903 => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:02:04.292171 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204d405-1ef6-4bce-b99c-96b266d90db2 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:04.340457 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:04.412607 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 140/266] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:02:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:04.418445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51b3e9-5b67-4728-90d7-143e32fec588 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:04.493650 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204d405-1ef6-4bce-b99c-96b266d90db2 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:04.527123 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:04.539195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cf796-941f-4de5-a866-3f31dc309bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:04.540132 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cf796-941f-4de5-a866-3f31dc309bc3 None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:04.540415 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cf796-941f-4de5-a866-3f31dc309bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:04.540691 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cf796-941f-4de5-a866-3f31dc309bc3 None admin] PATH_INFO: `/v3/projects/8de22bd0413a4a049d4de3e1b38ac903/users/eacd028742b048af9668e790667a9db6/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:04.542989 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579cf796-941f-4de5-a866-3f31dc309bc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=8de22bd0413a4a049d4de3e1b38ac903, user_id=eacd028742b048af9668e790667a9db6, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:04.544495 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579cf796-941f-4de5-a866-3f31dc309bc3 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:04.579355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51b3e9-5b67-4728-90d7-143e32fec588 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:04.619029 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf734bb-9fba-4d89-a4c9-508cce82fa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:04.619905 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf734bb-9fba-4d89-a4c9-508cce82fa20 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:04.620236 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf734bb-9fba-4d89-a4c9-508cce82fa20 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:04.620528 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf734bb-9fba-4d89-a4c9-508cce82fa20 None admin] PATH_INFO: `/v3/projects/8de22bd0413a4a049d4de3e1b38ac903` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:04.621734 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf734bb-9fba-4d89-a4c9-508cce82fa20 None admin] RBAC: Authorizing `identity:get_project(project_id=8de22bd0413a4a049d4de3e1b38ac903)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:04.623206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf734bb-9fba-4d89-a4c9-508cce82fa20 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:04.624949 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 141/267] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:02:04 2022] GET /identity/v3/projects/8de22bd0413a4a049d4de3e1b38ac903 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:04.631849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf734bb-9fba-4d89-a4c9-508cce82fa20 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:04.639201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 127/268] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jun 2 19:02:04 2022] PUT /identity/v3/projects/8de22bd0413a4a049d4de3e1b38ac903/users/eacd028742b048af9668e790667a9db6/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:04.657016 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:04.705727 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ce62b-dce2-49ab-ab60-947265ddf1d5 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:04.706068 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ce62b-dce2-49ab-ab60-947265ddf1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:04.706245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ce62b-dce2-49ab-ab60-947265ddf1d5 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:04.707825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 128/269] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:02:04.713514 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f376f48-c5ae-45ee-b330-2d31ae69f69f None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:04.713798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f376f48-c5ae-45ee-b330-2d31ae69f69f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:04.714082 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f376f48-c5ae-45ee-b330-2d31ae69f69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:04.739007 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-7f376f48-c5ae-45ee-b330-2d31ae69f69f None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:04.740674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7f376f48-c5ae-45ee-b330-2d31ae69f69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:04.785206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf734bb-9fba-4d89-a4c9-508cce82fa20 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:04.829893 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17cb81-d3bb-4953-9903-7a53119bac52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:04.830633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17cb81-d3bb-4953-9903-7a53119bac52 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:04.830914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17cb81-d3bb-4953-9903-7a53119bac52 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:04.831188 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17cb81-d3bb-4953-9903-7a53119bac52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:04.832073 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17cb81-d3bb-4953-9903-7a53119bac52 None admin] RBAC: Adding query filter params (role.id=27769697518a42139af80d8b8410ca07, scope.project.id=8de22bd0413a4a049d4de3e1b38ac903, user.id=4abdea0cc0504daeb081321347dbeed7) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:04.832391 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17cb81-d3bb-4953-9903-7a53119bac52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:04.833972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17cb81-d3bb-4953-9903-7a53119bac52 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:04.848332 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 142/270] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:02:04 2022] GET /identity/v3/role_assignments?user.id=4abdea0cc0504daeb081321347dbeed7&scope.project.id=8de22bd0413a4a049d4de3e1b38ac903&role.id=27769697518a42139af80d8b8410ca07 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:04.849934 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d98f5-4711-498e-bd20-126b3d3a34a3 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:04.850354 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d98f5-4711-498e-bd20-126b3d3a34a3 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:04.850742 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d98f5-4711-498e-bd20-126b3d3a34a3 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:04.852571 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 129/272] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 19:02:04.852712 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 143/272] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:04.867032 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828bb51-17e3-4a02-abcd-026aa0083417 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:04.867383 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828bb51-17e3-4a02-abcd-026aa0083417 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:04.867616 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828bb51-17e3-4a02-abcd-026aa0083417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:04.892551 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-5828bb51-17e3-4a02-abcd-026aa0083417 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:04.894358 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5828bb51-17e3-4a02-abcd-026aa0083417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:04.897118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d98f5-4711-498e-bd20-126b3d3a34a3 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:05.009132 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 130/273] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:05.035388 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828bb51-17e3-4a02-abcd-026aa0083417 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:05.078033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:05.089454 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:05.106439 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d98f5-4711-498e-bd20-126b3d3a34a3 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:05.150159 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280605fb-e501-4fb9-914a-7cc8f6a6fa16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:05.150533 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828bb51-17e3-4a02-abcd-026aa0083417 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:05.151907 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280605fb-e501-4fb9-914a-7cc8f6a6fa16 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:05.152678 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280605fb-e501-4fb9-914a-7cc8f6a6fa16 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:05.154097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280605fb-e501-4fb9-914a-7cc8f6a6fa16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:05.170276 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280605fb-e501-4fb9-914a-7cc8f6a6fa16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:05.179751 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-280605fb-e501-4fb9-914a-7cc8f6a6fa16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:02:05.179751 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:05.179751 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:05.179751 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:05.179751 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:05.179751 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:05.179751 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:05.179751 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:05.179751 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:05.179751 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:05.179751 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:05.179751 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:05.179751 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:05.179751 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:05.179751 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:05.179751 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:05.180877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:05.180877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:05.180877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:05.180877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:05.180877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:05.180877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:05.180877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:05.180877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:05.180877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:05.180877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:05.180877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:05.180877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:05.180877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:05.180877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:05.180877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:05.180877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:05.181749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:05.181749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:05.181749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:05.181749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:05.181749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:05.181749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:05.181749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:05.181749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:05.181749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:05.181749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:05.181749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:02:05.181749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:05.181749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 144/274] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:02:05.188139 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280605fb-e501-4fb9-914a-7cc8f6a6fa16 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:05.209451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66d253-2e43-4e13-875f-1455ed434a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:05.211572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66d253-2e43-4e13-875f-1455ed434a6a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:05.212183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66d253-2e43-4e13-875f-1455ed434a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:05.212663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66d253-2e43-4e13-875f-1455ed434a6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:05.215226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66d253-2e43-4e13-875f-1455ed434a6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:05.217950 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66d253-2e43-4e13-875f-1455ed434a6a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:05.220335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 131/275] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:02:05.228428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66d253-2e43-4e13-875f-1455ed434a6a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:05.314185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280605fb-e501-4fb9-914a-7cc8f6a6fa16 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:05.348122 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66d253-2e43-4e13-875f-1455ed434a6a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:05.350635 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae935471-64e7-4b74-ad4b-8c101a362d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:05.352032 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae935471-64e7-4b74-ad4b-8c101a362d69 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:05.352032 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae935471-64e7-4b74-ad4b-8c101a362d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:05.352338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae935471-64e7-4b74-ad4b-8c101a362d69 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:05.353162 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae935471-64e7-4b74-ad4b-8c101a362d69 None admin] RBAC: Adding query filter params (name=member) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:05.353475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae935471-64e7-4b74-ad4b-8c101a362d69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:05.354886 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae935471-64e7-4b74-ad4b-8c101a362d69 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:05.364326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:05.368400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 145/276] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:02:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:05.369321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae935471-64e7-4b74-ad4b-8c101a362d69 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:05.373246 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:05.391547 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f6f1d-9c1b-47d7-a3df-d3e0d455a2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:05.392263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f6f1d-9c1b-47d7-a3df-d3e0d455a2e8 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:05.393121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f6f1d-9c1b-47d7-a3df-d3e0d455a2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:05.393525 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f6f1d-9c1b-47d7-a3df-d3e0d455a2e8 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:05.394252 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f6f1d-9c1b-47d7-a3df-d3e0d455a2e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:05.396541 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f6f1d-9c1b-47d7-a3df-d3e0d455a2e8 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:05.482612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae935471-64e7-4b74-ad4b-8c101a362d69 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:05.516690 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74167e-42a0-43ed-b3a9-bad12cdd32a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:05.517566 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74167e-42a0-43ed-b3a9-bad12cdd32a0 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:05.519282 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74167e-42a0-43ed-b3a9-bad12cdd32a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:05.519574 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74167e-42a0-43ed-b3a9-bad12cdd32a0 None admin] PATH_INFO: `/v3/users/e6ddd4eab00840c5953c79d51cf9057c` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:05.534866 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 132/277] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jun 2 19:02:05 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:05.545950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74167e-42a0-43ed-b3a9-bad12cdd32a0 None admin] RBAC: Authorizing `identity:get_user(user_id=e6ddd4eab00840c5953c79d51cf9057c)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:05.547618 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74167e-42a0-43ed-b3a9-bad12cdd32a0 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:05.550155 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 146/278] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:02:05 2022] GET /identity/v3/users/e6ddd4eab00840c5953c79d51cf9057c => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:05.556626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f6f1d-9c1b-47d7-a3df-d3e0d455a2e8 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:05.681875 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f6f1d-9c1b-47d7-a3df-d3e0d455a2e8 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:05.731491 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca0c1d-f631-4359-9556-aa3f7da2f5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:05.732236 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca0c1d-f631-4359-9556-aa3f7da2f5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:05.732526 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca0c1d-f631-4359-9556-aa3f7da2f5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:05.732809 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca0c1d-f631-4359-9556-aa3f7da2f5e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:05.733704 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca0c1d-f631-4359-9556-aa3f7da2f5e3 None admin] RBAC: Adding query filter params (role.id=75723f2a7ead4f5cb2885e7b63680b08, user.id=e6ddd4eab00840c5953c79d51cf9057c, scope.system=all) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:05.734029 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca0c1d-f631-4359-9556-aa3f7da2f5e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:05.735621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca0c1d-f631-4359-9556-aa3f7da2f5e3 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:05.742909 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 133/279] 10.222.0.45 () {56 vars in 1308 bytes} [Thu Jun 2 19:02:05 2022] GET /identity/v3/role_assignments?user.id=e6ddd4eab00840c5953c79d51cf9057c&scope.system=all&role.id=75723f2a7ead4f5cb2885e7b63680b08 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:06.067015 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd32b5f-624d-4d66-87d8-1c4e35f58dc6 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:06.067361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd32b5f-624d-4d66-87d8-1c4e35f58dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:06.067474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd32b5f-624d-4d66-87d8-1c4e35f58dc6 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:06.069036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 147/280] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:06.074306 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1e6d7-103a-4948-be29-90b7aeb3db50 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:06.074619 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1e6d7-103a-4948-be29-90b7aeb3db50 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:06.074875 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1e6d7-103a-4948-be29-90b7aeb3db50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:06.094116 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-10e1e6d7-103a-4948-be29-90b7aeb3db50 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:06.095312 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-10e1e6d7-103a-4948-be29-90b7aeb3db50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:06.124440 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:06.167624 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 134/281] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:06.191002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd32b5f-624d-4d66-87d8-1c4e35f58dc6 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:06.277050 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:06.336880 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd32b5f-624d-4d66-87d8-1c4e35f58dc6 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:06.391700 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d6f14-a2e8-47f5-bb01-2646d7674ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:06.393010 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d6f14-a2e8-47f5-bb01-2646d7674ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:06.393500 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d6f14-a2e8-47f5-bb01-2646d7674ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:06.393969 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d6f14-a2e8-47f5-bb01-2646d7674ad3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:06.411130 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d6f14-a2e8-47f5-bb01-2646d7674ad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:06.425585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-7a4d6f14-a2e8-47f5-bb01-2646d7674ad3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 19:02:06.425585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:06.425585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:06.425585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:06.425585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:06.425585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:06.425585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:06.425585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:06.425585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:06.425585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:06.425585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:06.425585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:06.425585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:06.425585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:06.425585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:06.425585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:06.426976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:06.426976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:06.426976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:06.426976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:06.426976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:06.426976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:06.426976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:06.426976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:06.426976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:06.426976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:06.426976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:06.426976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:06.426976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:06.426976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:06.426976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:06.426976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:06.427778 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:06.427778 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:06.427778 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:06.427778 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:06.427778 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:06.427778 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:06.427778 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:06.427778 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:06.427778 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:06.427778 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:06.427778 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 19:02:06.427778 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:06.430107 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 148/282] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:02:06.435890 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1e6d7-103a-4948-be29-90b7aeb3db50 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:06.576868 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1e6d7-103a-4948-be29-90b7aeb3db50 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:06.619425 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16933853-a55a-4db3-90e3-d07d01e87d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:06.620734 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16933853-a55a-4db3-90e3-d07d01e87d65 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:06.621211 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16933853-a55a-4db3-90e3-d07d01e87d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:06.621675 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16933853-a55a-4db3-90e3-d07d01e87d65 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:06.622628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16933853-a55a-4db3-90e3-d07d01e87d65 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:06.623143 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16933853-a55a-4db3-90e3-d07d01e87d65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:06.624763 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16933853-a55a-4db3-90e3-d07d01e87d65 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:06.634823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 135/283] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:02:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:06.640522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d6f14-a2e8-47f5-bb01-2646d7674ad3 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:06.752851 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d6f14-a2e8-47f5-bb01-2646d7674ad3 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:06.775053 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:06.795726 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a1998-27f9-4b76-bbe2-5e53f6656b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:06.796747 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a1998-27f9-4b76-bbe2-5e53f6656b30 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:06.797346 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a1998-27f9-4b76-bbe2-5e53f6656b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:06.797346 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a1998-27f9-4b76-bbe2-5e53f6656b30 None admin] PATH_INFO: `/v3/users/b0c585156935498a8667deaa265751a5` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:06.798754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a1998-27f9-4b76-bbe2-5e53f6656b30 None admin] RBAC: Authorizing `identity:get_user(user_id=b0c585156935498a8667deaa265751a5)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:06.800293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a1998-27f9-4b76-bbe2-5e53f6656b30 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:06.801925 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 149/284] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:02:06 2022] GET /identity/v3/users/b0c585156935498a8667deaa265751a5 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:06.807598 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16933853-a55a-4db3-90e3-d07d01e87d65 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:06.846557 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:06.930102 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16933853-a55a-4db3-90e3-d07d01e87d65 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:06.972156 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64f96e-f87d-4231-9db2-84c101943390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:06.973090 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64f96e-f87d-4231-9db2-84c101943390 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:06.973376 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64f96e-f87d-4231-9db2-84c101943390 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:06.973646 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64f96e-f87d-4231-9db2-84c101943390 None admin] PATH_INFO: `/v3/projects/8de22bd0413a4a049d4de3e1b38ac903` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:06.974848 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e64f96e-f87d-4231-9db2-84c101943390 None admin] RBAC: Authorizing `identity:get_project(project_id=8de22bd0413a4a049d4de3e1b38ac903)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:06.976335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e64f96e-f87d-4231-9db2-84c101943390 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:06.982395 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 136/285] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:02:06 2022] GET /identity/v3/projects/8de22bd0413a4a049d4de3e1b38ac903 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:06.983629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a1998-27f9-4b76-bbe2-5e53f6656b30 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:07.103090 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a1998-27f9-4b76-bbe2-5e53f6656b30 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:07.147240 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a499c-1d76-4ee1-8981-cf70ad01e256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:07.148190 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a499c-1d76-4ee1-8981-cf70ad01e256 None admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:07.148472 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a499c-1d76-4ee1-8981-cf70ad01e256 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:07.148743 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a499c-1d76-4ee1-8981-cf70ad01e256 None admin] PATH_INFO: `/v3/projects/8de22bd0413a4a049d4de3e1b38ac903/users/b0c585156935498a8667deaa265751a5/roles/a562117402dd4e099b4dcab2b24ead28` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:07.153328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a499c-1d76-4ee1-8981-cf70ad01e256 None admin] RBAC: Authorizing `identity:create_grant(project_id=8de22bd0413a4a049d4de3e1b38ac903, user_id=b0c585156935498a8667deaa265751a5, role_id=a562117402dd4e099b4dcab2b24ead28)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:07.154792 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a499c-1d76-4ee1-8981-cf70ad01e256 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:07.226671 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 150/286] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jun 2 19:02:06 2022] PUT /identity/v3/projects/8de22bd0413a4a049d4de3e1b38ac903/users/b0c585156935498a8667deaa265751a5/roles/a562117402dd4e099b4dcab2b24ead28 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:07.671127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af478b55-76b9-4535-8ac4-67686dda9366 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:07.671825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af478b55-76b9-4535-8ac4-67686dda9366 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:07.671825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af478b55-76b9-4535-8ac4-67686dda9366 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:07.673456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 137/287] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:07.679788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5258c5f-f957-4237-b6eb-a5a13deaa779 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:07.680472 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5258c5f-f957-4237-b6eb-a5a13deaa779 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:07.680472 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5258c5f-f957-4237-b6eb-a5a13deaa779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:07.700324 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-c5258c5f-f957-4237-b6eb-a5a13deaa779 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:07.701551 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c5258c5f-f957-4237-b6eb-a5a13deaa779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:07.758908 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:07.786811 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 151/288] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:07.810660 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af478b55-76b9-4535-8ac4-67686dda9366 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:07.939481 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:07.949865 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af478b55-76b9-4535-8ac4-67686dda9366 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:07.985696 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed8e87-937c-4126-bf48-7d89488184ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:07.986584 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed8e87-937c-4126-bf48-7d89488184ff None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:07.986872 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed8e87-937c-4126-bf48-7d89488184ff None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:07.987146 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed8e87-937c-4126-bf48-7d89488184ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:07.998336 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed8e87-937c-4126-bf48-7d89488184ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:08.006756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-fbed8e87-937c-4126-bf48-7d89488184ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:02:08.006756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:08.006756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:08.006756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:08.006756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:08.006756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:08.006756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:08.006756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:08.006756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:08.006756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:08.006756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:08.006756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:08.006756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:08.006756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:08.006756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:08.006756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:08.007707 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:08.007707 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:08.007707 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:08.007707 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:08.007707 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:08.007707 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:08.007707 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:08.007707 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:08.007707 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:08.007707 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:08.007707 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:08.007707 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:08.007707 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:08.007707 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:08.007707 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:08.007707 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:08.008529 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:08.008529 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:08.008529 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:08.008529 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:08.008529 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:08.008529 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:08.008529 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:08.008529 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:08.008529 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:08.008529 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:08.008529 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:02:08.008529 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:08.008529 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 138/289] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:08.014270 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5258c5f-f957-4237-b6eb-a5a13deaa779 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:08.125803 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5258c5f-f957-4237-b6eb-a5a13deaa779 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:08.169211 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565ff91-c13c-46d6-8b66-8c5818be5b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:08.169896 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565ff91-c13c-46d6-8b66-8c5818be5b63 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:08.170183 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565ff91-c13c-46d6-8b66-8c5818be5b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:08.170464 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565ff91-c13c-46d6-8b66-8c5818be5b63 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:08.171228 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565ff91-c13c-46d6-8b66-8c5818be5b63 None admin] RBAC: Adding query filter params (name=member) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:08.171534 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565ff91-c13c-46d6-8b66-8c5818be5b63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:08.172950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565ff91-c13c-46d6-8b66-8c5818be5b63 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:08.182860 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 152/290] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:02:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:08.193275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed8e87-937c-4126-bf48-7d89488184ff None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:08.350235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed8e87-937c-4126-bf48-7d89488184ff None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:08.377527 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe237c32-c5eb-4720-aee7-abab28300144 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:08.377921 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe237c32-c5eb-4720-aee7-abab28300144 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:08.378275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe237c32-c5eb-4720-aee7-abab28300144 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:08.380129 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 153/291] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:02:08.385816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301526e-07bb-43d1-9d43-9f7176a0af3b None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:08.386682 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301526e-07bb-43d1-9d43-9f7176a0af3b None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:08.387059 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301526e-07bb-43d1-9d43-9f7176a0af3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:08.416775 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb9322-635e-40b1-be73-5249e6a238fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:08.417966 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb9322-635e-40b1-be73-5249e6a238fa None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:08.418426 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb9322-635e-40b1-be73-5249e6a238fa None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:08.418902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb9322-635e-40b1-be73-5249e6a238fa None admin] PATH_INFO: `/v3/users/eacd028742b048af9668e790667a9db6` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:08.420727 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb9322-635e-40b1-be73-5249e6a238fa None admin] RBAC: Authorizing `identity:get_user(user_id=eacd028742b048af9668e790667a9db6)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:08.422424 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb9322-635e-40b1-be73-5249e6a238fa None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:08.424274 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-f301526e-07bb-43d1-9d43-9f7176a0af3b None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:08.425435 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 139/292] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:02:08 2022] GET /identity/v3/users/eacd028742b048af9668e790667a9db6 => generated 297 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:08.426883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-f301526e-07bb-43d1-9d43-9f7176a0af3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:08.435217 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb9322-635e-40b1-be73-5249e6a238fa None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:08.461774 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:08.514705 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:08.558337 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb9322-635e-40b1-be73-5249e6a238fa None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:08.560038 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 154/293] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 19:02:08.561457 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f9c4b-513a-4902-9c56-6dee5d96351a None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:08.561748 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f9c4b-513a-4902-9c56-6dee5d96351a None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:08.562017 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f9c4b-513a-4902-9c56-6dee5d96351a None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:08.563256 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 155/294] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:08.582425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10286332-e0b8-4f1c-a8dc-e33c6f0a139d None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:08.582731 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10286332-e0b8-4f1c-a8dc-e33c6f0a139d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:08.582965 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10286332-e0b8-4f1c-a8dc-e33c6f0a139d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:08.602647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-10286332-e0b8-4f1c-a8dc-e33c6f0a139d None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:08.603817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-10286332-e0b8-4f1c-a8dc-e33c6f0a139d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:08.613628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e8320-7168-46b0-88f3-aa41115f7714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:08.614758 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e8320-7168-46b0-88f3-aa41115f7714 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:08.615104 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e8320-7168-46b0-88f3-aa41115f7714 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:08.615386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e8320-7168-46b0-88f3-aa41115f7714 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:08.677245 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 156/295] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 19:02:08.678412 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10286332-e0b8-4f1c-a8dc-e33c6f0a139d None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:08.713912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e8320-7168-46b0-88f3-aa41115f7714 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:08.719257 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e8320-7168-46b0-88f3-aa41115f7714 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:08.741651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:08.783049 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:08.786582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10286332-e0b8-4f1c-a8dc-e33c6f0a139d None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:08.825343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86352dc-8252-4585-8f38-34d55dba0b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:08.826149 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86352dc-8252-4585-8f38-34d55dba0b49 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:08.826428 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86352dc-8252-4585-8f38-34d55dba0b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:08.826704 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86352dc-8252-4585-8f38-34d55dba0b49 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:08.829963 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 140/296] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:02:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:08.831773 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024ca52-4510-4bff-b80e-6a30ed63ad8e None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:08.832158 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024ca52-4510-4bff-b80e-6a30ed63ad8e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:08.832512 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024ca52-4510-4bff-b80e-6a30ed63ad8e None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:08.833862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 141/297] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:08.837109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024ca52-4510-4bff-b80e-6a30ed63ad8e None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:08.842979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86352dc-8252-4585-8f38-34d55dba0b49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:08.851474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-a86352dc-8252-4585-8f38-34d55dba0b49 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:02:08.851474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:08.851474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:08.851474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:08.851474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:08.851474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:08.851474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:08.851474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:08.851474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:08.851474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:08.851474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:08.851474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:08.851474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:08.851474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:08.851474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:08.851474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:08.852404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:08.852404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:08.852404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:08.852404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:08.852404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:08.852404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:08.852404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:08.852404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:08.852404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:08.852404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:08.852404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:08.852404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:08.852404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:08.852404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:08.852404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:08.852404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:08.853206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:08.853206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:08.853206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:08.853206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:08.853206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:08.853206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:08.853206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:08.853206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:08.853206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:08.853206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:08.853206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:02:08.853206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:08.857948 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 157/298] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:08.858331 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86352dc-8252-4585-8f38-34d55dba0b49 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:08.942832 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024ca52-4510-4bff-b80e-6a30ed63ad8e None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:08.963608 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:08.979701 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86352dc-8252-4585-8f38-34d55dba0b49 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:08.979853 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57b11b-e247-478c-afdf-5de1efdc3504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:08.979853 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57b11b-e247-478c-afdf-5de1efdc3504 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:08.979853 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57b11b-e247-478c-afdf-5de1efdc3504 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:08.980125 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57b11b-e247-478c-afdf-5de1efdc3504 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:08.981143 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57b11b-e247-478c-afdf-5de1efdc3504 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:08.982600 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57b11b-e247-478c-afdf-5de1efdc3504 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:08.984249 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 142/299] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:08.990493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d49ed-7862-4bc0-8f28-ccb54fb11862 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:08.990783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d49ed-7862-4bc0-8f28-ccb54fb11862 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:08.991069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d49ed-7862-4bc0-8f28-ccb54fb11862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:09.006866 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a181662-f8c1-4296-ae36-ddad8a154545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:09.007758 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a181662-f8c1-4296-ae36-ddad8a154545 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:09.008073 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a181662-f8c1-4296-ae36-ddad8a154545 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:09.008355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a181662-f8c1-4296-ae36-ddad8a154545 None admin] PATH_INFO: `/v3/projects/8de22bd0413a4a049d4de3e1b38ac903` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:09.009284 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-508d49ed-7862-4bc0-8f28-ccb54fb11862 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:09.009640 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a181662-f8c1-4296-ae36-ddad8a154545 None admin] RBAC: Authorizing `identity:get_project(project_id=8de22bd0413a4a049d4de3e1b38ac903)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:09.010519 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-508d49ed-7862-4bc0-8f28-ccb54fb11862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:09.011158 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a181662-f8c1-4296-ae36-ddad8a154545 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:09.019009 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 158/300] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:02:08 2022] GET /identity/v3/projects/8de22bd0413a4a049d4de3e1b38ac903 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:09.019009 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a181662-f8c1-4296-ae36-ddad8a154545 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:09.051053 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:09.089975 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 143/301] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:09.091646 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d49ed-7862-4bc0-8f28-ccb54fb11862 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:09.133078 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a181662-f8c1-4296-ae36-ddad8a154545 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:09.171085 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c10c3f-63fd-497c-8f7c-5cec4380a069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:09.171764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c10c3f-63fd-497c-8f7c-5cec4380a069 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:09.172082 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c10c3f-63fd-497c-8f7c-5cec4380a069 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:09.172364 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c10c3f-63fd-497c-8f7c-5cec4380a069 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:09.173119 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c10c3f-63fd-497c-8f7c-5cec4380a069 None admin] RBAC: Adding query filter params (name=member) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:09.173427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c10c3f-63fd-497c-8f7c-5cec4380a069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:09.175506 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c10c3f-63fd-497c-8f7c-5cec4380a069 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:09.185709 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 159/302] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:02:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:09.186506 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c10c3f-63fd-497c-8f7c-5cec4380a069 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:09.199640 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d49ed-7862-4bc0-8f28-ccb54fb11862 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:09.219126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:09.240388 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8feff01-0740-4f5c-89f4-ee5e583671cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:09.240983 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8feff01-0740-4f5c-89f4-ee5e583671cb None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:09.241270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8feff01-0740-4f5c-89f4-ee5e583671cb None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:09.241544 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8feff01-0740-4f5c-89f4-ee5e583671cb None admin] PATH_INFO: `/v3/groups` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:09.242246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8feff01-0740-4f5c-89f4-ee5e583671cb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:09.243691 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8feff01-0740-4f5c-89f4-ee5e583671cb None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:09.286058 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:09.295348 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c10c3f-63fd-497c-8f7c-5cec4380a069 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:09.313943 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 144/303] 10.222.0.45 () {60 vars in 1134 bytes} [Thu Jun 2 19:02:09 2022] POST /identity/v3/groups => generated 229 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:09.315627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8feff01-0740-4f5c-89f4-ee5e583671cb None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:09.344936 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1032e-bb20-4825-b745-deb425574847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:09.346031 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1032e-bb20-4825-b745-deb425574847 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:09.346522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1032e-bb20-4825-b745-deb425574847 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:09.347002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1032e-bb20-4825-b745-deb425574847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:09.348262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1032e-bb20-4825-b745-deb425574847 None admin] RBAC: Adding query filter params (role.id=75723f2a7ead4f5cb2885e7b63680b08, scope.project.id=8de22bd0413a4a049d4de3e1b38ac903, user.id=eacd028742b048af9668e790667a9db6) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:09.348823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1032e-bb20-4825-b745-deb425574847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:09.350585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1032e-bb20-4825-b745-deb425574847 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:09.364499 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 160/304] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:02:09 2022] GET /identity/v3/role_assignments?user.id=eacd028742b048af9668e790667a9db6&scope.project.id=8de22bd0413a4a049d4de3e1b38ac903&role.id=75723f2a7ead4f5cb2885e7b63680b08 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:09.365750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1032e-bb20-4825-b745-deb425574847 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:09.529256 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8feff01-0740-4f5c-89f4-ee5e583671cb None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:09.536071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1032e-bb20-4825-b745-deb425574847 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:09.581562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdcd0a-b07c-47a8-96c5-3e57e94167dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:09.582566 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdcd0a-b07c-47a8-96c5-3e57e94167dc None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:09.582924 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdcd0a-b07c-47a8-96c5-3e57e94167dc None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:09.583296 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdcd0a-b07c-47a8-96c5-3e57e94167dc None admin] PATH_INFO: `/v3/users/e6ddd4eab00840c5953c79d51cf9057c` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:09.584813 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfdcd0a-b07c-47a8-96c5-3e57e94167dc None admin] RBAC: Authorizing `identity:get_user(user_id=e6ddd4eab00840c5953c79d51cf9057c)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:09.586391 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfdcd0a-b07c-47a8-96c5-3e57e94167dc None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:09.588937 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 161/305] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:02:09 2022] GET /identity/v3/users/e6ddd4eab00840c5953c79d51cf9057c => generated 293 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:09.594691 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdcd0a-b07c-47a8-96c5-3e57e94167dc None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:09.601538 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56f525-6162-4ee9-9e28-da5dc39ac4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:09.602474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56f525-6162-4ee9-9e28-da5dc39ac4af None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:09.602763 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56f525-6162-4ee9-9e28-da5dc39ac4af None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:09.603040 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56f525-6162-4ee9-9e28-da5dc39ac4af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:09.620969 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56f525-6162-4ee9-9e28-da5dc39ac4af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:09.627700 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:09.632920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-6d56f525-6162-4ee9-9e28-da5dc39ac4af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 19:02:09.632920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:09.632920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:09.632920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:09.632920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:09.632920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:09.632920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:09.632920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:09.632920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:09.632920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:09.632920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:09.632920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:09.632920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:09.632920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:09.632920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:09.632920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:09.633874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:09.633874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:09.633874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:09.633874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:09.633874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:09.633874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:09.633874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:09.633874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:09.633874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:09.633874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:09.633874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:09.633874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:09.633874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:09.633874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:09.633874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:09.633874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:09.634674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:09.634674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:09.634674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:09.634674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:09.634674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:09.634674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:09.634674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:09.634674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:09.634674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:09.634674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:09.634674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 19:02:09.634674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:09.634674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 145/306] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:09.641074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56f525-6162-4ee9-9e28-da5dc39ac4af None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:09.695113 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:09.723410 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdcd0a-b07c-47a8-96c5-3e57e94167dc None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:09.769054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27041fc7-9b08-4fe5-9822-94574dea789a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:09.769702 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56f525-6162-4ee9-9e28-da5dc39ac4af None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:09.770142 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27041fc7-9b08-4fe5-9822-94574dea789a None admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:09.771394 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27041fc7-9b08-4fe5-9822-94574dea789a None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:09.771715 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27041fc7-9b08-4fe5-9822-94574dea789a None admin] PATH_INFO: `/v3/system/users/e6ddd4eab00840c5953c79d51cf9057c/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:09.773809 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27041fc7-9b08-4fe5-9822-94574dea789a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e6ddd4eab00840c5953c79d51cf9057c, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:09.774789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27041fc7-9b08-4fe5-9822-94574dea789a None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:09.814213 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe9420-e1c9-4e2b-9dc4-8c9b624bb3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:09.815484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe9420-e1c9-4e2b-9dc4-8c9b624bb3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:09.815762 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe9420-e1c9-4e2b-9dc4-8c9b624bb3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:09.816059 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe9420-e1c9-4e2b-9dc4-8c9b624bb3c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:09.816807 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe9420-e1c9-4e2b-9dc4-8c9b624bb3c0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:09.817108 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe9420-e1c9-4e2b-9dc4-8c9b624bb3c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:09.818489 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe9420-e1c9-4e2b-9dc4-8c9b624bb3c0 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:09.832092 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 146/307] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:02:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:09.837671 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe9420-e1c9-4e2b-9dc4-8c9b624bb3c0 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:09.920956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 162/308] 10.222.0.45 () {58 vars in 1334 bytes} [Thu Jun 2 19:02:09 2022] PUT /identity/v3/system/users/e6ddd4eab00840c5953c79d51cf9057c/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:02:09.960122 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:09.964141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe9420-e1c9-4e2b-9dc4-8c9b624bb3c0 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:10.007926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ae64d-6dcc-48f1-b217-5a45300e9768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:10.008864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ae64d-6dcc-48f1-b217-5a45300e9768 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:10.009448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ae64d-6dcc-48f1-b217-5a45300e9768 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:10.009949 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ae64d-6dcc-48f1-b217-5a45300e9768 None admin] PATH_INFO: `/v3/users/a6b42e708aa84d1db8ce9b5973139a0f` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:10.027631 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ae64d-6dcc-48f1-b217-5a45300e9768 None admin] RBAC: Authorizing `identity:get_user(user_id=a6b42e708aa84d1db8ce9b5973139a0f)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:10.029218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ae64d-6dcc-48f1-b217-5a45300e9768 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:10.031290 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 147/309] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:02:09 2022] GET /identity/v3/users/a6b42e708aa84d1db8ce9b5973139a0f => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:10.038109 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27041fc7-9b08-4fe5-9822-94574dea789a None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:10.154761 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:10.171782 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27041fc7-9b08-4fe5-9822-94574dea789a None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:10.215827 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57423cd1-bafe-4650-8d40-b42d3a6f8c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:10.216620 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57423cd1-bafe-4650-8d40-b42d3a6f8c3b None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:10.216902 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57423cd1-bafe-4650-8d40-b42d3a6f8c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:10.217337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57423cd1-bafe-4650-8d40-b42d3a6f8c3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:10.218657 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57423cd1-bafe-4650-8d40-b42d3a6f8c3b None admin] RBAC: Adding query filter params (role.id=a562117402dd4e099b4dcab2b24ead28, user.id=a6b42e708aa84d1db8ce9b5973139a0f, scope.system=all) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:10.218975 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57423cd1-bafe-4650-8d40-b42d3a6f8c3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:10.220875 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57423cd1-bafe-4650-8d40-b42d3a6f8c3b None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:10.232211 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 163/310] 10.222.0.45 () {56 vars in 1308 bytes} [Thu Jun 2 19:02:10 2022] GET /identity/v3/role_assignments?user.id=a6b42e708aa84d1db8ce9b5973139a0f&scope.system=all&role.id=a562117402dd4e099b4dcab2b24ead28 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:10.235848 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f4067-5265-456c-bc9c-ce6b4bdf13a6 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:10.236292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f4067-5265-456c-bc9c-ce6b4bdf13a6 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:10.236656 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f4067-5265-456c-bc9c-ce6b4bdf13a6 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:10.238411 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 148/311] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:10.245970 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc06656-120d-481a-bc72-325633c1c016 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:10.246556 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc06656-120d-481a-bc72-325633c1c016 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:10.247008 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc06656-120d-481a-bc72-325633c1c016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:10.266130 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-1bc06656-120d-481a-bc72-325633c1c016 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:10.268297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-1bc06656-120d-481a-bc72-325633c1c016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:10.355022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 164/312] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:10.379227 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f4067-5265-456c-bc9c-ce6b4bdf13a6 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:10.505281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f4067-5265-456c-bc9c-ce6b4bdf13a6 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:10.543754 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9265f6b-a4da-4176-898c-ce7009a3c0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:10.544585 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9265f6b-a4da-4176-898c-ce7009a3c0ce None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:10.544926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9265f6b-a4da-4176-898c-ce7009a3c0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:10.545207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9265f6b-a4da-4176-898c-ce7009a3c0ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:10.556974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9265f6b-a4da-4176-898c-ce7009a3c0ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:10.565623 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-b9265f6b-a4da-4176-898c-ce7009a3c0ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 19:02:10.565623 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:10.565623 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:10.565623 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:10.565623 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:10.565623 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:10.565623 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:10.565623 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:10.565623 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:10.565623 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:10.565623 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:10.565623 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:10.565623 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:10.565623 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:10.565623 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:10.565623 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:10.566536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:10.566536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:10.566536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:10.566536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:10.566536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:10.566536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:10.566536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:10.566536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:10.566536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:10.566536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:10.566536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:10.566536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:10.566536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:10.566536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:10.566536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:10.566536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:10.567324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:10.567324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:10.567324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:10.567324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:10.567324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:10.567324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:10.567324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:10.567324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:10.567324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:10.567324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:10.567324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 19:02:10.567324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:10.567324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 149/313] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:10.574709 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc06656-120d-481a-bc72-325633c1c016 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:10.665051 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:10.686163 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc06656-120d-481a-bc72-325633c1c016 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:10.725180 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20bcac-23b4-41c1-867b-47a68012050f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:10.725854 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20bcac-23b4-41c1-867b-47a68012050f None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:10.726137 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20bcac-23b4-41c1-867b-47a68012050f None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:10.726411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20bcac-23b4-41c1-867b-47a68012050f None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:10.727171 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20bcac-23b4-41c1-867b-47a68012050f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:10.727477 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20bcac-23b4-41c1-867b-47a68012050f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:10.728961 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20bcac-23b4-41c1-867b-47a68012050f None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:10.738989 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 165/314] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:02:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:10.744600 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9265f6b-a4da-4176-898c-ce7009a3c0ce None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:10.769727 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:10.859337 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9265f6b-a4da-4176-898c-ce7009a3c0ce None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:10.909981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff8da8-ede6-4329-aca1-31088e2dd757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:10.911646 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff8da8-ede6-4329-aca1-31088e2dd757 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:10.912199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff8da8-ede6-4329-aca1-31088e2dd757 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:10.912709 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff8da8-ede6-4329-aca1-31088e2dd757 None admin] PATH_INFO: `/v3/users/b0c585156935498a8667deaa265751a5` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:10.914498 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff8da8-ede6-4329-aca1-31088e2dd757 None admin] RBAC: Authorizing `identity:get_user(user_id=b0c585156935498a8667deaa265751a5)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:10.917484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff8da8-ede6-4329-aca1-31088e2dd757 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:10.921073 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 150/315] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:02:10 2022] GET /identity/v3/users/b0c585156935498a8667deaa265751a5 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:10.926715 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20bcac-23b4-41c1-867b-47a68012050f None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:11.035131 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20bcac-23b4-41c1-867b-47a68012050f None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:11.071076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238c0b1-1e92-4eac-9b7f-45266e91f9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:11.071731 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238c0b1-1e92-4eac-9b7f-45266e91f9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:11.072114 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238c0b1-1e92-4eac-9b7f-45266e91f9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:11.072396 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238c0b1-1e92-4eac-9b7f-45266e91f9e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:11.085967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:11.148432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238c0b1-1e92-4eac-9b7f-45266e91f9e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:11.149949 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238c0b1-1e92-4eac-9b7f-45266e91f9e2 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:11.266239 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 166/316] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:02:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:11.273171 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff8da8-ede6-4329-aca1-31088e2dd757 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:11.368008 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:11.386134 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff8da8-ede6-4329-aca1-31088e2dd757 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:11.426442 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef86ae-8ca1-4b90-92c2-3e3eee480e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:11.427381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef86ae-8ca1-4b90-92c2-3e3eee480e87 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:11.427712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef86ae-8ca1-4b90-92c2-3e3eee480e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:11.428017 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef86ae-8ca1-4b90-92c2-3e3eee480e87 None admin] PATH_INFO: `/v3/projects/8de22bd0413a4a049d4de3e1b38ac903` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:11.429275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef86ae-8ca1-4b90-92c2-3e3eee480e87 None admin] RBAC: Authorizing `identity:get_project(project_id=8de22bd0413a4a049d4de3e1b38ac903)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:11.430730 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef86ae-8ca1-4b90-92c2-3e3eee480e87 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:11.432467 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 151/317] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:02:11 2022] GET /identity/v3/projects/8de22bd0413a4a049d4de3e1b38ac903 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:11.438229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238c0b1-1e92-4eac-9b7f-45266e91f9e2 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:11.483360 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:11.540755 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238c0b1-1e92-4eac-9b7f-45266e91f9e2 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:11.576472 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbd4c6-ae83-4a2d-8278-18c913e3fcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:11.577130 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbd4c6-ae83-4a2d-8278-18c913e3fcb2 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:11.577411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbd4c6-ae83-4a2d-8278-18c913e3fcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:11.577687 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbd4c6-ae83-4a2d-8278-18c913e3fcb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:11.578518 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfbd4c6-ae83-4a2d-8278-18c913e3fcb2 None admin] RBAC: Adding query filter params (role.id=a562117402dd4e099b4dcab2b24ead28, scope.project.id=8de22bd0413a4a049d4de3e1b38ac903, user.id=b0c585156935498a8667deaa265751a5) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:11.578826 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfbd4c6-ae83-4a2d-8278-18c913e3fcb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:11.580464 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfbd4c6-ae83-4a2d-8278-18c913e3fcb2 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:11.587048 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 167/318] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:02:11 2022] GET /identity/v3/role_assignments?user.id=b0c585156935498a8667deaa265751a5&scope.project.id=8de22bd0413a4a049d4de3e1b38ac903&role.id=a562117402dd4e099b4dcab2b24ead28 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:11.955805 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eabf3b-0bf8-41a9-82a1-afcf19a5e010 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:11.956341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eabf3b-0bf8-41a9-82a1-afcf19a5e010 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:11.956415 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eabf3b-0bf8-41a9-82a1-afcf19a5e010 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:11.957890 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 152/319] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:11.962962 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b9298-2ba0-42bf-b0de-64ba7144214b None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:11.963383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b9298-2ba0-42bf-b0de-64ba7144214b None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:11.963551 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b9298-2ba0-42bf-b0de-64ba7144214b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:11.981629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-f18b9298-2ba0-42bf-b0de-64ba7144214b None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:11.982823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-f18b9298-2ba0-42bf-b0de-64ba7144214b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:12.058586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 168/320] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:12.081351 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eabf3b-0bf8-41a9-82a1-afcf19a5e010 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:12.186795 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eabf3b-0bf8-41a9-82a1-afcf19a5e010 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:12.221973 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ca7a7-fa34-42b6-bb38-aa962e5090bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:12.222777 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ca7a7-fa34-42b6-bb38-aa962e5090bc None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:12.223061 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ca7a7-fa34-42b6-bb38-aa962e5090bc None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:12.223336 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ca7a7-fa34-42b6-bb38-aa962e5090bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:12.224537 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ca7a7-fa34-42b6-bb38-aa962e5090bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:12.225991 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ca7a7-fa34-42b6-bb38-aa962e5090bc None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:12.232187 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 153/321] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:12.233429 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b9298-2ba0-42bf-b0de-64ba7144214b None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:12.272579 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:12.341540 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b9298-2ba0-42bf-b0de-64ba7144214b None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:12.346381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458aa982-4fd0-419e-9335-fb78a0481a06 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:12.346669 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458aa982-4fd0-419e-9335-fb78a0481a06 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:12.346946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458aa982-4fd0-419e-9335-fb78a0481a06 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:12.348556 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 154/322] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:02:12.353709 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ace01-b96d-4a68-a7e2-9a209ffa2ecd None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:12.353996 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ace01-b96d-4a68-a7e2-9a209ffa2ecd None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:12.354273 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ace01-b96d-4a68-a7e2-9a209ffa2ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:12.371238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-325ace01-b96d-4a68-a7e2-9a209ffa2ecd None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:12.372635 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-325ace01-b96d-4a68-a7e2-9a209ffa2ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:12.388653 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2499404-85bd-475e-bafd-fb276f8834c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:12.389334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2499404-85bd-475e-bafd-fb276f8834c2 None admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:12.389613 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2499404-85bd-475e-bafd-fb276f8834c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:12.389885 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2499404-85bd-475e-bafd-fb276f8834c2 None admin] PATH_INFO: `/v3/groups` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:12.392152 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2499404-85bd-475e-bafd-fb276f8834c2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:12.392259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:12.392349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2499404-85bd-475e-bafd-fb276f8834c2 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:12.443199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 155/323] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 19:02:12.467167 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ace01-b96d-4a68-a7e2-9a209ffa2ecd None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:12.506380 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 169/324] 10.222.0.45 () {60 vars in 1134 bytes} [Thu Jun 2 19:02:12 2022] POST /identity/v3/groups => generated 226 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:12.576044 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ace01-b96d-4a68-a7e2-9a209ffa2ecd None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:12.576651 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f57ce-8e72-49b8-a2b9-bf8a9153f439 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:12.576941 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f57ce-8e72-49b8-a2b9-bf8a9153f439 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:12.577219 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f57ce-8e72-49b8-a2b9-bf8a9153f439 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:12.578963 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 170/325] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:02:12.584440 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3043848-5251-4043-848d-517240c5f6d3 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:12.584736 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3043848-5251-4043-848d-517240c5f6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:12.585020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3043848-5251-4043-848d-517240c5f6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:12.603159 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-f3043848-5251-4043-848d-517240c5f6d3 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:12.604328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-f3043848-5251-4043-848d-517240c5f6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:12.616931 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d111a-c5da-4579-be2c-ba0dd31266fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:12.618069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d111a-c5da-4579-be2c-ba0dd31266fa None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:12.618522 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d111a-c5da-4579-be2c-ba0dd31266fa None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:12.618964 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d111a-c5da-4579-be2c-ba0dd31266fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:12.631528 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d111a-c5da-4579-be2c-ba0dd31266fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:12.640222 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-789d111a-c5da-4579-be2c-ba0dd31266fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:02:12.640222 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:12.640222 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:12.640222 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:12.640222 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:12.640222 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:12.640222 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:12.640222 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:12.640222 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:12.640222 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:12.640222 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:12.640222 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:12.640222 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:12.640222 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:12.640222 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:12.640222 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:12.641153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:12.641153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:12.641153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:12.641153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:12.641153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:12.641153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:12.641153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:12.641153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:12.641153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:12.641153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:12.641153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:12.641153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:12.641153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:12.641153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:12.641153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:12.641153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:12.641965 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:12.641965 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:12.641965 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:12.641965 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:12.641965 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:12.641965 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:12.641965 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:12.641965 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:12.641965 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:12.641965 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:12.641965 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:02:12.641965 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:12.644540 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 156/326] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:02:12.651118 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d111a-c5da-4579-be2c-ba0dd31266fa None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:12.668764 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:12.681862 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 171/327] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 19:02:12.704034 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3043848-5251-4043-848d-517240c5f6d3 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:12.736776 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:12.772362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d111a-c5da-4579-be2c-ba0dd31266fa None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:12.822559 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10238e-ce99-4074-9fa7-597bad2b4a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:12.823242 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10238e-ce99-4074-9fa7-597bad2b4a0d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:12.823520 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10238e-ce99-4074-9fa7-597bad2b4a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:12.823792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10238e-ce99-4074-9fa7-597bad2b4a0d None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:12.824591 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10238e-ce99-4074-9fa7-597bad2b4a0d None admin] RBAC: Adding query filter params (name=member) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:12.824894 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10238e-ce99-4074-9fa7-597bad2b4a0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:12.825600 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3043848-5251-4043-848d-517240c5f6d3 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:12.826298 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10238e-ce99-4074-9fa7-597bad2b4a0d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:12.837514 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 157/328] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:02:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:02:12.843155 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10238e-ce99-4074-9fa7-597bad2b4a0d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:12.872301 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef90c08-04b6-46ac-9e03-5b1d4c348a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:12.873026 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef90c08-04b6-46ac-9e03-5b1d4c348a6f None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:12.873307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef90c08-04b6-46ac-9e03-5b1d4c348a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:12.873588 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef90c08-04b6-46ac-9e03-5b1d4c348a6f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:12.887674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef90c08-04b6-46ac-9e03-5b1d4c348a6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:12.896337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-1ef90c08-04b6-46ac-9e03-5b1d4c348a6f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 19:02:12.896337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:12.896337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:12.896337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:12.896337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:12.896337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:12.896337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:12.896337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:12.896337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:12.896337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:12.896337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:12.896337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:12.896337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:12.896337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:12.896337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:12.896337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:12.897263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:12.897263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:12.897263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:12.897263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:12.897263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:12.897263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:12.897263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:12.897263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:12.897263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:12.897263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:12.897263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:12.897263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:12.897263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:12.897263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:12.897263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:12.897263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:12.898047 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:12.898047 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:12.898047 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:12.898047 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:12.898047 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:12.898047 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:12.898047 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:12.898047 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:12.898047 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:12.898047 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:12.898047 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 19:02:12.898047 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:12.898047 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 172/329] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:02:12.905256 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef90c08-04b6-46ac-9e03-5b1d4c348a6f None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:12.943919 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:12.973216 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10238e-ce99-4074-9fa7-597bad2b4a0d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:13.013792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09952245-7217-463b-86a4-f9a4bf551950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:13.015003 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09952245-7217-463b-86a4-f9a4bf551950 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:13.015423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09952245-7217-463b-86a4-f9a4bf551950 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:13.015833 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09952245-7217-463b-86a4-f9a4bf551950 None admin] PATH_INFO: `/v3/users/e6ddd4eab00840c5953c79d51cf9057c` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:13.017365 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09952245-7217-463b-86a4-f9a4bf551950 None admin] RBAC: Authorizing `identity:get_user(user_id=e6ddd4eab00840c5953c79d51cf9057c)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:13.019652 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09952245-7217-463b-86a4-f9a4bf551950 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:13.021862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 158/330] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:02:12 2022] GET /identity/v3/users/e6ddd4eab00840c5953c79d51cf9057c => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:02:13.027381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09952245-7217-463b-86a4-f9a4bf551950 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:13.029879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:13.050587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef90c08-04b6-46ac-9e03-5b1d4c348a6f None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:13.098092 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee1e13-0b73-4570-a4bd-7caaceced026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:13.099216 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee1e13-0b73-4570-a4bd-7caaceced026 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:13.099616 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee1e13-0b73-4570-a4bd-7caaceced026 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:13.100015 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee1e13-0b73-4570-a4bd-7caaceced026 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:13.101154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee1e13-0b73-4570-a4bd-7caaceced026 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:13.101563 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee1e13-0b73-4570-a4bd-7caaceced026 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:13.103913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee1e13-0b73-4570-a4bd-7caaceced026 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:13.115555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 173/331] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:02:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:13.125105 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee1e13-0b73-4570-a4bd-7caaceced026 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:13.160144 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09952245-7217-463b-86a4-f9a4bf551950 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:13.205755 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e13a70-5832-4733-b37a-69549d9cb5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:13.206418 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e13a70-5832-4733-b37a-69549d9cb5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:13.206735 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e13a70-5832-4733-b37a-69549d9cb5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:13.206993 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e13a70-5832-4733-b37a-69549d9cb5b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:13.207835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e13a70-5832-4733-b37a-69549d9cb5b1 None admin] RBAC: Adding query filter params (role.id=75723f2a7ead4f5cb2885e7b63680b08, user.id=e6ddd4eab00840c5953c79d51cf9057c, scope.system=all) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:13.208958 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e13a70-5832-4733-b37a-69549d9cb5b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:13.210418 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e13a70-5832-4733-b37a-69549d9cb5b1 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:13.220575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:13.226319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 159/332] 10.222.0.45 () {56 vars in 1308 bytes} [Thu Jun 2 19:02:13 2022] GET /identity/v3/role_assignments?user.id=e6ddd4eab00840c5953c79d51cf9057c&scope.system=all&role.id=75723f2a7ead4f5cb2885e7b63680b08 => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:02:13.265533 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee1e13-0b73-4570-a4bd-7caaceced026 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:13.306859 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b577a-0f7c-41a4-ba0f-bfed0d51c0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:13.308167 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b577a-0f7c-41a4-ba0f-bfed0d51c0ac None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:13.308634 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b577a-0f7c-41a4-ba0f-bfed0d51c0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:13.309084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b577a-0f7c-41a4-ba0f-bfed0d51c0ac None admin] PATH_INFO: `/v3/users/a6b42e708aa84d1db8ce9b5973139a0f` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:13.310777 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b577a-0f7c-41a4-ba0f-bfed0d51c0ac None admin] RBAC: Authorizing `identity:get_user(user_id=a6b42e708aa84d1db8ce9b5973139a0f)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:13.312669 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b577a-0f7c-41a4-ba0f-bfed0d51c0ac None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:13.315615 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 174/333] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:02:13 2022] GET /identity/v3/users/a6b42e708aa84d1db8ce9b5973139a0f => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:13.321119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e13a70-5832-4733-b37a-69549d9cb5b1 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:13.442990 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e13a70-5832-4733-b37a-69549d9cb5b1 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:13.502976 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccea46-7b58-4590-bb57-1701f94ae1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:13.504189 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccea46-7b58-4590-bb57-1701f94ae1a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:13.504682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccea46-7b58-4590-bb57-1701f94ae1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:13.505137 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccea46-7b58-4590-bb57-1701f94ae1a9 None admin] PATH_INFO: `/v3/system/users/a6b42e708aa84d1db8ce9b5973139a0f/roles/a562117402dd4e099b4dcab2b24ead28` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:13.509261 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ccea46-7b58-4590-bb57-1701f94ae1a9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a6b42e708aa84d1db8ce9b5973139a0f, role_id=a562117402dd4e099b4dcab2b24ead28)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:13.510378 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ccea46-7b58-4590-bb57-1701f94ae1a9 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:13.572045 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 160/334] 10.222.0.45 () {58 vars in 1334 bytes} [Thu Jun 2 19:02:13 2022] PUT /identity/v3/system/users/a6b42e708aa84d1db8ce9b5973139a0f/roles/a562117402dd4e099b4dcab2b24ead28 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:02:15.277213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd43c9d-11b6-4a5e-a867-38d6ab65db11 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:15.277732 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd43c9d-11b6-4a5e-a867-38d6ab65db11 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:15.277808 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd43c9d-11b6-4a5e-a867-38d6ab65db11 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:15.279626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 175/335] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:15.302614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbbccd-0f3d-4ac7-b310-2ad589ff005c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:15.303108 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbbccd-0f3d-4ac7-b310-2ad589ff005c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:15.303182 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbbccd-0f3d-4ac7-b310-2ad589ff005c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:15.323056 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-eadbbccd-0f3d-4ac7-b310-2ad589ff005c None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:15.324454 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-eadbbccd-0f3d-4ac7-b310-2ad589ff005c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:15.371234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf56641-c9d4-4a1c-ae9f-c274ede8d284 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:15.371545 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf56641-c9d4-4a1c-ae9f-c274ede8d284 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:15.371794 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf56641-c9d4-4a1c-ae9f-c274ede8d284 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:15.373346 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 176/336] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:02:15.383071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756ef4c-8718-4538-9681-87ad19dc9667 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:15.383721 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756ef4c-8718-4538-9681-87ad19dc9667 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:15.384238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756ef4c-8718-4538-9681-87ad19dc9667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:15.404359 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:15.415161 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 161/337] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:15.418111 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-c756ef4c-8718-4538-9681-87ad19dc9667 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:15.419341 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c756ef4c-8718-4538-9681-87ad19dc9667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:15.441619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:15.492934 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbbccd-0f3d-4ac7-b310-2ad589ff005c None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:15.527809 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 177/338] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:15.570886 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756ef4c-8718-4538-9681-87ad19dc9667 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:15.632879 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbbccd-0f3d-4ac7-b310-2ad589ff005c None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:15.679053 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c803f7a-ea8e-4237-a746-472ce4365263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:15.679871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c803f7a-ea8e-4237-a746-472ce4365263 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:15.680178 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c803f7a-ea8e-4237-a746-472ce4365263 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:15.680449 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c803f7a-ea8e-4237-a746-472ce4365263 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:15.696151 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c803f7a-ea8e-4237-a746-472ce4365263 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:15.707023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-0c803f7a-ea8e-4237-a746-472ce4365263 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:02:15.707023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:15.707023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:15.707023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:15.707023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:15.707023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:15.707023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:15.707023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:15.707023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:15.707023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:15.707023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:15.707023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:15.707023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:15.707023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:15.707023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:15.707023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:15.707936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:15.707936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:15.707936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:15.707936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:15.707936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:15.707936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:15.707936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:15.707936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:15.707936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:15.707936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:15.707936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:15.707936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:15.707936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:15.707936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:15.707936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:15.707936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:15.709246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:15.709246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:15.709246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:15.709246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:15.709246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:15.709246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:15.709246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:15.709246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:15.709246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:15.709246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:15.709246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:02:15.709246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:15.709246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 162/339] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:15.721670 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c803f7a-ea8e-4237-a746-472ce4365263 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:15.751972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756ef4c-8718-4538-9681-87ad19dc9667 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:15.799756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be585c7f-fd9d-46dd-a218-80aa59d1568f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:15.800802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be585c7f-fd9d-46dd-a218-80aa59d1568f None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:15.801254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be585c7f-fd9d-46dd-a218-80aa59d1568f None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:15.801703 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be585c7f-fd9d-46dd-a218-80aa59d1568f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:15.811980 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:15.813339 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be585c7f-fd9d-46dd-a218-80aa59d1568f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:15.822355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-be585c7f-fd9d-46dd-a218-80aa59d1568f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 19:02:15.822355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:15.822355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:15.822355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:15.822355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:15.822355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:15.822355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:15.822355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:15.822355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:15.822355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:15.822355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:15.822355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:15.822355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:15.822355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:15.822355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:15.822355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:15.832770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:15.832770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:15.832770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:15.832770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:15.832770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:15.832770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:15.832770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:15.832770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:15.832770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:15.832770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:15.832770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:15.832770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:15.832770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:15.832770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:15.832770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:15.832770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:15.833790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:15.833790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:15.833790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:15.833790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:15.833790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:15.833790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:15.833790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:15.833790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:15.833790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:15.833790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:15.833790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 19:02:15.833790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:15.833790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 178/340] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jun 2 19:02:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:02:15.835512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be585c7f-fd9d-46dd-a218-80aa59d1568f None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:15.847329 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:15.911532 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c803f7a-ea8e-4237-a746-472ce4365263 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:15.954042 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be585c7f-fd9d-46dd-a218-80aa59d1568f None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:15.980353 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c65b01-b8c9-49ac-95a6-5fbd5e1bc7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:15.981031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c65b01-b8c9-49ac-95a6-5fbd5e1bc7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:15.981315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c65b01-b8c9-49ac-95a6-5fbd5e1bc7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:15.981590 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c65b01-b8c9-49ac-95a6-5fbd5e1bc7f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:15.982455 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c65b01-b8c9-49ac-95a6-5fbd5e1bc7f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:15.982774 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c65b01-b8c9-49ac-95a6-5fbd5e1bc7f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:15.984309 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c65b01-b8c9-49ac-95a6-5fbd5e1bc7f7 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:15.994607 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742abba6-86b8-445b-ae48-cf034dc1c6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:15.995518 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742abba6-86b8-445b-ae48-cf034dc1c6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:15.995949 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742abba6-86b8-445b-ae48-cf034dc1c6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:15.996390 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742abba6-86b8-445b-ae48-cf034dc1c6e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:15.997317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742abba6-86b8-445b-ae48-cf034dc1c6e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:15.997785 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742abba6-86b8-445b-ae48-cf034dc1c6e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:15.999306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742abba6-86b8-445b-ae48-cf034dc1c6e7 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:16.003697 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 163/341] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:02:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:16.013814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 179/342] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:02:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:16.015591 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c65b01-b8c9-49ac-95a6-5fbd5e1bc7f7 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:16.019961 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742abba6-86b8-445b-ae48-cf034dc1c6e7 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:16.120373 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:16.173078 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742abba6-86b8-445b-ae48-cf034dc1c6e7 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:16.226808 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60090d7f-4bb9-4ce0-bf11-f218160d36db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:16.227776 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60090d7f-4bb9-4ce0-bf11-f218160d36db None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:16.228260 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60090d7f-4bb9-4ce0-bf11-f218160d36db None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:16.228683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60090d7f-4bb9-4ce0-bf11-f218160d36db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:16.259915 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c65b01-b8c9-49ac-95a6-5fbd5e1bc7f7 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:16.312019 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:16.322529 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60090d7f-4bb9-4ce0-bf11-f218160d36db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:16.338695 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60090d7f-4bb9-4ce0-bf11-f218160d36db None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:16.378545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab03f1-2119-48d2-be89-a417fb2a5f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:16.379151 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab03f1-2119-48d2-be89-a417fb2a5f07 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:16.379435 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab03f1-2119-48d2-be89-a417fb2a5f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:16.379712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab03f1-2119-48d2-be89-a417fb2a5f07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:16.424559 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:16.462610 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 180/343] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:02:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 19:02:16.468691 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60090d7f-4bb9-4ce0-bf11-f218160d36db None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:16.514912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab03f1-2119-48d2-be89-a417fb2a5f07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:16.516365 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab03f1-2119-48d2-be89-a417fb2a5f07 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:16.593676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60090d7f-4bb9-4ce0-bf11-f218160d36db None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:16.658771 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a7aef-1895-46ad-9920-90c4d6c74e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:16.660089 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a7aef-1895-46ad-9920-90c4d6c74e31 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:16.660586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a7aef-1895-46ad-9920-90c4d6c74e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:16.661302 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a7aef-1895-46ad-9920-90c4d6c74e31 None admin] PATH_INFO: `/v3/projects/3c0517c3b0534b0499d8dae17360cb89` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:16.669291 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a7aef-1895-46ad-9920-90c4d6c74e31 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0517c3b0534b0499d8dae17360cb89)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:16.671240 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a7aef-1895-46ad-9920-90c4d6c74e31 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:16.673407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 181/344] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:02:16 2022] GET /identity/v3/projects/3c0517c3b0534b0499d8dae17360cb89 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:16.679836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a7aef-1895-46ad-9920-90c4d6c74e31 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:16.751791 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:16.771113 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 164/345] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:02:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 756 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:16.793067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab03f1-2119-48d2-be89-a417fb2a5f07 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:16.835404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a7aef-1895-46ad-9920-90c4d6c74e31 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:16.841730 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:16.879811 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb088f-e588-45b1-b238-2b881abca98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:16.881056 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb088f-e588-45b1-b238-2b881abca98c None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:16.881619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb088f-e588-45b1-b238-2b881abca98c None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:16.882090 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb088f-e588-45b1-b238-2b881abca98c None admin] PATH_INFO: `/v3/groups/05ba43e65f6a48b58b397b4d8690c25a` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:16.898588 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb088f-e588-45b1-b238-2b881abca98c None admin] RBAC: Authorizing `identity:get_group(group_id=05ba43e65f6a48b58b397b4d8690c25a)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:16.900324 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb088f-e588-45b1-b238-2b881abca98c None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:16.902256 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 182/346] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jun 2 19:02:16 2022] GET /identity/v3/groups/05ba43e65f6a48b58b397b4d8690c25a => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:02:16.903699 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6d02c-0126-4fca-a492-82b7b7e05fc2 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:16.905596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6d02c-0126-4fca-a492-82b7b7e05fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:16.906032 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6d02c-0126-4fca-a492-82b7b7e05fc2 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:16.909169 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 183/347] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:16.914573 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f21c3-3da4-4bbd-a3fc-d595c30715d8 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:16.915059 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f21c3-3da4-4bbd-a3fc-d595c30715d8 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:16.915504 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f21c3-3da4-4bbd-a3fc-d595c30715d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:16.943254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-5e0f21c3-3da4-4bbd-a3fc-d595c30715d8 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:16.945452 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5e0f21c3-3da4-4bbd-a3fc-d595c30715d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:17.012945 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab03f1-2119-48d2-be89-a417fb2a5f07 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:17.055200 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 184/348] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:17.056108 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f21c3-3da4-4bbd-a3fc-d595c30715d8 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:17.082253 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6e220-6ec5-400a-b489-882d7382059a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:17.083123 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6e220-6ec5-400a-b489-882d7382059a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:17.083426 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6e220-6ec5-400a-b489-882d7382059a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:17.083703 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6e220-6ec5-400a-b489-882d7382059a None admin] PATH_INFO: `/v3/projects/3c0517c3b0534b0499d8dae17360cb89` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:17.085776 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6e220-6ec5-400a-b489-882d7382059a None admin] RBAC: Authorizing `identity:get_project(project_id=3c0517c3b0534b0499d8dae17360cb89)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:17.087240 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6e220-6ec5-400a-b489-882d7382059a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:17.089179 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 165/349] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:02:16 2022] GET /identity/v3/projects/3c0517c3b0534b0499d8dae17360cb89 => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:17.095517 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6e220-6ec5-400a-b489-882d7382059a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:17.114477 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:17.237921 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:17.246215 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6e220-6ec5-400a-b489-882d7382059a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:17.276580 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f21c3-3da4-4bbd-a3fc-d595c30715d8 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:17.308813 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e4790-e259-40db-baa5-d028e9c62842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:17.309967 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e4790-e259-40db-baa5-d028e9c62842 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:17.310405 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e4790-e259-40db-baa5-d028e9c62842 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:17.310839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e4790-e259-40db-baa5-d028e9c62842 None admin] PATH_INFO: `/v3/groups/05ba43e65f6a48b58b397b4d8690c25a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:17.312226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e4790-e259-40db-baa5-d028e9c62842 None admin] RBAC: Authorizing `identity:get_group(group_id=05ba43e65f6a48b58b397b4d8690c25a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:17.315038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e4790-e259-40db-baa5-d028e9c62842 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:17.317429 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 166/350] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jun 2 19:02:17 2022] GET /identity/v3/groups/05ba43e65f6a48b58b397b4d8690c25a => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:17.318703 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e4790-e259-40db-baa5-d028e9c62842 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:17.321035 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612efe88-f5fb-4681-8a6a-01f05bb087e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:17.321990 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612efe88-f5fb-4681-8a6a-01f05bb087e8 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:17.322365 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612efe88-f5fb-4681-8a6a-01f05bb087e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:17.322851 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612efe88-f5fb-4681-8a6a-01f05bb087e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:17.324471 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612efe88-f5fb-4681-8a6a-01f05bb087e8 None admin] RBAC: Adding query filter params (group.id=05ba43e65f6a48b58b397b4d8690c25a, role.id=27769697518a42139af80d8b8410ca07, scope.project.id=3c0517c3b0534b0499d8dae17360cb89) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:17.324995 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612efe88-f5fb-4681-8a6a-01f05bb087e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:17.326700 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612efe88-f5fb-4681-8a6a-01f05bb087e8 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:17.339511 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 185/351] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Jun 2 19:02:17 2022] GET /identity/v3/role_assignments?group.id=05ba43e65f6a48b58b397b4d8690c25a&scope.project.id=3c0517c3b0534b0499d8dae17360cb89&role.id=27769697518a42139af80d8b8410ca07 => generated 260 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:17.339511 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e6dcd-3e1c-4042-ae53-a51d464b7fd1 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:17.339511 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e6dcd-3e1c-4042-ae53-a51d464b7fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:17.339511 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e6dcd-3e1c-4042-ae53-a51d464b7fd1 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:17.339916 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 186/352] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:17.346897 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e6dcd-3e1c-4042-ae53-a51d464b7fd1 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:17.551790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:17.554020 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e4790-e259-40db-baa5-d028e9c62842 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:17.563349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e6dcd-3e1c-4042-ae53-a51d464b7fd1 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:17.604379 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577e9a1-1d80-4534-ba42-58d943a0bc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:17.605264 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577e9a1-1d80-4534-ba42-58d943a0bc39 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:17.605548 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577e9a1-1d80-4534-ba42-58d943a0bc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:17.605829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577e9a1-1d80-4534-ba42-58d943a0bc39 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:17.607642 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3790eb-8932-4b9f-b97d-f85fbefcb95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:17.608727 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3790eb-8932-4b9f-b97d-f85fbefcb95a None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:17.609232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3790eb-8932-4b9f-b97d-f85fbefcb95a None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:17.609707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3790eb-8932-4b9f-b97d-f85fbefcb95a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:17.610822 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3790eb-8932-4b9f-b97d-f85fbefcb95a None admin] RBAC: Adding query filter params (group.id=05ba43e65f6a48b58b397b4d8690c25a, role.id=75723f2a7ead4f5cb2885e7b63680b08, scope.project.id=3c0517c3b0534b0499d8dae17360cb89) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:17.611924 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3790eb-8932-4b9f-b97d-f85fbefcb95a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:17.613913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3790eb-8932-4b9f-b97d-f85fbefcb95a None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:17.619672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577e9a1-1d80-4534-ba42-58d943a0bc39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:17.621087 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 187/353] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Jun 2 19:02:17 2022] GET /identity/v3/role_assignments?group.id=05ba43e65f6a48b58b397b4d8690c25a&scope.project.id=3c0517c3b0534b0499d8dae17360cb89&role.id=75723f2a7ead4f5cb2885e7b63680b08 => generated 260 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:17.623310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626fe09-0297-4a5f-b64c-2ad7a20c01a3 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:17.623893 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626fe09-0297-4a5f-b64c-2ad7a20c01a3 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:17.624398 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626fe09-0297-4a5f-b64c-2ad7a20c01a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:17.630065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-5577e9a1-1d80-4534-ba42-58d943a0bc39 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 19:02:17.630065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:17.630065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:17.630065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:17.630065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:17.630065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:17.630065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:17.630065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:17.630065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:17.630065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:17.630065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:17.630065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:17.630065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:17.630065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:17.630065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:17.630065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:17.631074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:17.631074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:17.631074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:17.631074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:17.631074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:17.631074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:17.631074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:17.631074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:17.631074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:17.631074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:17.631074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:17.631074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:17.631074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:17.631074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:17.631074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:17.631074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:17.632389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:17.632389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:17.632389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:17.632389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:17.632389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:17.632389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:17.632389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:17.632389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:17.632389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:17.632389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:17.632389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 19:02:17.632389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:17.632389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 167/354] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:17.633418 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2e7de-e829-4e5e-8325-d4513ecac5c5 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:17.633711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2e7de-e829-4e5e-8325-d4513ecac5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:17.633991 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2e7de-e829-4e5e-8325-d4513ecac5c5 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:17.636417 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 168/355] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:17.641916 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2e7de-e829-4e5e-8325-d4513ecac5c5 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:17.656587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-c626fe09-0297-4a5f-b64c-2ad7a20c01a3 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:17.656926 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c626fe09-0297-4a5f-b64c-2ad7a20c01a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:17.666607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:17.780232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 188/356] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:17.782379 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708d554-22fb-47f8-b403-900117c7b27d None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:17.782683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708d554-22fb-47f8-b403-900117c7b27d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:17.783501 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708d554-22fb-47f8-b403-900117c7b27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:17.811594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-c708d554-22fb-47f8-b403-900117c7b27d None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:17.813203 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c708d554-22fb-47f8-b403-900117c7b27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:17.814122 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2e7de-e829-4e5e-8325-d4513ecac5c5 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:17.863748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efaf76-5b9a-4fd5-9205-6978a5c2c94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:17.864489 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efaf76-5b9a-4fd5-9205-6978a5c2c94c None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:17.865882 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efaf76-5b9a-4fd5-9205-6978a5c2c94c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:17.866315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efaf76-5b9a-4fd5-9205-6978a5c2c94c None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:17.867931 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efaf76-5b9a-4fd5-9205-6978a5c2c94c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:17.868420 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efaf76-5b9a-4fd5-9205-6978a5c2c94c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:17.870062 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efaf76-5b9a-4fd5-9205-6978a5c2c94c None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:17.884036 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 169/357] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:02:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:17.885437 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efaf76-5b9a-4fd5-9205-6978a5c2c94c None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:17.910054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 189/358] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:17.911924 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708d554-22fb-47f8-b403-900117c7b27d None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:17.945290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:17.992716 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:18.020090 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efaf76-5b9a-4fd5-9205-6978a5c2c94c None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:18.061056 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea630d-3530-49fa-9756-fb5831ac18ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:18.061926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea630d-3530-49fa-9756-fb5831ac18ba None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:18.062147 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea630d-3530-49fa-9756-fb5831ac18ba None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:18.062430 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea630d-3530-49fa-9756-fb5831ac18ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:18.073863 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea630d-3530-49fa-9756-fb5831ac18ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:18.080672 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708d554-22fb-47f8-b403-900117c7b27d None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:18.082344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-1dea630d-3530-49fa-9756-fb5831ac18ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:02:18.082344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:18.082344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:18.082344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:18.082344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:18.082344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:18.082344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:18.082344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:18.082344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:18.082344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:18.082344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:18.082344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:18.082344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:18.082344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:18.082344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:18.082344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:18.083229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:18.083229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:18.083229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:18.083229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:18.083229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:18.083229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:18.083229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:18.083229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:18.083229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:18.083229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:18.083229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:18.083229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:18.083229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:18.083229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:18.083229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:18.083229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:18.084141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:18.084141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:18.084141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:18.084141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:18.084141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:18.084141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:18.084141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:18.084141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:18.084141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:18.084141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:18.084141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:02:18.084141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:18.084141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 170/359] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:18.088986 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea630d-3530-49fa-9756-fb5831ac18ba None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:18.124953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d91368-a29f-4550-b2b8-ea701a378f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:18.126419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d91368-a29f-4550-b2b8-ea701a378f48 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:18.127522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d91368-a29f-4550-b2b8-ea701a378f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:18.128050 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d91368-a29f-4550-b2b8-ea701a378f48 None admin] PATH_INFO: `/v3/users/a6b42e708aa84d1db8ce9b5973139a0f` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:18.129513 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d91368-a29f-4550-b2b8-ea701a378f48 None admin] RBAC: Authorizing `identity:get_user(user_id=a6b42e708aa84d1db8ce9b5973139a0f)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:18.131412 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d91368-a29f-4550-b2b8-ea701a378f48 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:18.134721 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 190/360] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:02:17 2022] GET /identity/v3/users/a6b42e708aa84d1db8ce9b5973139a0f => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:18.135866 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d91368-a29f-4550-b2b8-ea701a378f48 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:18.201102 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea630d-3530-49fa-9756-fb5831ac18ba None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:18.242645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72ab3d-ed1f-45ea-9c48-692a3c74a56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:18.243745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72ab3d-ed1f-45ea-9c48-692a3c74a56a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:18.244053 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72ab3d-ed1f-45ea-9c48-692a3c74a56a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:18.244336 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72ab3d-ed1f-45ea-9c48-692a3c74a56a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:18.252437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:18.253104 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:18.257326 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d91368-a29f-4550-b2b8-ea701a378f48 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:18.259648 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72ab3d-ed1f-45ea-9c48-692a3c74a56a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:18.271346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-cc72ab3d-ed1f-45ea-9c48-692a3c74a56a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 19:02:18.271346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:18.271346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:18.271346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:18.271346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:18.271346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:18.271346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:18.271346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:18.271346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:18.271346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:18.271346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:18.271346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:18.271346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:18.271346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:18.271346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:18.271346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:18.274192 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:18.274192 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:18.274192 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:18.274192 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:18.274192 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:18.274192 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:18.274192 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:18.274192 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:18.274192 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:18.274192 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:18.274192 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:18.274192 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:18.274192 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:18.274192 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:18.274192 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:18.274192 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:18.275195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:18.275195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:18.275195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:18.275195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:18.275195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:18.275195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:18.275195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:18.275195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:18.275195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:18.275195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:18.275195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 19:02:18.275195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:18.275195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 171/361] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jun 2 19:02:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:18.275195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295e419-a421-4ddb-b76f-f936949bf631 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:18.276099 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295e419-a421-4ddb-b76f-f936949bf631 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:18.276099 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295e419-a421-4ddb-b76f-f936949bf631 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:18.277364 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 172/362] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:18.278379 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295e419-a421-4ddb-b76f-f936949bf631 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:18.303717 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97358e-0c56-49be-be74-ab4f583ce346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:18.304688 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97358e-0c56-49be-be74-ab4f583ce346 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:18.305309 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97358e-0c56-49be-be74-ab4f583ce346 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:18.305594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97358e-0c56-49be-be74-ab4f583ce346 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:18.307253 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97358e-0c56-49be-be74-ab4f583ce346 None admin] RBAC: Adding query filter params (name=member) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:18.307253 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97358e-0c56-49be-be74-ab4f583ce346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:18.308567 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97358e-0c56-49be-be74-ab4f583ce346 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:18.324351 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 191/363] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:02:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:18.329798 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97358e-0c56-49be-be74-ab4f583ce346 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:18.436332 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295e419-a421-4ddb-b76f-f936949bf631 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:18.466978 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97358e-0c56-49be-be74-ab4f583ce346 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:18.483406 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d6d77-95d8-492e-96c9-4d55c3edc94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:18.484095 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d6d77-95d8-492e-96c9-4d55c3edc94a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:18.484379 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d6d77-95d8-492e-96c9-4d55c3edc94a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:18.484650 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d6d77-95d8-492e-96c9-4d55c3edc94a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:18.485491 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d6d77-95d8-492e-96c9-4d55c3edc94a None admin] RBAC: Adding query filter params (role.id=a562117402dd4e099b4dcab2b24ead28, user.id=a6b42e708aa84d1db8ce9b5973139a0f, scope.system=all) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:18.488830 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d6d77-95d8-492e-96c9-4d55c3edc94a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:18.490461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d6d77-95d8-492e-96c9-4d55c3edc94a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:18.512475 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 173/364] 10.222.0.45 () {56 vars in 1308 bytes} [Thu Jun 2 19:02:18 2022] GET /identity/v3/role_assignments?user.id=a6b42e708aa84d1db8ce9b5973139a0f&scope.system=all&role.id=a562117402dd4e099b4dcab2b24ead28 => generated 510 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:18.513985 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c81803-3831-4a0c-998c-2938d4b1e394 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:18.514275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c81803-3831-4a0c-998c-2938d4b1e394 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:18.514554 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c81803-3831-4a0c-998c-2938d4b1e394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:18.515388 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772b4dc-823d-44e6-9e96-b1425f30c9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:18.516863 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772b4dc-823d-44e6-9e96-b1425f30c9de None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:18.517156 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772b4dc-823d-44e6-9e96-b1425f30c9de None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:18.518047 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772b4dc-823d-44e6-9e96-b1425f30c9de None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:18.518896 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772b4dc-823d-44e6-9e96-b1425f30c9de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:18.519213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772b4dc-823d-44e6-9e96-b1425f30c9de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:18.520721 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772b4dc-823d-44e6-9e96-b1425f30c9de None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:18.531619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 192/365] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:02:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:18.532559 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772b4dc-823d-44e6-9e96-b1425f30c9de None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:18.553690 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:18.565728 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-98c81803-3831-4a0c-998c-2938d4b1e394 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:18.566965 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-98c81803-3831-4a0c-998c-2938d4b1e394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:18.665707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772b4dc-823d-44e6-9e96-b1425f30c9de None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:18.708118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43398c5a-ed1d-4b7a-b852-7f4a81a472e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:18.708791 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43398c5a-ed1d-4b7a-b852-7f4a81a472e4 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:18.709076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43398c5a-ed1d-4b7a-b852-7f4a81a472e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:18.709351 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43398c5a-ed1d-4b7a-b852-7f4a81a472e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:18.736555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:18.794997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43398c5a-ed1d-4b7a-b852-7f4a81a472e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:18.801627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43398c5a-ed1d-4b7a-b852-7f4a81a472e4 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:18.816884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:18.819625 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 174/366] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:18.820823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c81803-3831-4a0c-998c-2938d4b1e394 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:18.930204 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 193/367] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:02:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:18.930814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43398c5a-ed1d-4b7a-b852-7f4a81a472e4 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:18.965471 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c81803-3831-4a0c-998c-2938d4b1e394 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.018999 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669de92-c233-48ab-a3d7-179b7f8ecca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.019677 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669de92-c233-48ab-a3d7-179b7f8ecca6 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.019964 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669de92-c233-48ab-a3d7-179b7f8ecca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.020265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669de92-c233-48ab-a3d7-179b7f8ecca6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.073346 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43398c5a-ed1d-4b7a-b852-7f4a81a472e4 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.090761 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:19.091193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:19.118090 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669de92-c233-48ab-a3d7-179b7f8ecca6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:19.120148 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3537bf0-1f95-4b1c-8244-47e43225d71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.120604 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669de92-c233-48ab-a3d7-179b7f8ecca6 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:19.127149 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3537bf0-1f95-4b1c-8244-47e43225d71b None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.127962 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3537bf0-1f95-4b1c-8244-47e43225d71b None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.132902 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3537bf0-1f95-4b1c-8244-47e43225d71b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.151970 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3537bf0-1f95-4b1c-8244-47e43225d71b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:19.162967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-a3537bf0-1f95-4b1c-8244-47e43225d71b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:02:19.162967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:19.162967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:19.162967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:19.162967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:19.162967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:19.162967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:19.162967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:19.162967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:19.162967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:19.162967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:19.162967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:19.162967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:19.162967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:19.162967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:19.162967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:19.163904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:19.163904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:19.163904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:19.163904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:19.163904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:19.163904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:19.163904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:19.163904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:19.163904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:19.163904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:19.163904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:19.163904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:19.163904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:19.163904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:19.163904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:19.163904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:19.165176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:19.165176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:19.165176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:19.165176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:19.165176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:19.165176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:19.165176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:19.165176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:19.165176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:19.165176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:19.165176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:02:19.165176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:19.165176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 194/368] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:02:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:19.165829 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3537bf0-1f95-4b1c-8244-47e43225d71b None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.251026 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 175/369] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:02:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:19.251959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669de92-c233-48ab-a3d7-179b7f8ecca6 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.333259 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3537bf0-1f95-4b1c-8244-47e43225d71b None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.343741 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:19.365389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669de92-c233-48ab-a3d7-179b7f8ecca6 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.383986 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbe6b5-719f-4a31-9f34-56c6986a8e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.387380 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbe6b5-719f-4a31-9f34-56c6986a8e58 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.387672 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbe6b5-719f-4a31-9f34-56c6986a8e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.387956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbe6b5-719f-4a31-9f34-56c6986a8e58 None admin] PATH_INFO: `/v3/projects/8de22bd0413a4a049d4de3e1b38ac903` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.390217 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbe6b5-719f-4a31-9f34-56c6986a8e58 None admin] RBAC: Authorizing `identity:get_project(project_id=8de22bd0413a4a049d4de3e1b38ac903)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:19.392085 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbe6b5-719f-4a31-9f34-56c6986a8e58 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:19.395549 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 195/370] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:02:19 2022] GET /identity/v3/projects/8de22bd0413a4a049d4de3e1b38ac903 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:19.396563 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbe6b5-719f-4a31-9f34-56c6986a8e58 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.413603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352a8b1-497d-471e-976d-96e2761c0bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.414282 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352a8b1-497d-471e-976d-96e2761c0bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.414560 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352a8b1-497d-471e-976d-96e2761c0bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.414829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352a8b1-497d-471e-976d-96e2761c0bf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.415585 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352a8b1-497d-471e-976d-96e2761c0bf8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:19.416318 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352a8b1-497d-471e-976d-96e2761c0bf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:19.418012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352a8b1-497d-471e-976d-96e2761c0bf8 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:19.434401 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 176/371] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:19.435696 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352a8b1-497d-471e-976d-96e2761c0bf8 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.454319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:19.559803 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbe6b5-719f-4a31-9f34-56c6986a8e58 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.565531 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352a8b1-497d-471e-976d-96e2761c0bf8 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.601130 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710880d-cd7e-4d90-923b-472d17aa1e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.602024 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710880d-cd7e-4d90-923b-472d17aa1e5a None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.602304 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710880d-cd7e-4d90-923b-472d17aa1e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.602580 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710880d-cd7e-4d90-923b-472d17aa1e5a None admin] PATH_INFO: `/v3/projects/8de22bd0413a4a049d4de3e1b38ac903` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.603907 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710880d-cd7e-4d90-923b-472d17aa1e5a None admin] RBAC: Authorizing `identity:get_project(project_id=8de22bd0413a4a049d4de3e1b38ac903)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:19.605296 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7f6df-f34d-4ba5-924d-606de93b57de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.605421 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710880d-cd7e-4d90-923b-472d17aa1e5a None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:19.606494 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7f6df-f34d-4ba5-924d-606de93b57de None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.606998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7f6df-f34d-4ba5-924d-606de93b57de None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.607112 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 196/372] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:02:19 2022] GET /identity/v3/projects/8de22bd0413a4a049d4de3e1b38ac903 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:19.607843 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7f6df-f34d-4ba5-924d-606de93b57de None admin] PATH_INFO: `/v3/groups/05ba43e65f6a48b58b397b4d8690c25a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.607953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710880d-cd7e-4d90-923b-472d17aa1e5a None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.609477 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7f6df-f34d-4ba5-924d-606de93b57de None admin] RBAC: Authorizing `identity:get_group(group_id=05ba43e65f6a48b58b397b4d8690c25a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:19.611688 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7f6df-f34d-4ba5-924d-606de93b57de None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:19.613944 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 177/373] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jun 2 19:02:19 2022] GET /identity/v3/groups/05ba43e65f6a48b58b397b4d8690c25a => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:19.615027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7f6df-f34d-4ba5-924d-606de93b57de None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.632820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:19.726937 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710880d-cd7e-4d90-923b-472d17aa1e5a None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.737267 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:19.738751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7f6df-f34d-4ba5-924d-606de93b57de None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.770207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbaf0c5-2336-4b50-8e64-d1882b0baf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.770868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaf0c5-2336-4b50-8e64-d1882b0baf7a None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.771149 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaf0c5-2336-4b50-8e64-d1882b0baf7a None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.771423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaf0c5-2336-4b50-8e64-d1882b0baf7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.781855 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736844f1-5951-4dbf-bdd4-ca09ca298c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.783660 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736844f1-5951-4dbf-bdd4-ca09ca298c57 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.784180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736844f1-5951-4dbf-bdd4-ca09ca298c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.784764 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736844f1-5951-4dbf-bdd4-ca09ca298c57 None admin] PATH_INFO: `/v3/groups/05ba43e65f6a48b58b397b4d8690c25a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.786302 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736844f1-5951-4dbf-bdd4-ca09ca298c57 None admin] RBAC: Authorizing `identity:get_group(group_id=05ba43e65f6a48b58b397b4d8690c25a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:19.788026 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736844f1-5951-4dbf-bdd4-ca09ca298c57 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:19.790134 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 178/374] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jun 2 19:02:19 2022] GET /identity/v3/groups/05ba43e65f6a48b58b397b4d8690c25a => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:19.791107 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736844f1-5951-4dbf-bdd4-ca09ca298c57 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.849561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbaf0c5-2336-4b50-8e64-d1882b0baf7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:19.851115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbaf0c5-2336-4b50-8e64-d1882b0baf7a None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:19.908412 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:19.917527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736844f1-5951-4dbf-bdd4-ca09ca298c57 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.962262 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70f80e-ff71-434b-ad8c-eadb779b4e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.963043 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70f80e-ff71-434b-ad8c-eadb779b4e36 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.963446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70f80e-ff71-434b-ad8c-eadb779b4e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.963737 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70f80e-ff71-434b-ad8c-eadb779b4e36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.964663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70f80e-ff71-434b-ad8c-eadb779b4e36 None admin] RBAC: Adding query filter params (group.id=05ba43e65f6a48b58b397b4d8690c25a, role.id=75723f2a7ead4f5cb2885e7b63680b08, scope.project.id=8de22bd0413a4a049d4de3e1b38ac903) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:19.965019 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70f80e-ff71-434b-ad8c-eadb779b4e36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:19.966698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70f80e-ff71-434b-ad8c-eadb779b4e36 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:19.971228 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 197/375] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:02:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:19.972118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbaf0c5-2336-4b50-8e64-d1882b0baf7a None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.974103 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 179/376] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Jun 2 19:02:19 2022] GET /identity/v3/role_assignments?group.id=05ba43e65f6a48b58b397b4d8690c25a&scope.project.id=8de22bd0413a4a049d4de3e1b38ac903&role.id=75723f2a7ead4f5cb2885e7b63680b08 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:19.981120 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:19.981324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70f80e-ff71-434b-ad8c-eadb779b4e36 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:20.146437 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70f80e-ff71-434b-ad8c-eadb779b4e36 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:20.230976 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05059646-98b1-4770-8794-6e0df8aceffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:20.234564 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05059646-98b1-4770-8794-6e0df8aceffe None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:20.235590 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05059646-98b1-4770-8794-6e0df8aceffe None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:20.236926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05059646-98b1-4770-8794-6e0df8aceffe None admin] PATH_INFO: `/v3/projects/cc622f67162c4bdeb3f3fd1a3419d2ab` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:20.240041 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05059646-98b1-4770-8794-6e0df8aceffe None admin] RBAC: Authorizing `identity:get_project(project_id=cc622f67162c4bdeb3f3fd1a3419d2ab)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:20.243103 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05059646-98b1-4770-8794-6e0df8aceffe None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:20.247680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 180/377] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:02:19 2022] GET /identity/v3/projects/cc622f67162c4bdeb3f3fd1a3419d2ab => generated 344 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:20.254385 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05059646-98b1-4770-8794-6e0df8aceffe None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:20.267057 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbaf0c5-2336-4b50-8e64-d1882b0baf7a None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:20.274648 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:20.351002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366f16e-9348-48db-8e62-4356f3cca584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:20.351002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366f16e-9348-48db-8e62-4356f3cca584 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:20.351651 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366f16e-9348-48db-8e62-4356f3cca584 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:20.351651 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366f16e-9348-48db-8e62-4356f3cca584 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:20.352743 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366f16e-9348-48db-8e62-4356f3cca584 None admin] RBAC: Adding query filter params (group.id=05ba43e65f6a48b58b397b4d8690c25a, role.id=27769697518a42139af80d8b8410ca07, scope.project.id=8de22bd0413a4a049d4de3e1b38ac903) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:20.352743 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366f16e-9348-48db-8e62-4356f3cca584 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:20.354052 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366f16e-9348-48db-8e62-4356f3cca584 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:20.365360 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 198/378] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Jun 2 19:02:19 2022] GET /identity/v3/role_assignments?group.id=05ba43e65f6a48b58b397b4d8690c25a&scope.project.id=8de22bd0413a4a049d4de3e1b38ac903&role.id=27769697518a42139af80d8b8410ca07 => generated 260 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:20.366721 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b0cd6-daa5-40eb-8baf-aa7c9c354f39 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:20.367004 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b0cd6-daa5-40eb-8baf-aa7c9c354f39 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:20.367279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b0cd6-daa5-40eb-8baf-aa7c9c354f39 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:20.368945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 199/379] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:20.377662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376cc56-17a3-4638-acd2-645f3b0fdade None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:20.377984 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376cc56-17a3-4638-acd2-645f3b0fdade None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:20.378333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376cc56-17a3-4638-acd2-645f3b0fdade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:20.386053 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05059646-98b1-4770-8794-6e0df8aceffe None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:20.401307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-b376cc56-17a3-4638-acd2-645f3b0fdade None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:20.402781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-b376cc56-17a3-4638-acd2-645f3b0fdade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:20.469103 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b922b6-d150-472f-84a9-f9126442b3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:20.470324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b922b6-d150-472f-84a9-f9126442b3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:20.474480 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b922b6-d150-472f-84a9-f9126442b3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:20.475007 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b922b6-d150-472f-84a9-f9126442b3b0 None admin] PATH_INFO: `/v3/groups/8d639b1ffe5c4804a3bce28af6a0e430` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:20.488522 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b922b6-d150-472f-84a9-f9126442b3b0 None admin] RBAC: Authorizing `identity:get_group(group_id=8d639b1ffe5c4804a3bce28af6a0e430)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:20.491252 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b922b6-d150-472f-84a9-f9126442b3b0 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:20.496807 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 181/380] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jun 2 19:02:20 2022] GET /identity/v3/groups/8d639b1ffe5c4804a3bce28af6a0e430 => generated 229 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:02:20.500866 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b922b6-d150-472f-84a9-f9126442b3b0 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:20.540566 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:20.550573 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 200/381] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:20.583554 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376cc56-17a3-4638-acd2-645f3b0fdade None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:20.634506 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:20.677607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b922b6-d150-472f-84a9-f9126442b3b0 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:20.720885 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376cc56-17a3-4638-acd2-645f3b0fdade None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:20.732769 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e1f3c-8bec-4640-9bb3-3b7df95ce0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:20.734077 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e1f3c-8bec-4640-9bb3-3b7df95ce0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:20.734383 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e1f3c-8bec-4640-9bb3-3b7df95ce0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:20.734741 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e1f3c-8bec-4640-9bb3-3b7df95ce0f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:20.736367 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e1f3c-8bec-4640-9bb3-3b7df95ce0f9 None admin] RBAC: Adding query filter params (group.id=8d639b1ffe5c4804a3bce28af6a0e430, role.id=4588ca63994f4e2d9ce482d475edbabd, scope.project.id=cc622f67162c4bdeb3f3fd1a3419d2ab) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:20.736815 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e1f3c-8bec-4640-9bb3-3b7df95ce0f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:20.738815 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e1f3c-8bec-4640-9bb3-3b7df95ce0f9 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:20.752462 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 182/382] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Jun 2 19:02:20 2022] GET /identity/v3/role_assignments?group.id=8d639b1ffe5c4804a3bce28af6a0e430&scope.project.id=cc622f67162c4bdeb3f3fd1a3419d2ab&role.id=4588ca63994f4e2d9ce482d475edbabd => generated 260 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:20.754581 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3954f3-dc22-4994-886d-26d1bcde534b None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:20.755579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3954f3-dc22-4994-886d-26d1bcde534b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:20.755876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3954f3-dc22-4994-886d-26d1bcde534b None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:20.764598 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 183/383] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:20.766081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751726b-7c1f-45a7-8fdd-03b4ff02289b None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:20.766611 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751726b-7c1f-45a7-8fdd-03b4ff02289b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:20.766903 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751726b-7c1f-45a7-8fdd-03b4ff02289b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:20.776906 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab7550-cb61-4b74-9219-b33bb3615877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:20.778087 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab7550-cb61-4b74-9219-b33bb3615877 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:20.778377 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab7550-cb61-4b74-9219-b33bb3615877 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:20.778655 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab7550-cb61-4b74-9219-b33bb3615877 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:20.798331 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab7550-cb61-4b74-9219-b33bb3615877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:20.804047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-1751726b-7c1f-45a7-8fdd-03b4ff02289b None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:20.804047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1751726b-7c1f-45a7-8fdd-03b4ff02289b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:20.820753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-2bab7550-cb61-4b74-9219-b33bb3615877 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 19:02:20.820753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:20.820753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:20.820753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:20.820753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:20.820753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:20.820753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:20.820753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:20.820753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:20.820753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:20.820753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:20.820753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:20.820753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:20.820753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:20.820753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:20.820753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:20.821912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:20.821912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:20.821912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:20.821912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:20.821912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:20.821912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:20.821912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:20.821912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:20.821912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:20.821912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:20.821912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:20.821912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:20.821912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:20.821912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:20.821912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:20.821912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:20.822701 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:20.822701 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:20.822701 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:20.822701 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:20.822701 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:20.822701 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:20.822701 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:20.822701 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:20.822701 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:20.822701 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:20.822701 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 19:02:20.822701 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:20.824805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 201/384] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jun 2 19:02:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:02:20.832349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab7550-cb61-4b74-9219-b33bb3615877 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:20.925129 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 184/385] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:20.943975 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:21.010399 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab7550-cb61-4b74-9219-b33bb3615877 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:21.011691 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751726b-7c1f-45a7-8fdd-03b4ff02289b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:21.064082 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd32190-be4d-47e3-af14-77f069aad731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:21.064899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd32190-be4d-47e3-af14-77f069aad731 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:21.065249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd32190-be4d-47e3-af14-77f069aad731 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:21.065595 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd32190-be4d-47e3-af14-77f069aad731 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:21.066472 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd32190-be4d-47e3-af14-77f069aad731 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:21.066847 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd32190-be4d-47e3-af14-77f069aad731 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:21.068495 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd32190-be4d-47e3-af14-77f069aad731 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:21.087385 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 202/386] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:02:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:02:21.094200 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd32190-be4d-47e3-af14-77f069aad731 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:21.146858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:21.186955 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751726b-7c1f-45a7-8fdd-03b4ff02289b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:21.235326 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd32190-be4d-47e3-af14-77f069aad731 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:21.248857 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b7a52-820e-4abd-952b-32d15b6688a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:21.249698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b7a52-820e-4abd-952b-32d15b6688a5 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:21.249985 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b7a52-820e-4abd-952b-32d15b6688a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:21.250264 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b7a52-820e-4abd-952b-32d15b6688a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:21.264405 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:21.272263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b7a52-820e-4abd-952b-32d15b6688a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:21.275961 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633eb138-a62d-4f2b-86f4-68243b1857b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:21.276851 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633eb138-a62d-4f2b-86f4-68243b1857b0 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:21.280920 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633eb138-a62d-4f2b-86f4-68243b1857b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:21.280920 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633eb138-a62d-4f2b-86f4-68243b1857b0 None admin] PATH_INFO: `/v3/groups/05ba43e65f6a48b58b397b4d8690c25a` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:21.280920 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633eb138-a62d-4f2b-86f4-68243b1857b0 None admin] RBAC: Authorizing `identity:get_group(group_id=05ba43e65f6a48b58b397b4d8690c25a)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:21.280920 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633eb138-a62d-4f2b-86f4-68243b1857b0 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:21.281212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-1e5b7a52-820e-4abd-952b-32d15b6688a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:02:21.281212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:21.281212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:21.281212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:21.281212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:21.281212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:21.281212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:21.281212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:21.281212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:21.281212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:21.281212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:21.281212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:21.281212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:21.281212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:21.281212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:21.281212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:21.282005 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:21.282005 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:21.282005 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:21.282005 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:21.282005 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:21.282005 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:21.282005 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:21.282005 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:21.282005 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:21.282005 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:21.282005 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:21.282005 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:21.282005 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:21.282005 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:21.282005 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:21.282005 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:21.282878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:21.282878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:21.282878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:21.282878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:21.282878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:21.282878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:21.282878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:21.282878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:21.282878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:21.282878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:21.282878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:02:21.282878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:21.283522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 203/387] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jun 2 19:02:21 2022] GET /identity/v3/groups/05ba43e65f6a48b58b397b4d8690c25a => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:21.286449 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 185/388] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:21.292439 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633eb138-a62d-4f2b-86f4-68243b1857b0 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:21.293627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b7a52-820e-4abd-952b-32d15b6688a5 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:21.446518 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633eb138-a62d-4f2b-86f4-68243b1857b0 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:21.474875 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b7a52-820e-4abd-952b-32d15b6688a5 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:21.499021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f2dac-1d39-4e14-93b8-cf6ac439cd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:21.499867 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f2dac-1d39-4e14-93b8-cf6ac439cd5e None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:21.500189 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f2dac-1d39-4e14-93b8-cf6ac439cd5e None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:21.500577 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f2dac-1d39-4e14-93b8-cf6ac439cd5e None admin] PATH_INFO: `/v3/projects/3c0517c3b0534b0499d8dae17360cb89` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:21.502409 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f2dac-1d39-4e14-93b8-cf6ac439cd5e None admin] RBAC: Authorizing `identity:get_project(project_id=3c0517c3b0534b0499d8dae17360cb89)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:21.503873 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f2dac-1d39-4e14-93b8-cf6ac439cd5e None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:21.510350 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 204/389] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:02:21 2022] GET /identity/v3/projects/3c0517c3b0534b0499d8dae17360cb89 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:21.511592 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f2dac-1d39-4e14-93b8-cf6ac439cd5e None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:21.516538 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:21.528673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c6764-db22-4c83-9755-bc108088a101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:21.530058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c6764-db22-4c83-9755-bc108088a101 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:21.530058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c6764-db22-4c83-9755-bc108088a101 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:21.530425 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c6764-db22-4c83-9755-bc108088a101 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:21.531437 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c6764-db22-4c83-9755-bc108088a101 None admin] RBAC: Adding query filter params (name=member) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:21.531891 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c6764-db22-4c83-9755-bc108088a101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:21.533552 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c6764-db22-4c83-9755-bc108088a101 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:21.543637 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 186/390] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:02:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:21.550746 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c6764-db22-4c83-9755-bc108088a101 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:21.580321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:21.636025 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f2dac-1d39-4e14-93b8-cf6ac439cd5e None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:21.675278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9b063-9809-4865-8440-4853b91810ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:21.676314 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9b063-9809-4865-8440-4853b91810ac None admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:21.676604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9b063-9809-4865-8440-4853b91810ac None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:21.676882 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9b063-9809-4865-8440-4853b91810ac None admin] PATH_INFO: `/v3/projects/3c0517c3b0534b0499d8dae17360cb89/groups/05ba43e65f6a48b58b397b4d8690c25a/roles/27769697518a42139af80d8b8410ca07` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:21.680186 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9b063-9809-4865-8440-4853b91810ac None admin] RBAC: Authorizing `identity:create_grant(project_id=3c0517c3b0534b0499d8dae17360cb89, group_id=05ba43e65f6a48b58b397b4d8690c25a, role_id=27769697518a42139af80d8b8410ca07)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:21.681673 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9b063-9809-4865-8440-4853b91810ac None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:21.711823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c6764-db22-4c83-9755-bc108088a101 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:21.753259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd94ae-5d05-4e6f-9fe5-e339b09a0032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:21.754211 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd94ae-5d05-4e6f-9fe5-e339b09a0032 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:21.754499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd94ae-5d05-4e6f-9fe5-e339b09a0032 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:21.754775 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd94ae-5d05-4e6f-9fe5-e339b09a0032 None admin] PATH_INFO: `/v3/groups/05ba43e65f6a48b58b397b4d8690c25a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:21.756059 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd94ae-5d05-4e6f-9fe5-e339b09a0032 None admin] RBAC: Authorizing `identity:get_group(group_id=05ba43e65f6a48b58b397b4d8690c25a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:21.757572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd94ae-5d05-4e6f-9fe5-e339b09a0032 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:21.766015 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 205/391] 10.222.0.45 () {58 vars in 1442 bytes} [Thu Jun 2 19:02:21 2022] PUT /identity/v3/projects/3c0517c3b0534b0499d8dae17360cb89/groups/05ba43e65f6a48b58b397b4d8690c25a/roles/27769697518a42139af80d8b8410ca07 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:02:21.766384 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 187/392] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jun 2 19:02:21 2022] GET /identity/v3/groups/05ba43e65f6a48b58b397b4d8690c25a => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:02:21.772282 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9b063-9809-4865-8440-4853b91810ac None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:21.903831 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9b063-9809-4865-8440-4853b91810ac None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:21.926244 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:21.944990 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d443507-eedd-477d-a32d-1f0622e82076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:21.945937 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d443507-eedd-477d-a32d-1f0622e82076 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:21.946220 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d443507-eedd-477d-a32d-1f0622e82076 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:21.946498 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d443507-eedd-477d-a32d-1f0622e82076 None admin] PATH_INFO: `/v3/projects/3c0517c3b0534b0499d8dae17360cb89` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:21.947763 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d443507-eedd-477d-a32d-1f0622e82076 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0517c3b0534b0499d8dae17360cb89)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:21.949426 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d443507-eedd-477d-a32d-1f0622e82076 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:21.951592 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 206/393] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:02:21 2022] GET /identity/v3/projects/3c0517c3b0534b0499d8dae17360cb89 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:21.960749 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd94ae-5d05-4e6f-9fe5-e339b09a0032 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:22.037562 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:22.093404 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd94ae-5d05-4e6f-9fe5-e339b09a0032 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:22.134153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e71635-4356-4cb8-b2f2-804648668b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:22.135047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e71635-4356-4cb8-b2f2-804648668b91 None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:22.135327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e71635-4356-4cb8-b2f2-804648668b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:22.135603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e71635-4356-4cb8-b2f2-804648668b91 None admin] PATH_INFO: `/v3/projects/3c0517c3b0534b0499d8dae17360cb89/groups/05ba43e65f6a48b58b397b4d8690c25a/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:22.137770 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e71635-4356-4cb8-b2f2-804648668b91 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c0517c3b0534b0499d8dae17360cb89, group_id=05ba43e65f6a48b58b397b4d8690c25a, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:22.139280 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e71635-4356-4cb8-b2f2-804648668b91 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:22.219064 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 188/394] 10.222.0.45 () {58 vars in 1442 bytes} [Thu Jun 2 19:02:21 2022] PUT /identity/v3/projects/3c0517c3b0534b0499d8dae17360cb89/groups/05ba43e65f6a48b58b397b4d8690c25a/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:22.840602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1281f-65ee-4c08-b515-7c08a7f7d7a7 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:22.841106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1281f-65ee-4c08-b515-7c08a7f7d7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:22.841180 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1281f-65ee-4c08-b515-7c08a7f7d7a7 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:22.843104 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 207/395] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:22.849185 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357aefc6-1b3c-4d3a-92cf-51d5d599f997 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:22.849648 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357aefc6-1b3c-4d3a-92cf-51d5d599f997 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:22.849721 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357aefc6-1b3c-4d3a-92cf-51d5d599f997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:22.877117 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-357aefc6-1b3c-4d3a-92cf-51d5d599f997 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:22.878335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-357aefc6-1b3c-4d3a-92cf-51d5d599f997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:22.970125 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 189/396] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:23.009981 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1281f-65ee-4c08-b515-7c08a7f7d7a7 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:23.137313 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1281f-65ee-4c08-b515-7c08a7f7d7a7 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:23.183530 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549415a9-d81a-4bc5-ba72-a11f738c2b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:23.184376 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549415a9-d81a-4bc5-ba72-a11f738c2b92 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:23.184669 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549415a9-d81a-4bc5-ba72-a11f738c2b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:23.184924 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549415a9-d81a-4bc5-ba72-a11f738c2b92 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:23.196703 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549415a9-d81a-4bc5-ba72-a11f738c2b92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:23.209257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-549415a9-d81a-4bc5-ba72-a11f738c2b92 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:02:23.209257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:23.209257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:23.209257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:23.209257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:23.209257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:23.209257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:23.209257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:23.209257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:23.209257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:23.209257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:23.209257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:23.209257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:23.209257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:23.209257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:23.209257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:23.210178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:23.210178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:23.210178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:23.210178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:23.210178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:23.210178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:23.210178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:23.210178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:23.210178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:23.210178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:23.210178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:23.210178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:23.210178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:23.210178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:23.210178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:23.210178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:23.210944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:23.210944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:23.210944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:23.210944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:23.210944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:23.210944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:23.210944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:23.210944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:23.210944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:23.210944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:23.210944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:02:23.210944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:23.210944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 208/397] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:23.216567 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357aefc6-1b3c-4d3a-92cf-51d5d599f997 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:23.234383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938a0bf-eb76-4990-ae9c-f1805a8d4443 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:23.234684 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938a0bf-eb76-4990-ae9c-f1805a8d4443 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:23.234934 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938a0bf-eb76-4990-ae9c-f1805a8d4443 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:23.237192 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 209/398] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:02:23.243865 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925a396-8ea6-4d65-b97d-39dc5e45be70 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:23.244362 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925a396-8ea6-4d65-b97d-39dc5e45be70 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:23.244782 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925a396-8ea6-4d65-b97d-39dc5e45be70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:23.275410 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-3925a396-8ea6-4d65-b97d-39dc5e45be70 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:23.277548 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-3925a396-8ea6-4d65-b97d-39dc5e45be70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:23.319223 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:23.376383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:23.403465 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357aefc6-1b3c-4d3a-92cf-51d5d599f997 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:23.416313 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 210/399] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 19:02:23.448369 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925a396-8ea6-4d65-b97d-39dc5e45be70 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:23.457927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09035185-3bbc-4247-9fd2-1424272c8f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:23.458856 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09035185-3bbc-4247-9fd2-1424272c8f7d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:23.459287 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09035185-3bbc-4247-9fd2-1424272c8f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:23.459728 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09035185-3bbc-4247-9fd2-1424272c8f7d None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:23.460670 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09035185-3bbc-4247-9fd2-1424272c8f7d None admin] RBAC: Adding query filter params (name=member) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:23.461141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09035185-3bbc-4247-9fd2-1424272c8f7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:23.463859 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09035185-3bbc-4247-9fd2-1424272c8f7d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:23.478395 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 190/400] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:02:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:23.484727 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09035185-3bbc-4247-9fd2-1424272c8f7d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:23.570901 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925a396-8ea6-4d65-b97d-39dc5e45be70 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:23.612698 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cd412-7221-462b-8659-9ce308165527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:23.614566 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cd412-7221-462b-8659-9ce308165527 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:23.615581 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cd412-7221-462b-8659-9ce308165527 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:23.616186 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cd412-7221-462b-8659-9ce308165527 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:23.630466 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cd412-7221-462b-8659-9ce308165527 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:23.639154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-c70cd412-7221-462b-8659-9ce308165527 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 19:02:23.639154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:23.639154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:23.639154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:23.639154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:23.639154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:23.639154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:23.639154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:23.639154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:23.639154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:23.639154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:23.639154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:23.639154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:23.639154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:23.639154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:23.639154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:23.640297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:23.640297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:23.640297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:23.640297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:23.640297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:23.640297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:23.640297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:23.640297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:23.640297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:23.640297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:23.640297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:23.640297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:23.640297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:23.640297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:23.640297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:23.640297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:23.641310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:23.641310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:23.641310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:23.641310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:23.641310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:23.641310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:23.641310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:23.641310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:23.641310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:23.641310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:23.641310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 19:02:23.641310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:23.643822 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 211/401] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jun 2 19:02:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:02:23.649913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cd412-7221-462b-8659-9ce308165527 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:23.714021 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09035185-3bbc-4247-9fd2-1424272c8f7d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:23.736388 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:23.744078 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:23.789906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e355eb-c44c-421a-b94d-7d35af4d8474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:23.792701 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e355eb-c44c-421a-b94d-7d35af4d8474 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:23.794728 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e355eb-c44c-421a-b94d-7d35af4d8474 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:23.795233 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e355eb-c44c-421a-b94d-7d35af4d8474 None admin] PATH_INFO: `/v3/groups/05ba43e65f6a48b58b397b4d8690c25a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:23.800024 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e355eb-c44c-421a-b94d-7d35af4d8474 None admin] RBAC: Authorizing `identity:get_group(group_id=05ba43e65f6a48b58b397b4d8690c25a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:23.800156 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e355eb-c44c-421a-b94d-7d35af4d8474 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:23.810861 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 191/402] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jun 2 19:02:23 2022] GET /identity/v3/groups/05ba43e65f6a48b58b397b4d8690c25a => generated 226 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:23.816849 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e355eb-c44c-421a-b94d-7d35af4d8474 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:23.869049 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cd412-7221-462b-8659-9ce308165527 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:23.912031 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486defb-5ff7-40d4-a0a8-8e5718f0734c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:23.912847 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486defb-5ff7-40d4-a0a8-8e5718f0734c None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:23.913132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486defb-5ff7-40d4-a0a8-8e5718f0734c None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:23.913409 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486defb-5ff7-40d4-a0a8-8e5718f0734c None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:23.914343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486defb-5ff7-40d4-a0a8-8e5718f0734c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:23.914655 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486defb-5ff7-40d4-a0a8-8e5718f0734c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:23.916090 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486defb-5ff7-40d4-a0a8-8e5718f0734c None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:23.926747 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 212/403] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:02:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:23.932812 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486defb-5ff7-40d4-a0a8-8e5718f0734c None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:24.055566 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e355eb-c44c-421a-b94d-7d35af4d8474 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:24.062276 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:24.067299 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486defb-5ff7-40d4-a0a8-8e5718f0734c None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:24.094010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93358ce-0fd6-4f55-b7a5-bfbd79fed2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:24.094931 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93358ce-0fd6-4f55-b7a5-bfbd79fed2b5 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:24.095274 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93358ce-0fd6-4f55-b7a5-bfbd79fed2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:24.096155 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93358ce-0fd6-4f55-b7a5-bfbd79fed2b5 None admin] PATH_INFO: `/v3/projects/8de22bd0413a4a049d4de3e1b38ac903` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:24.097401 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93358ce-0fd6-4f55-b7a5-bfbd79fed2b5 None admin] RBAC: Authorizing `identity:get_project(project_id=8de22bd0413a4a049d4de3e1b38ac903)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:24.098865 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93358ce-0fd6-4f55-b7a5-bfbd79fed2b5 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:24.106999 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 192/404] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:02:23 2022] GET /identity/v3/projects/8de22bd0413a4a049d4de3e1b38ac903 => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:02:24.106999 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be7e2d-827d-400e-b87b-daf1d373e194 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:24.107278 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be7e2d-827d-400e-b87b-daf1d373e194 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:24.107547 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be7e2d-827d-400e-b87b-daf1d373e194 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:24.109021 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 193/405] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:24.110267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be7e2d-827d-400e-b87b-daf1d373e194 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:24.113101 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f27f4e-443b-4e6b-867b-033ff0331050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:24.114545 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f27f4e-443b-4e6b-867b-033ff0331050 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:24.115049 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f27f4e-443b-4e6b-867b-033ff0331050 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:24.115519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f27f4e-443b-4e6b-867b-033ff0331050 None admin] PATH_INFO: `/v3/groups/05ba43e65f6a48b58b397b4d8690c25a` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:24.117009 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f27f4e-443b-4e6b-867b-033ff0331050 None admin] RBAC: Authorizing `identity:get_group(group_id=05ba43e65f6a48b58b397b4d8690c25a)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:24.118841 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f27f4e-443b-4e6b-867b-033ff0331050 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:24.121011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 213/406] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jun 2 19:02:23 2022] GET /identity/v3/groups/05ba43e65f6a48b58b397b4d8690c25a => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:24.126838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf74f24-a621-4e16-9137-54addd3f4733 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:24.126838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf74f24-a621-4e16-9137-54addd3f4733 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:24.126838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf74f24-a621-4e16-9137-54addd3f4733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:24.144397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-bcf74f24-a621-4e16-9137-54addd3f4733 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:24.145963 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-bcf74f24-a621-4e16-9137-54addd3f4733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:24.172623 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:24.218900 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 214/407] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:24.220300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf74f24-a621-4e16-9137-54addd3f4733 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:24.246003 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be7e2d-827d-400e-b87b-daf1d373e194 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:24.290603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5d62b-6ce0-41fb-8fd9-a11fdc22cd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:24.291742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5d62b-6ce0-41fb-8fd9-a11fdc22cd1c None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:24.292172 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5d62b-6ce0-41fb-8fd9-a11fdc22cd1c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:24.292458 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5d62b-6ce0-41fb-8fd9-a11fdc22cd1c None admin] PATH_INFO: `/v3/projects/8de22bd0413a4a049d4de3e1b38ac903/groups/05ba43e65f6a48b58b397b4d8690c25a/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:24.294718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5d62b-6ce0-41fb-8fd9-a11fdc22cd1c None admin] RBAC: Authorizing `identity:create_grant(project_id=8de22bd0413a4a049d4de3e1b38ac903, group_id=05ba43e65f6a48b58b397b4d8690c25a, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:24.296201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5d62b-6ce0-41fb-8fd9-a11fdc22cd1c None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:24.327175 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:24.333899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf74f24-a621-4e16-9137-54addd3f4733 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:24.372145 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c874f19-1e8d-4cab-9660-089870b5bc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:24.373107 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c874f19-1e8d-4cab-9660-089870b5bc0e None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:24.373458 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c874f19-1e8d-4cab-9660-089870b5bc0e None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:24.373822 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c874f19-1e8d-4cab-9660-089870b5bc0e None admin] PATH_INFO: `/v3/projects/8de22bd0413a4a049d4de3e1b38ac903` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:24.375107 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c874f19-1e8d-4cab-9660-089870b5bc0e None admin] RBAC: Authorizing `identity:get_project(project_id=8de22bd0413a4a049d4de3e1b38ac903)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:24.376690 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c874f19-1e8d-4cab-9660-089870b5bc0e None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:24.383168 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 215/408] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:02:24 2022] GET /identity/v3/projects/8de22bd0413a4a049d4de3e1b38ac903 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:24.383168 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c874f19-1e8d-4cab-9660-089870b5bc0e None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:24.399508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 194/409] 10.222.0.45 () {58 vars in 1442 bytes} [Thu Jun 2 19:02:24 2022] PUT /identity/v3/projects/8de22bd0413a4a049d4de3e1b38ac903/groups/05ba43e65f6a48b58b397b4d8690c25a/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:24.400945 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5d62b-6ce0-41fb-8fd9-a11fdc22cd1c None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:24.587315 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c874f19-1e8d-4cab-9660-089870b5bc0e None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:24.629987 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632c682-4bfa-43de-9099-2829b0b609c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:24.631362 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632c682-4bfa-43de-9099-2829b0b609c9 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:24.631870 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632c682-4bfa-43de-9099-2829b0b609c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:24.632373 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632c682-4bfa-43de-9099-2829b0b609c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:24.643047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5d62b-6ce0-41fb-8fd9-a11fdc22cd1c None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:24.646814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632c682-4bfa-43de-9099-2829b0b609c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:24.655522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-6632c682-4bfa-43de-9099-2829b0b609c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:02:24.655522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:24.655522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:24.655522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:24.655522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:24.655522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:24.655522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:24.655522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:24.655522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:24.655522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:24.655522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:24.655522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:24.655522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:24.655522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:24.655522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:24.655522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:24.656598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:24.656598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:24.656598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:24.656598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:24.656598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:24.656598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:24.656598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:24.656598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:24.656598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:24.656598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:24.656598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:24.656598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:24.656598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:24.656598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:24.656598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:24.656598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:24.657397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:24.657397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:24.657397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:24.657397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:24.657397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:24.657397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:24.657397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:24.657397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:24.657397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:24.657397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:24.657397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:02:24.657397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:24.664136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 216/410] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:02:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:24.666850 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632c682-4bfa-43de-9099-2829b0b609c9 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:24.667002 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:24.712634 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:24.718962 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258caea3-73e6-4085-bbe2-d4032936b8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:24.719925 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258caea3-73e6-4085-bbe2-d4032936b8c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:24.720268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258caea3-73e6-4085-bbe2-d4032936b8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:24.720550 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258caea3-73e6-4085-bbe2-d4032936b8c0 None admin] PATH_INFO: `/v3/projects/8de22bd0413a4a049d4de3e1b38ac903/groups/05ba43e65f6a48b58b397b4d8690c25a/roles/27769697518a42139af80d8b8410ca07` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:24.723058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258caea3-73e6-4085-bbe2-d4032936b8c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=8de22bd0413a4a049d4de3e1b38ac903, group_id=05ba43e65f6a48b58b397b4d8690c25a, role_id=27769697518a42139af80d8b8410ca07)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:24.724631 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258caea3-73e6-4085-bbe2-d4032936b8c0 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:24.801409 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632c682-4bfa-43de-9099-2829b0b609c9 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:24.806751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 195/411] 10.222.0.45 () {58 vars in 1442 bytes} [Thu Jun 2 19:02:24 2022] PUT /identity/v3/projects/8de22bd0413a4a049d4de3e1b38ac903/groups/05ba43e65f6a48b58b397b4d8690c25a/roles/27769697518a42139af80d8b8410ca07 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:24.841269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd31b4b-3a2a-4289-991c-fdfa00401cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:24.841879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd31b4b-3a2a-4289-991c-fdfa00401cea None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:24.842164 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd31b4b-3a2a-4289-991c-fdfa00401cea None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:24.842734 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd31b4b-3a2a-4289-991c-fdfa00401cea None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:24.843503 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd31b4b-3a2a-4289-991c-fdfa00401cea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:24.843810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd31b4b-3a2a-4289-991c-fdfa00401cea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:24.845418 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd31b4b-3a2a-4289-991c-fdfa00401cea None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:24.852925 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0fb39-e5a1-490d-97bb-6634171ade6b None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:24.853225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0fb39-e5a1-490d-97bb-6634171ade6b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:24.853480 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0fb39-e5a1-490d-97bb-6634171ade6b None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:24.855189 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 196/412] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:02:24.855612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 217/413] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:24.861472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c733a-e1f8-4934-a86b-1c2a579aa6fc None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:24.861781 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c733a-e1f8-4934-a86b-1c2a579aa6fc None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:24.862001 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c733a-e1f8-4934-a86b-1c2a579aa6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:24.862684 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd31b4b-3a2a-4289-991c-fdfa00401cea None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:24.901166 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-817c733a-e1f8-4934-a86b-1c2a579aa6fc None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:24.902367 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-817c733a-e1f8-4934-a86b-1c2a579aa6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:24.984412 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:25.012024 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd31b4b-3a2a-4289-991c-fdfa00401cea None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:25.067654 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68ac88-3b44-4f6a-a2fc-5313c87ecdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:25.068569 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68ac88-3b44-4f6a-a2fc-5313c87ecdd1 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:25.068851 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68ac88-3b44-4f6a-a2fc-5313c87ecdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:25.069127 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68ac88-3b44-4f6a-a2fc-5313c87ecdd1 None admin] PATH_INFO: `/v3/groups/8d639b1ffe5c4804a3bce28af6a0e430` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:25.070943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68ac88-3b44-4f6a-a2fc-5313c87ecdd1 None admin] RBAC: Authorizing `identity:get_group(group_id=8d639b1ffe5c4804a3bce28af6a0e430)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:25.072479 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68ac88-3b44-4f6a-a2fc-5313c87ecdd1 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:25.074761 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 218/414] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jun 2 19:02:24 2022] GET /identity/v3/groups/8d639b1ffe5c4804a3bce28af6a0e430 => generated 229 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:25.081277 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68ac88-3b44-4f6a-a2fc-5313c87ecdd1 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:25.152402 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 197/415] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:25.182495 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c733a-e1f8-4934-a86b-1c2a579aa6fc None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:25.315830 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:25.321776 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c733a-e1f8-4934-a86b-1c2a579aa6fc None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:25.349762 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68ac88-3b44-4f6a-a2fc-5313c87ecdd1 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:25.422654 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc866dca-da8a-4102-acf5-f277dfb1c3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:25.424681 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc866dca-da8a-4102-acf5-f277dfb1c3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:25.424983 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc866dca-da8a-4102-acf5-f277dfb1c3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:25.425260 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc866dca-da8a-4102-acf5-f277dfb1c3c9 None admin] PATH_INFO: `/v3/projects/cc622f67162c4bdeb3f3fd1a3419d2ab` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:25.427732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d96ed-7871-45ef-aae9-dee3b9b710a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:25.427860 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc866dca-da8a-4102-acf5-f277dfb1c3c9 None admin] RBAC: Authorizing `identity:get_project(project_id=cc622f67162c4bdeb3f3fd1a3419d2ab)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:25.427937 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d96ed-7871-45ef-aae9-dee3b9b710a7 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:25.427937 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d96ed-7871-45ef-aae9-dee3b9b710a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:25.427937 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d96ed-7871-45ef-aae9-dee3b9b710a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:25.432020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc866dca-da8a-4102-acf5-f277dfb1c3c9 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:25.433757 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 219/416] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:02:25 2022] GET /identity/v3/projects/cc622f67162c4bdeb3f3fd1a3419d2ab => generated 344 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:25.434319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc244a-424f-4d09-ab69-940958bd7bd9 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:25.437569 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc244a-424f-4d09-ab69-940958bd7bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:25.437569 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc244a-424f-4d09-ab69-940958bd7bd9 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:25.437569 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 220/417] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:25.444046 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc244a-424f-4d09-ab69-940958bd7bd9 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:25.453437 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d96ed-7871-45ef-aae9-dee3b9b710a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:25.472027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-663d96ed-7871-45ef-aae9-dee3b9b710a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 19:02:25.472027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:25.472027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:25.472027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:25.472027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:25.472027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:25.472027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:25.472027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:25.472027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:25.472027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:25.472027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:25.472027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:25.472027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:25.472027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:25.472027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:25.472027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:25.475874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:25.475874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:25.475874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:25.475874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:25.475874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:25.475874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:25.475874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:25.475874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:25.475874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:25.475874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:25.475874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:25.475874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:25.475874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:25.475874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:25.475874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:25.475874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:25.476695 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:25.476695 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:25.476695 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:25.476695 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:25.476695 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:25.476695 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:25.476695 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:25.476695 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:25.476695 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:25.476695 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:25.476695 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 19:02:25.476695 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:25.476695 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 198/418] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jun 2 19:02:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:02:25.477354 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4538e-f355-41df-8288-642c7097c16c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:25.477354 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4538e-f355-41df-8288-642c7097c16c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:25.477908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4538e-f355-41df-8288-642c7097c16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:25.502728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:25.513241 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-02c4538e-f355-41df-8288-642c7097c16c None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:25.514444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-02c4538e-f355-41df-8288-642c7097c16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:25.627905 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc244a-424f-4d09-ab69-940958bd7bd9 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:25.640437 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 199/419] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:25.641456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4538e-f355-41df-8288-642c7097c16c None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:25.670406 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbd167-4e01-46f3-aeb3-5327df122676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:25.671440 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbd167-4e01-46f3-aeb3-5327df122676 None admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:25.671721 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbd167-4e01-46f3-aeb3-5327df122676 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:25.672012 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbd167-4e01-46f3-aeb3-5327df122676 None admin] PATH_INFO: `/v3/projects/cc622f67162c4bdeb3f3fd1a3419d2ab/groups/8d639b1ffe5c4804a3bce28af6a0e430/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:25.674811 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbd167-4e01-46f3-aeb3-5327df122676 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc622f67162c4bdeb3f3fd1a3419d2ab, group_id=8d639b1ffe5c4804a3bce28af6a0e430, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:25.676413 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbd167-4e01-46f3-aeb3-5327df122676 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:25.750933 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:25.764743 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4538e-f355-41df-8288-642c7097c16c None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:25.768578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 221/420] 10.222.0.45 () {58 vars in 1442 bytes} [Thu Jun 2 19:02:25 2022] PUT /identity/v3/projects/cc622f67162c4bdeb3f3fd1a3419d2ab/groups/8d639b1ffe5c4804a3bce28af6a0e430/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:25.769571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbd167-4e01-46f3-aeb3-5327df122676 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:25.822171 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690940b9-91d7-4532-8cb6-6ea9aeca2763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:25.822801 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690940b9-91d7-4532-8cb6-6ea9aeca2763 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:25.823085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690940b9-91d7-4532-8cb6-6ea9aeca2763 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:25.823431 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690940b9-91d7-4532-8cb6-6ea9aeca2763 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:25.824283 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690940b9-91d7-4532-8cb6-6ea9aeca2763 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:25.824594 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690940b9-91d7-4532-8cb6-6ea9aeca2763 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:25.826049 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690940b9-91d7-4532-8cb6-6ea9aeca2763 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:25.848024 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 200/421] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:02:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:25.860449 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690940b9-91d7-4532-8cb6-6ea9aeca2763 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:25.899369 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:25.923211 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbd167-4e01-46f3-aeb3-5327df122676 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:25.968903 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd349d85-eb8c-42aa-9502-c68274dfe80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:25.970360 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd349d85-eb8c-42aa-9502-c68274dfe80c None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:25.971140 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd349d85-eb8c-42aa-9502-c68274dfe80c None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:25.971643 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd349d85-eb8c-42aa-9502-c68274dfe80c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:25.985120 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd349d85-eb8c-42aa-9502-c68274dfe80c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:25.995280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-cd349d85-eb8c-42aa-9502-c68274dfe80c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:02:25.995280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:25.995280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:25.995280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:25.995280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:25.995280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:25.995280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:25.995280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:25.995280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:25.995280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:25.995280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:25.995280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:25.995280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:25.995280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:25.995280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:25.995280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:25.996270 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:25.996270 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:25.996270 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:25.996270 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:25.996270 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:25.996270 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:25.996270 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:25.996270 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:25.996270 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:25.996270 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:25.996270 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:25.996270 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:25.996270 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:25.996270 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:25.996270 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:25.996270 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:25.997068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:25.997068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:25.997068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:25.997068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:25.997068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:25.997068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:25.997068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:25.997068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:25.997068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:25.997068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:25.997068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:02:25.997068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:25.999960 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 222/422] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:26.008363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd349d85-eb8c-42aa-9502-c68274dfe80c None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:26.091462 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690940b9-91d7-4532-8cb6-6ea9aeca2763 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:26.130170 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa89049-4477-43cd-a3ac-2d27e0dc8747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:26.130840 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa89049-4477-43cd-a3ac-2d27e0dc8747 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:26.131128 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa89049-4477-43cd-a3ac-2d27e0dc8747 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:26.131409 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa89049-4477-43cd-a3ac-2d27e0dc8747 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:26.153533 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd349d85-eb8c-42aa-9502-c68274dfe80c None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:26.155720 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:26.192573 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e9bee-706f-4c83-bc82-01579d0670fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:26.193668 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e9bee-706f-4c83-bc82-01579d0670fa None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:26.194178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e9bee-706f-4c83-bc82-01579d0670fa None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:26.194667 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e9bee-706f-4c83-bc82-01579d0670fa None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:26.195646 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e9bee-706f-4c83-bc82-01579d0670fa None admin] RBAC: Adding query filter params (name=member) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:26.196231 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e9bee-706f-4c83-bc82-01579d0670fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:26.197836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e9bee-706f-4c83-bc82-01579d0670fa None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:26.207442 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa89049-4477-43cd-a3ac-2d27e0dc8747 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:26.209711 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 223/423] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:02:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:02:26.209898 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa89049-4477-43cd-a3ac-2d27e0dc8747 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:26.217513 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e9bee-706f-4c83-bc82-01579d0670fa None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:26.228438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:26.316377 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 201/424] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:02:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 19:02:26.325714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa89049-4477-43cd-a3ac-2d27e0dc8747 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:26.410790 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:26.460248 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e9bee-706f-4c83-bc82-01579d0670fa None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:26.501626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b8c07-d544-40d3-ac51-4e1fdd1dc5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:26.502214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b8c07-d544-40d3-ac51-4e1fdd1dc5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:26.502502 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b8c07-d544-40d3-ac51-4e1fdd1dc5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:26.502781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b8c07-d544-40d3-ac51-4e1fdd1dc5a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:26.539782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa89049-4477-43cd-a3ac-2d27e0dc8747 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:26.580167 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b8c07-d544-40d3-ac51-4e1fdd1dc5a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:26.581647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b8c07-d544-40d3-ac51-4e1fdd1dc5a1 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:26.584500 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:26.626127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5475d5-1039-443d-a662-769a3dde7645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:26.627407 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5475d5-1039-443d-a662-769a3dde7645 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:26.627924 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5475d5-1039-443d-a662-769a3dde7645 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:26.628461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5475d5-1039-443d-a662-769a3dde7645 None admin] PATH_INFO: `/v3/projects/3c0517c3b0534b0499d8dae17360cb89` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:26.632882 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5475d5-1039-443d-a662-769a3dde7645 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0517c3b0534b0499d8dae17360cb89)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:26.634665 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5475d5-1039-443d-a662-769a3dde7645 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:26.641251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 202/425] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:02:26 2022] GET /identity/v3/projects/3c0517c3b0534b0499d8dae17360cb89 => generated 298 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:26.646334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5475d5-1039-443d-a662-769a3dde7645 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:26.695758 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 224/426] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:02:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:26.700905 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b8c07-d544-40d3-ac51-4e1fdd1dc5a1 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:26.866156 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5475d5-1039-443d-a662-769a3dde7645 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:26.886451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:26.890213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b8c07-d544-40d3-ac51-4e1fdd1dc5a1 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:26.906887 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:26.917396 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30620a84-7b80-4382-a819-9f192dc43ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:26.918278 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30620a84-7b80-4382-a819-9f192dc43ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:26.918561 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30620a84-7b80-4382-a819-9f192dc43ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:26.918835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30620a84-7b80-4382-a819-9f192dc43ba6 None admin] PATH_INFO: `/v3/groups/05ba43e65f6a48b58b397b4d8690c25a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:26.920732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30620a84-7b80-4382-a819-9f192dc43ba6 None admin] RBAC: Authorizing `identity:get_group(group_id=05ba43e65f6a48b58b397b4d8690c25a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:26.923067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30620a84-7b80-4382-a819-9f192dc43ba6 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:26.926035 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 203/427] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jun 2 19:02:26 2022] GET /identity/v3/groups/05ba43e65f6a48b58b397b4d8690c25a => generated 226 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:02:26.933231 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30620a84-7b80-4382-a819-9f192dc43ba6 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:26.939649 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854e685-8362-4a51-94d8-2e3cdbbc00b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:26.940550 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854e685-8362-4a51-94d8-2e3cdbbc00b4 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:26.940823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854e685-8362-4a51-94d8-2e3cdbbc00b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:26.941093 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854e685-8362-4a51-94d8-2e3cdbbc00b4 None admin] PATH_INFO: `/v3/projects/3c0517c3b0534b0499d8dae17360cb89` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:26.946732 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854e685-8362-4a51-94d8-2e3cdbbc00b4 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0517c3b0534b0499d8dae17360cb89)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:26.948261 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854e685-8362-4a51-94d8-2e3cdbbc00b4 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:26.950037 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 225/428] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:02:26 2022] GET /identity/v3/projects/3c0517c3b0534b0499d8dae17360cb89 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:26.956546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854e685-8362-4a51-94d8-2e3cdbbc00b4 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:27.114047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30620a84-7b80-4382-a819-9f192dc43ba6 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:27.155233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854e685-8362-4a51-94d8-2e3cdbbc00b4 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:27.159340 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28daeda3-89db-436b-b506-6944f540990e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:27.160028 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28daeda3-89db-436b-b506-6944f540990e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:27.160311 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28daeda3-89db-436b-b506-6944f540990e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:27.160584 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28daeda3-89db-436b-b506-6944f540990e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:27.161432 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28daeda3-89db-436b-b506-6944f540990e None admin] RBAC: Adding query filter params (group.id=05ba43e65f6a48b58b397b4d8690c25a, role.id=27769697518a42139af80d8b8410ca07, scope.project.id=3c0517c3b0534b0499d8dae17360cb89) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:27.161751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28daeda3-89db-436b-b506-6944f540990e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:27.163214 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28daeda3-89db-436b-b506-6944f540990e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:27.175494 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 204/429] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Jun 2 19:02:26 2022] GET /identity/v3/role_assignments?group.id=05ba43e65f6a48b58b397b4d8690c25a&scope.project.id=3c0517c3b0534b0499d8dae17360cb89&role.id=27769697518a42139af80d8b8410ca07 => generated 611 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:02:27.176886 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56f7fd-82ac-472d-9d77-185b16a79616 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:27.177207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56f7fd-82ac-472d-9d77-185b16a79616 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:27.177487 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56f7fd-82ac-472d-9d77-185b16a79616 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:27.179124 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 205/430] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:27.185623 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a75e0-4e70-433d-9d2f-b514bb73b895 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:27.186178 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a75e0-4e70-433d-9d2f-b514bb73b895 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:27.186605 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a75e0-4e70-433d-9d2f-b514bb73b895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:27.209358 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5fd84-3032-421f-87a2-e9df846e158e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:27.210365 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5fd84-3032-421f-87a2-e9df846e158e None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:27.210724 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5fd84-3032-421f-87a2-e9df846e158e None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:27.211089 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5fd84-3032-421f-87a2-e9df846e158e None admin] PATH_INFO: `/v3/groups/05ba43e65f6a48b58b397b4d8690c25a` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:27.212531 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5fd84-3032-421f-87a2-e9df846e158e None admin] RBAC: Authorizing `identity:get_group(group_id=05ba43e65f6a48b58b397b4d8690c25a)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:27.214338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5fd84-3032-421f-87a2-e9df846e158e None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:27.220017 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 226/431] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jun 2 19:02:26 2022] GET /identity/v3/groups/05ba43e65f6a48b58b397b4d8690c25a => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:27.226273 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5fd84-3032-421f-87a2-e9df846e158e None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:27.228664 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-a85a75e0-4e70-433d-9d2f-b514bb73b895 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:27.230146 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a85a75e0-4e70-433d-9d2f-b514bb73b895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:27.315485 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:27.341001 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 206/432] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:27.369692 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a75e0-4e70-433d-9d2f-b514bb73b895 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:27.371946 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:27.463482 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5fd84-3032-421f-87a2-e9df846e158e None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:27.487202 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a75e0-4e70-433d-9d2f-b514bb73b895 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:27.510965 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc8323-e21f-474e-8cdd-b2db6b49c96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:27.511644 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc8323-e21f-474e-8cdd-b2db6b49c96d None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:27.511927 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc8323-e21f-474e-8cdd-b2db6b49c96d None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:27.512231 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc8323-e21f-474e-8cdd-b2db6b49c96d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:27.513082 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc8323-e21f-474e-8cdd-b2db6b49c96d None admin] RBAC: Adding query filter params (group.id=05ba43e65f6a48b58b397b4d8690c25a, role.id=75723f2a7ead4f5cb2885e7b63680b08, scope.project.id=3c0517c3b0534b0499d8dae17360cb89) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:27.513393 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc8323-e21f-474e-8cdd-b2db6b49c96d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:27.515508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc8323-e21f-474e-8cdd-b2db6b49c96d None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:27.525116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 227/433] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Jun 2 19:02:27 2022] GET /identity/v3/role_assignments?group.id=05ba43e65f6a48b58b397b4d8690c25a&scope.project.id=3c0517c3b0534b0499d8dae17360cb89&role.id=75723f2a7ead4f5cb2885e7b63680b08 => generated 611 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:27.534679 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40804a59-6deb-4c53-acb0-ca7cdcf81765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:27.535876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40804a59-6deb-4c53-acb0-ca7cdcf81765 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:27.536197 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40804a59-6deb-4c53-acb0-ca7cdcf81765 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:27.536473 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40804a59-6deb-4c53-acb0-ca7cdcf81765 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:27.554753 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40804a59-6deb-4c53-acb0-ca7cdcf81765 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:27.562817 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-40804a59-6deb-4c53-acb0-ca7cdcf81765 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:02:27.562817 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:27.562817 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:27.562817 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:27.562817 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:27.562817 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:27.562817 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:27.562817 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:27.562817 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:27.562817 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:27.562817 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:27.562817 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:27.562817 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:27.562817 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:27.562817 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:27.562817 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:27.563783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:27.563783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:27.563783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:27.563783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:27.563783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:27.563783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:27.563783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:27.563783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:27.563783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:27.563783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:27.563783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:27.563783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:27.563783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:27.563783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:27.563783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:27.563783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:27.564787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:27.564787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:27.564787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:27.564787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:27.564787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:27.564787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:27.564787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:27.564787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:27.564787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:27.564787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:27.564787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 19:02:27.564787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:27.564787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 207/434] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:27.571003 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc8323-e21f-474e-8cdd-b2db6b49c96d None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:27.669334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eae7ec-a0f8-4219-a9ea-529b90f6eac4 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:27.669637 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eae7ec-a0f8-4219-a9ea-529b90f6eac4 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:27.669819 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eae7ec-a0f8-4219-a9ea-529b90f6eac4 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:27.671221 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 208/435] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:27.679625 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067c967-c283-4cb2-8c27-2cab9a1df32d None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:27.680279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067c967-c283-4cb2-8c27-2cab9a1df32d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:27.680761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067c967-c283-4cb2-8c27-2cab9a1df32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:27.700700 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-e067c967-c283-4cb2-8c27-2cab9a1df32d None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:27.702311 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e067c967-c283-4cb2-8c27-2cab9a1df32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:27.725459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc8323-e21f-474e-8cdd-b2db6b49c96d None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:27.744685 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:27.761268 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:27.776548 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d750a-d317-4a8e-b593-7b73e2250815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:27.777227 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d750a-d317-4a8e-b593-7b73e2250815 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:27.777505 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d750a-d317-4a8e-b593-7b73e2250815 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:27.777797 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d750a-d317-4a8e-b593-7b73e2250815 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:27.778557 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d750a-d317-4a8e-b593-7b73e2250815 None admin] RBAC: Adding query filter params (name=member) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:27.778865 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d750a-d317-4a8e-b593-7b73e2250815 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:27.780289 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d750a-d317-4a8e-b593-7b73e2250815 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:27.783693 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 209/436] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 19:02:27.790220 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 228/437] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:02:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:27.796067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067c967-c283-4cb2-8c27-2cab9a1df32d None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:27.811759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d750a-d317-4a8e-b593-7b73e2250815 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:27.940165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067c967-c283-4cb2-8c27-2cab9a1df32d None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:27.949653 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d750a-d317-4a8e-b593-7b73e2250815 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:27.995002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226d1fc-ad02-432c-8d49-1a36138d9bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:27.995867 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226d1fc-ad02-432c-8d49-1a36138d9bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:27.996192 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226d1fc-ad02-432c-8d49-1a36138d9bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:27.996474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226d1fc-ad02-432c-8d49-1a36138d9bf1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:27.997870 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c8d82-952d-4f0f-bd0b-ac965c2e5c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:27.998537 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c8d82-952d-4f0f-bd0b-ac965c2e5c92 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:27.998812 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c8d82-952d-4f0f-bd0b-ac965c2e5c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:27.999082 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c8d82-952d-4f0f-bd0b-ac965c2e5c92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:28.009416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226d1fc-ad02-432c-8d49-1a36138d9bf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:28.018317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-8226d1fc-ad02-432c-8d49-1a36138d9bf1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 19:02:28.018317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:28.018317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:28.018317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:28.018317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:28.018317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:28.018317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:28.018317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:28.018317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:28.018317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:28.018317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:28.018317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:28.018317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:28.018317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:28.018317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:28.018317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:28.019474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:28.019474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:28.019474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:28.019474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:28.019474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:28.019474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:28.019474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:28.019474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:28.019474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:28.019474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:28.019474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:28.019474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:28.019474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:28.019474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:28.019474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:28.019474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:28.020307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:28.020307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:28.020307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:28.020307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:28.020307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:28.020307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:28.020307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:28.020307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:28.020307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:28.020307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:28.020307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 19:02:28.020307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:28.020307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 229/438] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jun 2 19:02:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:02:28.026204 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226d1fc-ad02-432c-8d49-1a36138d9bf1 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:28.061199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:28.065789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:28.104560 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c8d82-952d-4f0f-bd0b-ac965c2e5c92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:28.106154 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c8d82-952d-4f0f-bd0b-ac965c2e5c92 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:28.180368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226d1fc-ad02-432c-8d49-1a36138d9bf1 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:28.227136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655716c8-808a-4c60-a18d-04d70fb264b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:28.228290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655716c8-808a-4c60-a18d-04d70fb264b9 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:28.228831 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655716c8-808a-4c60-a18d-04d70fb264b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:28.229297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655716c8-808a-4c60-a18d-04d70fb264b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:28.230450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655716c8-808a-4c60-a18d-04d70fb264b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:28.230885 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655716c8-808a-4c60-a18d-04d70fb264b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:28.233640 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655716c8-808a-4c60-a18d-04d70fb264b9 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:28.247035 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 230/439] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:02:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:02:28.252484 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655716c8-808a-4c60-a18d-04d70fb264b9 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:28.260037 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 210/440] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:02:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 19:02:28.265457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c8d82-952d-4f0f-bd0b-ac965c2e5c92 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:28.369352 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:28.372208 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:28.386746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655716c8-808a-4c60-a18d-04d70fb264b9 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:28.396130 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c8d82-952d-4f0f-bd0b-ac965c2e5c92 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:28.432301 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c85ac6-5f63-4ed6-addf-fecc717bc569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:28.433102 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c85ac6-5f63-4ed6-addf-fecc717bc569 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:28.433260 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c85ac6-5f63-4ed6-addf-fecc717bc569 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:28.433524 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c85ac6-5f63-4ed6-addf-fecc717bc569 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:28.436329 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6631c1-1fbc-415c-a7b4-0ec571e4d4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:28.437193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6631c1-1fbc-415c-a7b4-0ec571e4d4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:28.437896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6631c1-1fbc-415c-a7b4-0ec571e4d4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:28.437896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6631c1-1fbc-415c-a7b4-0ec571e4d4f1 None admin] PATH_INFO: `/v3/projects/8de22bd0413a4a049d4de3e1b38ac903` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:28.439051 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6631c1-1fbc-415c-a7b4-0ec571e4d4f1 None admin] RBAC: Authorizing `identity:get_project(project_id=8de22bd0413a4a049d4de3e1b38ac903)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:28.440618 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6631c1-1fbc-415c-a7b4-0ec571e4d4f1 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:28.442492 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 211/441] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:02:28 2022] GET /identity/v3/projects/8de22bd0413a4a049d4de3e1b38ac903 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:02:28.448282 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6631c1-1fbc-415c-a7b4-0ec571e4d4f1 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:28.508780 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c85ac6-5f63-4ed6-addf-fecc717bc569 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:28.510474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c85ac6-5f63-4ed6-addf-fecc717bc569 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:28.550981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6631c1-1fbc-415c-a7b4-0ec571e4d4f1 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:28.587952 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537a7ef-83e1-4def-90b8-a96ec53c534b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:28.588835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537a7ef-83e1-4def-90b8-a96ec53c534b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:28.589111 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537a7ef-83e1-4def-90b8-a96ec53c534b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:28.589379 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537a7ef-83e1-4def-90b8-a96ec53c534b None admin] PATH_INFO: `/v3/groups/05ba43e65f6a48b58b397b4d8690c25a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:28.590569 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537a7ef-83e1-4def-90b8-a96ec53c534b None admin] RBAC: Authorizing `identity:get_group(group_id=05ba43e65f6a48b58b397b4d8690c25a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:28.592052 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537a7ef-83e1-4def-90b8-a96ec53c534b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:28.594151 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 212/442] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jun 2 19:02:28 2022] GET /identity/v3/groups/05ba43e65f6a48b58b397b4d8690c25a => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:02:28.599240 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2eb25-1441-44f7-b9de-6555ba9118d0 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:28.599530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2eb25-1441-44f7-b9de-6555ba9118d0 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:28.599810 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2eb25-1441-44f7-b9de-6555ba9118d0 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:28.601151 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 213/443] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:02:28.601841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2eb25-1441-44f7-b9de-6555ba9118d0 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:28.610070 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:28.610548 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:28.623201 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 231/444] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:02:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 19:02:28.623201 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb62a00-e906-4f16-84ce-57c188053c0a None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:28.623201 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb62a00-e906-4f16-84ce-57c188053c0a None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:28.623201 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb62a00-e906-4f16-84ce-57c188053c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:28.641674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-6fb62a00-e906-4f16-84ce-57c188053c0a None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:28.642900 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-6fb62a00-e906-4f16-84ce-57c188053c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:28.705670 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2eb25-1441-44f7-b9de-6555ba9118d0 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:28.709658 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 232/445] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:28.710503 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb62a00-e906-4f16-84ce-57c188053c0a None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:28.745276 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7de0e-5ca8-443f-bfe1-8a744b0ebbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:28.745933 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7de0e-5ca8-443f-bfe1-8a744b0ebbae None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:28.746219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7de0e-5ca8-443f-bfe1-8a744b0ebbae None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:28.746505 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7de0e-5ca8-443f-bfe1-8a744b0ebbae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:28.747327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7de0e-5ca8-443f-bfe1-8a744b0ebbae None admin] RBAC: Adding query filter params (group.id=05ba43e65f6a48b58b397b4d8690c25a, role.id=75723f2a7ead4f5cb2885e7b63680b08, scope.project.id=8de22bd0413a4a049d4de3e1b38ac903) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:28.747637 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7de0e-5ca8-443f-bfe1-8a744b0ebbae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:28.749116 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7de0e-5ca8-443f-bfe1-8a744b0ebbae None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:28.755695 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 214/446] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Jun 2 19:02:28 2022] GET /identity/v3/role_assignments?group.id=05ba43e65f6a48b58b397b4d8690c25a&scope.project.id=8de22bd0413a4a049d4de3e1b38ac903&role.id=75723f2a7ead4f5cb2885e7b63680b08 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:28.756542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7de0e-5ca8-443f-bfe1-8a744b0ebbae None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:28.830038 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb62a00-e906-4f16-84ce-57c188053c0a None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:28.848649 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:28.850299 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:28.870483 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eea465-ada1-410f-a572-27247a096f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:28.871368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eea465-ada1-410f-a572-27247a096f2e None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:28.871642 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eea465-ada1-410f-a572-27247a096f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:28.871919 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eea465-ada1-410f-a572-27247a096f2e None admin] PATH_INFO: `/v3/projects/8de22bd0413a4a049d4de3e1b38ac903` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:28.873334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eea465-ada1-410f-a572-27247a096f2e None admin] RBAC: Authorizing `identity:get_project(project_id=8de22bd0413a4a049d4de3e1b38ac903)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:28.874827 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eea465-ada1-410f-a572-27247a096f2e None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:28.876683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 233/447] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:02:28 2022] GET /identity/v3/projects/8de22bd0413a4a049d4de3e1b38ac903 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:28.882448 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eea465-ada1-410f-a572-27247a096f2e None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:28.889251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7de0e-5ca8-443f-bfe1-8a744b0ebbae None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:28.932401 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71a1ff-623e-4801-a0b0-883e332b2681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:28.933521 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71a1ff-623e-4801-a0b0-883e332b2681 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:28.933811 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71a1ff-623e-4801-a0b0-883e332b2681 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:28.934088 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71a1ff-623e-4801-a0b0-883e332b2681 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:28.949784 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71a1ff-623e-4801-a0b0-883e332b2681 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:28.959173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-0d71a1ff-623e-4801-a0b0-883e332b2681 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:02:28.959173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:28.959173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:28.959173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:28.959173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:28.959173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:28.959173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:28.959173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:28.959173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:28.959173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:28.959173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:28.959173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:28.959173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:28.959173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:28.959173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:28.959173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:28.960243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:28.960243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:28.960243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:28.960243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:28.960243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:28.960243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:28.960243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:28.960243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:28.960243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:28.960243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:28.960243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:28.960243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:28.960243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:28.960243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:28.960243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:28.960243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:28.961031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:28.961031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:28.961031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:28.961031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:28.961031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:28.961031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:28.961031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:28.961031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:28.961031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:28.961031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:28.961031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:02:28.961031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:28.961031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 215/448] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:02:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:28.966656 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71a1ff-623e-4801-a0b0-883e332b2681 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:28.993929 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eea465-ada1-410f-a572-27247a096f2e None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:29.035175 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed06dd-8381-4031-bf87-a04b621ee4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:29.036529 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed06dd-8381-4031-bf87-a04b621ee4ce None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:29.036808 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed06dd-8381-4031-bf87-a04b621ee4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:29.037115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed06dd-8381-4031-bf87-a04b621ee4ce None admin] PATH_INFO: `/v3/groups/05ba43e65f6a48b58b397b4d8690c25a` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:29.039381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed06dd-8381-4031-bf87-a04b621ee4ce None admin] RBAC: Authorizing `identity:get_group(group_id=05ba43e65f6a48b58b397b4d8690c25a)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:29.040930 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed06dd-8381-4031-bf87-a04b621ee4ce None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:29.042554 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 234/449] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jun 2 19:02:28 2022] GET /identity/v3/groups/05ba43e65f6a48b58b397b4d8690c25a => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:02:29.048658 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed06dd-8381-4031-bf87-a04b621ee4ce None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:29.093935 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71a1ff-623e-4801-a0b0-883e332b2681 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:29.116767 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:29.123353 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:29.143178 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3986e1e-2e21-4f3f-8680-f4fafd2315e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:29.143178 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3986e1e-2e21-4f3f-8680-f4fafd2315e2 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:29.143178 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3986e1e-2e21-4f3f-8680-f4fafd2315e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:29.143178 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3986e1e-2e21-4f3f-8680-f4fafd2315e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:29.143547 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3986e1e-2e21-4f3f-8680-f4fafd2315e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:29.143547 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3986e1e-2e21-4f3f-8680-f4fafd2315e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:29.143547 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3986e1e-2e21-4f3f-8680-f4fafd2315e2 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:29.145989 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 216/450] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:02:29.151467 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3986e1e-2e21-4f3f-8680-f4fafd2315e2 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:29.167948 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed06dd-8381-4031-bf87-a04b621ee4ce None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:29.203935 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200892d-139e-4986-b58b-64bd17a8a91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:29.205253 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200892d-139e-4986-b58b-64bd17a8a91d None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:29.205474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200892d-139e-4986-b58b-64bd17a8a91d None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:29.205743 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200892d-139e-4986-b58b-64bd17a8a91d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:29.206591 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200892d-139e-4986-b58b-64bd17a8a91d None admin] RBAC: Adding query filter params (group.id=05ba43e65f6a48b58b397b4d8690c25a, role.id=27769697518a42139af80d8b8410ca07, scope.project.id=8de22bd0413a4a049d4de3e1b38ac903) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:29.206903 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200892d-139e-4986-b58b-64bd17a8a91d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:29.208444 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200892d-139e-4986-b58b-64bd17a8a91d None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:29.215183 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 235/451] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Jun 2 19:02:29 2022] GET /identity/v3/role_assignments?group.id=05ba43e65f6a48b58b397b4d8690c25a&scope.project.id=8de22bd0413a4a049d4de3e1b38ac903&role.id=27769697518a42139af80d8b8410ca07 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:02:29.391401 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3986e1e-2e21-4f3f-8680-f4fafd2315e2 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:29.427541 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87030356-22e5-412d-baf1-9bf7f1cf02d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:29.428228 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87030356-22e5-412d-baf1-9bf7f1cf02d8 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:29.428513 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87030356-22e5-412d-baf1-9bf7f1cf02d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:29.428793 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87030356-22e5-412d-baf1-9bf7f1cf02d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:29.489447 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:29.499028 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87030356-22e5-412d-baf1-9bf7f1cf02d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:29.500523 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87030356-22e5-412d-baf1-9bf7f1cf02d8 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:29.604510 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 217/452] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:02:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:29.610113 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200892d-139e-4986-b58b-64bd17a8a91d None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:29.708358 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200892d-139e-4986-b58b-64bd17a8a91d None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:29.725579 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:29.742087 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56d2f0-0d7f-46b4-a480-47e569cb46e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:29.742941 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56d2f0-0d7f-46b4-a480-47e569cb46e1 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:29.743216 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56d2f0-0d7f-46b4-a480-47e569cb46e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:29.743485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56d2f0-0d7f-46b4-a480-47e569cb46e1 None admin] PATH_INFO: `/v3/projects/cc622f67162c4bdeb3f3fd1a3419d2ab` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:29.744661 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56d2f0-0d7f-46b4-a480-47e569cb46e1 None admin] RBAC: Authorizing `identity:get_project(project_id=cc622f67162c4bdeb3f3fd1a3419d2ab)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:29.746092 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56d2f0-0d7f-46b4-a480-47e569cb46e1 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:29.747735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 236/453] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:02:29 2022] GET /identity/v3/projects/cc622f67162c4bdeb3f3fd1a3419d2ab => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:29.753357 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87030356-22e5-412d-baf1-9bf7f1cf02d8 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:29.843114 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:29.851559 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87030356-22e5-412d-baf1-9bf7f1cf02d8 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:29.885087 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac846ba5-95da-45aa-b7c6-55c4ee279cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:29.885949 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac846ba5-95da-45aa-b7c6-55c4ee279cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:29.886229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac846ba5-95da-45aa-b7c6-55c4ee279cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:29.886620 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac846ba5-95da-45aa-b7c6-55c4ee279cd3 None admin] PATH_INFO: `/v3/groups/8d639b1ffe5c4804a3bce28af6a0e430` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:29.887770 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac846ba5-95da-45aa-b7c6-55c4ee279cd3 None admin] RBAC: Authorizing `identity:get_group(group_id=8d639b1ffe5c4804a3bce28af6a0e430)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:29.889228 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac846ba5-95da-45aa-b7c6-55c4ee279cd3 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:29.890818 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 218/454] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jun 2 19:02:29 2022] GET /identity/v3/groups/8d639b1ffe5c4804a3bce28af6a0e430 => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:29.897247 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56d2f0-0d7f-46b4-a480-47e569cb46e1 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:29.994684 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56d2f0-0d7f-46b4-a480-47e569cb46e1 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:30.027604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee05739-6b64-4eff-8cff-62a698d11cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:30.028275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee05739-6b64-4eff-8cff-62a698d11cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:30.028554 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee05739-6b64-4eff-8cff-62a698d11cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:30.028824 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee05739-6b64-4eff-8cff-62a698d11cc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:30.029642 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee05739-6b64-4eff-8cff-62a698d11cc0 None admin] RBAC: Adding query filter params (group.id=8d639b1ffe5c4804a3bce28af6a0e430, role.id=4588ca63994f4e2d9ce482d475edbabd, scope.project.id=cc622f67162c4bdeb3f3fd1a3419d2ab) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:30.029953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee05739-6b64-4eff-8cff-62a698d11cc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:30.031390 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee05739-6b64-4eff-8cff-62a698d11cc0 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:30.037358 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 237/455] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Jun 2 19:02:29 2022] GET /identity/v3/role_assignments?group.id=8d639b1ffe5c4804a3bce28af6a0e430&scope.project.id=cc622f67162c4bdeb3f3fd1a3419d2ab&role.id=4588ca63994f4e2d9ce482d475edbabd => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:32.686275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241ddcc-cf43-4edf-a71e-1b54c3012c96 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:32.687404 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241ddcc-cf43-4edf-a71e-1b54c3012c96 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:32.687911 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241ddcc-cf43-4edf-a71e-1b54c3012c96 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:32.690038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 219/456] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:32.696350 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85040648-2d80-43c2-b7eb-5c1192c74f0d None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:32.697347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85040648-2d80-43c2-b7eb-5c1192c74f0d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:32.697837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85040648-2d80-43c2-b7eb-5c1192c74f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:32.729035 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-85040648-2d80-43c2-b7eb-5c1192c74f0d None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:32.730600 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-85040648-2d80-43c2-b7eb-5c1192c74f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:32.800177 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:32.834972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 238/457] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 19:02:32.883189 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241ddcc-cf43-4edf-a71e-1b54c3012c96 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:33.041793 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241ddcc-cf43-4edf-a71e-1b54c3012c96 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:33.072939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b302a2-c444-4fbe-8e19-7bc5a124139d None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:33.073280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b302a2-c444-4fbe-8e19-7bc5a124139d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:33.073488 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b302a2-c444-4fbe-8e19-7bc5a124139d None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:33.076388 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 239/458] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:33.081302 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53faa58-300f-488e-addb-d3bef76e57ad None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:33.081589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53faa58-300f-488e-addb-d3bef76e57ad None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:33.081862 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53faa58-300f-488e-addb-d3bef76e57ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:33.100931 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963265a3-7834-4b7d-96fc-d1b8cf7e049a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:33.101800 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963265a3-7834-4b7d-96fc-d1b8cf7e049a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:33.102026 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963265a3-7834-4b7d-96fc-d1b8cf7e049a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:33.102308 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963265a3-7834-4b7d-96fc-d1b8cf7e049a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:33.106926 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-a53faa58-300f-488e-addb-d3bef76e57ad None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:33.108395 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-a53faa58-300f-488e-addb-d3bef76e57ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:33.129763 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963265a3-7834-4b7d-96fc-d1b8cf7e049a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:33.136500 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963265a3-7834-4b7d-96fc-d1b8cf7e049a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:33.162609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-963265a3-7834-4b7d-96fc-d1b8cf7e049a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:33.162609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:33.162609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:33.162609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:33.162609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:33.162609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:33.162609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:33.162609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:33.162609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:33.162609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:33.162609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:33.162609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:33.162609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:33.162609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:33.162609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:33.163563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:33.163563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:33.163563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:33.163563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:33.163563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:33.163563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:33.163563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:33.163563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:33.163563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:33.163563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:33.163563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:33.163563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:33.163563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:33.163563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:33.163563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:33.163563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:33.163563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:33.164484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:33.164484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:33.164484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:33.164484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:33.166789 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 220/459] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:33.172505 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963265a3-7834-4b7d-96fc-d1b8cf7e049a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:33.204328 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:33.244515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 240/460] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:33.269073 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53faa58-300f-488e-addb-d3bef76e57ad None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:33.336115 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963265a3-7834-4b7d-96fc-d1b8cf7e049a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:33.377782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95397b70-58c8-4463-be3d-2117d50baf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:33.378463 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95397b70-58c8-4463-be3d-2117d50baf19 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:33.378747 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95397b70-58c8-4463-be3d-2117d50baf19 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:33.379023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95397b70-58c8-4463-be3d-2117d50baf19 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:33.379757 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95397b70-58c8-4463-be3d-2117d50baf19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:33.380208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95397b70-58c8-4463-be3d-2117d50baf19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:33.381745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95397b70-58c8-4463-be3d-2117d50baf19 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:33.402615 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 221/461] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:33.402615 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3afec-95f1-4e80-9de8-2b01acf1836e None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:33.402615 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3afec-95f1-4e80-9de8-2b01acf1836e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:33.402615 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3afec-95f1-4e80-9de8-2b01acf1836e None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:33.402615 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 222/462] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:33.403778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3afec-95f1-4e80-9de8-2b01acf1836e None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:33.411387 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53faa58-300f-488e-addb-d3bef76e57ad None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:33.428738 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:33.463138 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7d71e-679d-4ca2-a567-777d9d92ef80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:33.464777 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7d71e-679d-4ca2-a567-777d9d92ef80 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:33.465257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7d71e-679d-4ca2-a567-777d9d92ef80 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:33.465753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7d71e-679d-4ca2-a567-777d9d92ef80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:33.480588 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca7d71e-679d-4ca2-a567-777d9d92ef80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:33.483379 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca7d71e-679d-4ca2-a567-777d9d92ef80 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:33.487240 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:33.510997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-cca7d71e-679d-4ca2-a567-777d9d92ef80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:33.510997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:33.510997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:33.510997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:33.510997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:33.510997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:33.510997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:33.510997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:33.510997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:33.510997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:33.510997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:33.510997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:33.510997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:33.510997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:33.510997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:33.511912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:33.511912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:33.511912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:33.511912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:33.511912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:33.511912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:33.511912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:33.511912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:33.511912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:33.511912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:33.511912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:33.511912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:33.511912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:33.511912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:33.511912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:33.511912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:33.511912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:33.512834 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:33.512834 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:33.512834 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:33.512834 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:33.513595 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 241/463] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:02:33.514582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b8983-49f7-4b81-8a9e-e5bd59865a5c None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:33.514868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b8983-49f7-4b81-8a9e-e5bd59865a5c None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:33.515143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b8983-49f7-4b81-8a9e-e5bd59865a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:33.525698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3afec-95f1-4e80-9de8-2b01acf1836e None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:33.533133 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-c29b8983-49f7-4b81-8a9e-e5bd59865a5c None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:33.534372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c29b8983-49f7-4b81-8a9e-e5bd59865a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:33.563853 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50184ba0-d76a-4f68-8100-53aa2d679c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:33.564559 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50184ba0-d76a-4f68-8100-53aa2d679c83 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:33.564886 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50184ba0-d76a-4f68-8100-53aa2d679c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:33.565112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50184ba0-d76a-4f68-8100-53aa2d679c83 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:33.565819 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50184ba0-d76a-4f68-8100-53aa2d679c83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:33.567249 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50184ba0-d76a-4f68-8100-53aa2d679c83 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:33.603581 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 242/464] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:33.604390 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b8983-49f7-4b81-8a9e-e5bd59865a5c None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:33.679931 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 223/465] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jun 2 19:02:33 2022] POST /identity/v3/users => generated 246 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:33.685909 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d4959-21a2-4ff8-9e84-b14530150b7b None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:33.686216 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d4959-21a2-4ff8-9e84-b14530150b7b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:33.692325 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d4959-21a2-4ff8-9e84-b14530150b7b None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:33.692325 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 224/466] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:33.696877 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d4959-21a2-4ff8-9e84-b14530150b7b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:33.716330 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:33.727681 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b8983-49f7-4b81-8a9e-e5bd59865a5c None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:33.772217 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290890ab-df32-4345-9916-507541f156dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:33.772795 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290890ab-df32-4345-9916-507541f156dc None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:33.773182 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290890ab-df32-4345-9916-507541f156dc None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:33.773529 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290890ab-df32-4345-9916-507541f156dc None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:33.774431 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290890ab-df32-4345-9916-507541f156dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:33.774805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290890ab-df32-4345-9916-507541f156dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:33.776642 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290890ab-df32-4345-9916-507541f156dc None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:33.797136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 243/467] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:33.798607 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd6854-501e-4a54-8c58-95fc01ca43b8 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:33.798970 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd6854-501e-4a54-8c58-95fc01ca43b8 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:33.799475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd6854-501e-4a54-8c58-95fc01ca43b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:33.821870 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-b3bd6854-501e-4a54-8c58-95fc01ca43b8 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:33.823316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-b3bd6854-501e-4a54-8c58-95fc01ca43b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:33.861167 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d4959-21a2-4ff8-9e84-b14530150b7b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:33.894884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:33.910959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383837e-3eac-420f-b659-1d9ce1317658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:33.912053 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383837e-3eac-420f-b659-1d9ce1317658 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:33.912185 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383837e-3eac-420f-b659-1d9ce1317658 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:33.912407 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383837e-3eac-420f-b659-1d9ce1317658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:33.925344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383837e-3eac-420f-b659-1d9ce1317658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:33.926822 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383837e-3eac-420f-b659-1d9ce1317658 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:33.936964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 244/468] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:33.940134 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd6854-501e-4a54-8c58-95fc01ca43b8 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:33.951058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-0383837e-3eac-420f-b659-1d9ce1317658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:33.951058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:33.951058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:33.951058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:33.951058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:33.951058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:33.951058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:33.951058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:33.951058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:33.951058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:33.951058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:33.951058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:33.951058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:33.951058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:33.951058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:33.951946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:33.951946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:33.951946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:33.951946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:33.951946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:33.951946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:33.951946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:33.951946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:33.951946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:33.951946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:33.951946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:33.951946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:33.951946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:33.951946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:33.951946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:33.951946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:33.951946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:33.952870 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:33.952870 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:33.952870 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:33.952870 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:33.958142 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 225/469] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:33.959217 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383837e-3eac-420f-b659-1d9ce1317658 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:34.071173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:34.094149 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd6854-501e-4a54-8c58-95fc01ca43b8 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:34.100493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383837e-3eac-420f-b659-1d9ce1317658 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:34.133023 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf50f6-5d7a-44ea-8913-6050805ac88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:34.133659 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf50f6-5d7a-44ea-8913-6050805ac88e None admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:34.133940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf50f6-5d7a-44ea-8913-6050805ac88e None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:34.134211 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf50f6-5d7a-44ea-8913-6050805ac88e None admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:34.134927 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf50f6-5d7a-44ea-8913-6050805ac88e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:34.136448 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf50f6-5d7a-44ea-8913-6050805ac88e None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:34.146192 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644b84b-7b37-451c-b52b-246efe3ddfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:34.147359 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644b84b-7b37-451c-b52b-246efe3ddfaf None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:34.148115 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644b84b-7b37-451c-b52b-246efe3ddfaf None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:34.148404 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644b84b-7b37-451c-b52b-246efe3ddfaf None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:34.149309 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f644b84b-7b37-451c-b52b-246efe3ddfaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:34.149620 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f644b84b-7b37-451c-b52b-246efe3ddfaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:34.151123 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f644b84b-7b37-451c-b52b-246efe3ddfaf None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:34.165080 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 226/470] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:34.169612 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644b84b-7b37-451c-b52b-246efe3ddfaf None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:34.221324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:34.232438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 245/471] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jun 2 19:02:33 2022] POST /identity/v3/users => generated 248 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:34.233627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf50f6-5d7a-44ea-8913-6050805ac88e None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:34.349385 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644b84b-7b37-451c-b52b-246efe3ddfaf None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:34.402758 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f4026-a536-470c-979a-2d51ad6601d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:34.403949 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f4026-a536-470c-979a-2d51ad6601d9 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:34.404569 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f4026-a536-470c-979a-2d51ad6601d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:34.405053 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f4026-a536-470c-979a-2d51ad6601d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:34.421328 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f4026-a536-470c-979a-2d51ad6601d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:34.424397 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f4026-a536-470c-979a-2d51ad6601d9 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:34.469672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-823f4026-a536-470c-979a-2d51ad6601d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:34.469672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:34.469672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:34.469672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:34.469672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:34.469672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:34.469672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:34.469672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:34.469672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:34.469672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:34.469672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:34.469672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:34.469672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:34.469672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:34.469672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:34.471183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:34.471183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:34.471183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:34.471183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:34.471183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:34.471183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:34.471183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:34.471183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:34.471183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:34.471183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:34.471183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:34.471183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:34.471183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:34.471183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:34.471183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:34.471183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:34.471183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:34.472680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:34.472680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:34.472680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:34.472680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:34.472680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 227/472] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:34.478216 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f4026-a536-470c-979a-2d51ad6601d9 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:34.480880 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf50f6-5d7a-44ea-8913-6050805ac88e None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:34.526269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c275f1f-4bc2-442e-8b30-c38500f0f617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:34.526975 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c275f1f-4bc2-442e-8b30-c38500f0f617 None admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:34.527242 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c275f1f-4bc2-442e-8b30-c38500f0f617 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:34.527597 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c275f1f-4bc2-442e-8b30-c38500f0f617 None admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:34.528293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c275f1f-4bc2-442e-8b30-c38500f0f617 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:34.529907 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c275f1f-4bc2-442e-8b30-c38500f0f617 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:34.541953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:34.606976 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:34.616832 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f4026-a536-470c-979a-2d51ad6601d9 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:34.652678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c6715-79dc-4bd9-9015-e82718073131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:34.653651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c6715-79dc-4bd9-9015-e82718073131 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:34.654083 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c6715-79dc-4bd9-9015-e82718073131 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:34.654522 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c6715-79dc-4bd9-9015-e82718073131 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:34.655413 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c6715-79dc-4bd9-9015-e82718073131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:34.655863 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c6715-79dc-4bd9-9015-e82718073131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:34.658005 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c6715-79dc-4bd9-9015-e82718073131 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:34.669744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 228/473] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:02:34.671313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed89e2-2ca8-41ca-a74d-02ee12bc5251 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:34.671740 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed89e2-2ca8-41ca-a74d-02ee12bc5251 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:34.672190 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed89e2-2ca8-41ca-a74d-02ee12bc5251 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:34.674458 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 229/474] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:34.681855 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed89e2-2ca8-41ca-a74d-02ee12bc5251 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:34.684714 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 246/475] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jun 2 19:02:34 2022] POST /identity/v3/users => generated 248 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:34.686086 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd76f4-bfa1-4a49-8bcc-14f5bc7638c0 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:34.692195 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd76f4-bfa1-4a49-8bcc-14f5bc7638c0 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:34.692195 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd76f4-bfa1-4a49-8bcc-14f5bc7638c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:34.710307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-6ccd76f4-bfa1-4a49-8bcc-14f5bc7638c0 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:34.711674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-6ccd76f4-bfa1-4a49-8bcc-14f5bc7638c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:34.821076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 247/476] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:34.847672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed89e2-2ca8-41ca-a74d-02ee12bc5251 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:34.892940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd76f4-bfa1-4a49-8bcc-14f5bc7638c0 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:34.906230 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef1b46-09d8-4bfc-901d-415d5934c1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:34.907242 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef1b46-09d8-4bfc-901d-415d5934c1db None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:34.908296 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef1b46-09d8-4bfc-901d-415d5934c1db None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:34.908715 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef1b46-09d8-4bfc-901d-415d5934c1db None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:34.909593 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef1b46-09d8-4bfc-901d-415d5934c1db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:34.912634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef1b46-09d8-4bfc-901d-415d5934c1db None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:35.012122 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 230/477] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jun 2 19:02:34 2022] POST /identity/v3/users => generated 249 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:02:35.031780 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd76f4-bfa1-4a49-8bcc-14f5bc7638c0 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:35.061464 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:35.074711 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0cb6b-9f42-4bdc-acdd-a3bbabf73b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:35.075414 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0cb6b-9f42-4bdc-acdd-a3bbabf73b28 None admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:35.075714 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0cb6b-9f42-4bdc-acdd-a3bbabf73b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:35.075986 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0cb6b-9f42-4bdc-acdd-a3bbabf73b28 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:35.076788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0cb6b-9f42-4bdc-acdd-a3bbabf73b28 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:35.078225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0cb6b-9f42-4bdc-acdd-a3bbabf73b28 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:35.125537 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.sql.core [None req-45c0cb6b-9f42-4bdc-acdd-a3bbabf73b28 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 19:02:35.125537 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 02 19:02:35.125537 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [parameters: {'id': '81586b3f2bcb44509274b511463d5e25', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 02 19:02:35.125537 dv-cinder-797608-28-smb devstack@keystone.service[80608]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80608) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 19:02:35.143823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-45c0cb6b-9f42-4bdc-acdd-a3bbabf73b28 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 02 19:02:35.143823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:35.143823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 19:02:35.143823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 19:02:35.143823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 19:02:35.143823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 19:02:35.143823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 19:02:35.143823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 19:02:35.143823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 19:02:35.143823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application conn.query(q) Jun 02 19:02:35.143823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 19:02:35.143823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 19:02:35.143823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 19:02:35.143823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application result.read() Jun 02 19:02:35.143823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 19:02:35.144816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 19:02:35.144816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 19:02:35.144816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 19:02:35.144816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 19:02:35.144816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 19:02:35.144816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 19:02:35.144816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 19:02:35.144816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 19:02:35.144816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:35.144816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 19:02:35.144816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:35.144816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:35.144816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 19:02:35.144816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 19:02:35.144816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 02 19:02:35.144816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return ref.to_dict() Jun 02 19:02:35.144816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 19:02:35.144816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application next(self.gen) Jun 02 19:02:35.145772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 19:02:35.145772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application yield resource Jun 02 19:02:35.145772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 19:02:35.145772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application next(self.gen) Jun 02 19:02:35.145772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 19:02:35.145772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 19:02:35.145772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 19:02:35.145772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 19:02:35.145772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 19:02:35.145772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise self.value Jun 02 19:02:35.145772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 19:02:35.145772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 19:02:35.145772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 19:02:35.145772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application session.commit() Jun 02 19:02:35.145772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 19:02:35.145772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 19:02:35.145772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 19:02:35.146677 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 19:02:35.146677 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 19:02:35.146677 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self.session.flush() Jun 02 19:02:35.146677 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 19:02:35.146677 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 19:02:35.146677 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 19:02:35.146677 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 19:02:35.146677 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 19:02:35.146677 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application compat.raise_( Jun 02 19:02:35.146677 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 19:02:35.146677 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception Jun 02 19:02:35.146677 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 19:02:35.146677 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 19:02:35.146677 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 19:02:35.146677 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 19:02:35.146677 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 19:02:35.146677 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 19:02:35.147602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 19:02:35.147602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 19:02:35.147602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 02 19:02:35.147602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 02 19:02:35.147602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 19:02:35.147602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 19:02:35.147602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 19:02:35.147602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 19:02:35.147602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 19:02:35.147602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 19:02:35.147602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 19:02:35.147602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 19:02:35.147602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 19:02:35.147602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 19:02:35.147602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 19:02:35.147602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception Jun 02 19:02:35.148450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 19:02:35.148450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 19:02:35.148450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 19:02:35.148450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 19:02:35.148450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 19:02:35.148450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 19:02:35.148450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 19:02:35.148450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application conn.query(q) Jun 02 19:02:35.148450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 19:02:35.148450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 19:02:35.148450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 19:02:35.148450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application result.read() Jun 02 19:02:35.148450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 19:02:35.148450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 19:02:35.148450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 19:02:35.148450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 19:02:35.149233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 19:02:35.149233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 19:02:35.149233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 19:02:35.149233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 19:02:35.149233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 19:02:35.149233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 02 19:02:35.149233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [parameters: {'id': '81586b3f2bcb44509274b511463d5e25', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 02 19:02:35.149233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 19:02:35.149233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:35.149233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:02:35.149233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:35.149233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:35.149233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:35.149233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:35.149233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:35.149233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:35.150025 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:35.150025 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:35.150025 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:35.150025 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:35.150025 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:35.150025 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:35.150025 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 02 19:02:35.150025 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 02 19:02:35.150025 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:35.150025 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:35.150025 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 02 19:02:35.150025 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 02 19:02:35.150025 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 19:02:35.150025 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 19:02:35.150025 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 02 19:02:35.150025 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:35.153345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 248/478] 10.222.0.45 () {60 vars in 1131 bytes} [Thu Jun 2 19:02:34 2022] POST /identity/v3/roles => generated 144 bytes in 253 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:02:35.153483 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef1b46-09d8-4bfc-901d-415d5934c1db None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:35.166803 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:35.282991 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef1b46-09d8-4bfc-901d-415d5934c1db None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:35.319445 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c11fa-1b9b-4a36-ae50-3a2cfbeab539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:35.320340 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c11fa-1b9b-4a36-ae50-3a2cfbeab539 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:35.320627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c11fa-1b9b-4a36-ae50-3a2cfbeab539 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:35.320903 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c11fa-1b9b-4a36-ae50-3a2cfbeab539 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:35.331942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c11fa-1b9b-4a36-ae50-3a2cfbeab539 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:35.340225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-424c11fa-1b9b-4a36-ae50-3a2cfbeab539 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 19:02:35.340225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:35.340225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:35.340225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:35.340225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:35.340225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:35.340225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:35.340225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:35.340225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:35.340225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:35.340225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:35.340225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:35.340225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:35.340225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:35.340225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:35.340225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:35.342479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:35.342479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:35.342479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:35.342479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:35.342479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:35.342479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:35.342479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:35.342479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:35.342479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:35.342479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:35.342479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:35.342479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:35.342479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:35.342479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:35.342479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:35.342479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:35.344446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:35.344446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:35.344446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:35.344446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:35.344446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:35.344446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:35.344446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:35.344446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:35.344446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:35.344446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:35.344446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 19:02:35.344446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:35.344446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 231/479] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jun 2 19:02:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:35.348553 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0cb6b-9f42-4bdc-acdd-a3bbabf73b28 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:35.457160 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0cb6b-9f42-4bdc-acdd-a3bbabf73b28 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:35.493674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475621b-14bd-41db-9645-af2a99b2ab5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:35.494697 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475621b-14bd-41db-9645-af2a99b2ab5d None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:35.495198 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475621b-14bd-41db-9645-af2a99b2ab5d None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:35.495679 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475621b-14bd-41db-9645-af2a99b2ab5d None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:35.496672 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475621b-14bd-41db-9645-af2a99b2ab5d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:35.497171 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475621b-14bd-41db-9645-af2a99b2ab5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:35.498736 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475621b-14bd-41db-9645-af2a99b2ab5d None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:35.508108 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 249/480] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:02:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:36.485105 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6598e8-a529-4783-9fca-ace3b3214151 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:36.485678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6598e8-a529-4783-9fca-ace3b3214151 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:36.485678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6598e8-a529-4783-9fca-ace3b3214151 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:36.487409 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 232/481] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:36.493952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83353df8-ba9d-47a0-b688-676f31418929 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:36.494929 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83353df8-ba9d-47a0-b688-676f31418929 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:36.495447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83353df8-ba9d-47a0-b688-676f31418929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:36.515966 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-83353df8-ba9d-47a0-b688-676f31418929 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:36.517796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-83353df8-ba9d-47a0-b688-676f31418929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:36.581425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:36.604072 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 250/482] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:36.638238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6598e8-a529-4783-9fca-ace3b3214151 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:36.740473 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:36.759801 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6598e8-a529-4783-9fca-ace3b3214151 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:36.803547 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfae75-794c-43a5-8405-ea6ea88dcc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:36.804399 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfae75-794c-43a5-8405-ea6ea88dcc94 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:36.804680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfae75-794c-43a5-8405-ea6ea88dcc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:36.804953 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfae75-794c-43a5-8405-ea6ea88dcc94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:36.817008 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfae75-794c-43a5-8405-ea6ea88dcc94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:36.824850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-eebfae75-794c-43a5-8405-ea6ea88dcc94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:36.824850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:36.824850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:36.824850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:36.824850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:36.824850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:36.824850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:36.824850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:36.824850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:36.824850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:36.824850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:36.824850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:36.824850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:36.824850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:36.824850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:36.824850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:36.825748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:36.825748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:36.825748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:36.825748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:36.825748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:36.825748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:36.825748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:36.825748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:36.825748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:36.825748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:36.825748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:36.825748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:36.825748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:36.825748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:36.825748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:36.825748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:36.826574 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:36.826574 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:36.826574 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:36.826574 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:36.826574 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:36.826574 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:36.826574 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:36.826574 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:36.826574 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:36.826574 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:36.826574 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:36.826574 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:36.826574 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 233/483] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jun 2 19:02:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:36.832808 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83353df8-ba9d-47a0-b688-676f31418929 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:36.954830 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca876f0e-665e-4557-83d5-0a4400662292 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:36.955481 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca876f0e-665e-4557-83d5-0a4400662292 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:36.955958 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca876f0e-665e-4557-83d5-0a4400662292 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:36.957721 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 234/484] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:36.966407 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3e098-4b88-4f56-b3ae-9f23a74668ae None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:36.966407 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3e098-4b88-4f56-b3ae-9f23a74668ae None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:36.966407 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3e098-4b88-4f56-b3ae-9f23a74668ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:36.970259 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83353df8-ba9d-47a0-b688-676f31418929 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:37.009213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95b7c9-83d0-4d37-82b6-f45c200a2200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:37.009437 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-66f3e098-4b88-4f56-b3ae-9f23a74668ae None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:37.010271 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95b7c9-83d0-4d37-82b6-f45c200a2200 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:37.010595 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-66f3e098-4b88-4f56-b3ae-9f23a74668ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:37.010866 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95b7c9-83d0-4d37-82b6-f45c200a2200 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:37.011281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95b7c9-83d0-4d37-82b6-f45c200a2200 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:37.012323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95b7c9-83d0-4d37-82b6-f45c200a2200 None admin] RBAC: Adding query filter params (name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:37.012794 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95b7c9-83d0-4d37-82b6-f45c200a2200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:37.014731 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95b7c9-83d0-4d37-82b6-f45c200a2200 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:37.026517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 251/485] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jun 2 19:02:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:37.032918 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95b7c9-83d0-4d37-82b6-f45c200a2200 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:37.120398 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:37.175476 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 235/486] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:37.203932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95b7c9-83d0-4d37-82b6-f45c200a2200 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:37.221430 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3e098-4b88-4f56-b3ae-9f23a74668ae None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:37.251626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e73165-b5ae-4ed4-add5-27ca8c179a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:37.252761 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e73165-b5ae-4ed4-add5-27ca8c179a3f None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:37.253190 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e73165-b5ae-4ed4-add5-27ca8c179a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:37.253768 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e73165-b5ae-4ed4-add5-27ca8c179a3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:37.267753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e73165-b5ae-4ed4-add5-27ca8c179a3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:37.269526 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e73165-b5ae-4ed4-add5-27ca8c179a3f None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:37.290896 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-62e73165-b5ae-4ed4-add5-27ca8c179a3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:37.290896 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:37.290896 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:37.290896 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:37.290896 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:37.290896 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:37.290896 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:37.290896 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:37.290896 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:37.290896 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:37.290896 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:37.290896 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:37.290896 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:37.290896 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:37.290896 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:37.292011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:37.292011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:37.292011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:37.292011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:37.292011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:37.292011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:37.292011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:37.292011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:37.292011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:37.292011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:37.292011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:37.292011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:37.292011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:37.292011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:37.292011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:37.292011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:37.292011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:37.293065 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:37.293065 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:37.293065 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:37.293065 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:37.295020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 252/487] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:37.301815 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e73165-b5ae-4ed4-add5-27ca8c179a3f None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:37.379108 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:37.425800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e73165-b5ae-4ed4-add5-27ca8c179a3f None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:37.427835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:37.464631 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8361c-e577-498c-aad6-08ee50e43c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:37.465682 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8361c-e577-498c-aad6-08ee50e43c2a None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:37.466165 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8361c-e577-498c-aad6-08ee50e43c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:37.466636 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8361c-e577-498c-aad6-08ee50e43c2a None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:37.467826 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8361c-e577-498c-aad6-08ee50e43c2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:37.468390 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8361c-e577-498c-aad6-08ee50e43c2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:37.470043 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8361c-e577-498c-aad6-08ee50e43c2a None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:37.484140 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 253/488] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:02:37.490439 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8361c-e577-498c-aad6-08ee50e43c2a None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:37.503052 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3e098-4b88-4f56-b3ae-9f23a74668ae None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:37.576957 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ba208-74dc-4112-87a2-d0e784bc8746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:37.577624 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ba208-74dc-4112-87a2-d0e784bc8746 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:37.577906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ba208-74dc-4112-87a2-d0e784bc8746 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:37.578177 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ba208-74dc-4112-87a2-d0e784bc8746 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:37.590237 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ba208-74dc-4112-87a2-d0e784bc8746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:37.599509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-c25ba208-74dc-4112-87a2-d0e784bc8746 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:37.599509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:37.599509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:37.599509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:37.599509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:37.599509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:37.599509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:37.599509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:37.599509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:37.599509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:37.599509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:37.599509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:37.599509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:37.599509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:37.599509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:37.599509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:37.600456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:37.600456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:37.600456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:37.600456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:37.600456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:37.600456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:37.600456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:37.600456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:37.600456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:37.600456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:37.600456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:37.600456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:37.600456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:37.600456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:37.600456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:37.600456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:37.601257 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:37.601257 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:37.601257 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:37.601257 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:37.601257 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:37.601257 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:37.601257 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:37.601257 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:37.601257 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:37.601257 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:37.601257 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:37.601257 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:37.601257 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 236/489] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jun 2 19:02:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:37.602491 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c52aaf-7b7b-44c7-90c0-9c8cbd081824 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:37.602715 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c52aaf-7b7b-44c7-90c0-9c8cbd081824 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:37.602994 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c52aaf-7b7b-44c7-90c0-9c8cbd081824 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:37.604982 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8361c-e577-498c-aad6-08ee50e43c2a None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:37.608811 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 237/490] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:37.609327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c52aaf-7b7b-44c7-90c0-9c8cbd081824 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:37.645448 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c3595-68b6-4566-bda7-48138fbd20a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:37.646735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c3595-68b6-4566-bda7-48138fbd20a9 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:37.647334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c3595-68b6-4566-bda7-48138fbd20a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:37.647803 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c3595-68b6-4566-bda7-48138fbd20a9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:37.656255 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c3595-68b6-4566-bda7-48138fbd20a9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:37.658810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c3595-68b6-4566-bda7-48138fbd20a9 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:37.677287 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-242c3595-68b6-4566-bda7-48138fbd20a9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 19:02:37.677287 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:37.677287 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:37.677287 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:37.677287 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:37.677287 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:37.677287 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:37.677287 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:37.677287 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:37.677287 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:37.677287 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:37.677287 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:37.677287 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:02:37.677287 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:02:37.677287 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:02:37.677287 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:02:37.678213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:37.678213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:37.678213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:02:37.678213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:37.678213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:02:37.678213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:37.678213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:37.678213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:37.678213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:37.678213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:37.678213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:37.678213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:37.678213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:37.678213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:37.678213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:37.678213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:37.678213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:37.678213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:37.679097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:37.679097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:37.679097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:02:37.679097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:02:37.679097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:02:37.679097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:02:37.679097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:02:37.679097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:02:37.679097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 19:02:37.679097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:37.681904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 254/491] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Jun 2 19:02:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:02:37.687784 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61ab97-12b4-412c-9d58-7cd50963fcc0 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:37.688328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61ab97-12b4-412c-9d58-7cd50963fcc0 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:37.689500 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61ab97-12b4-412c-9d58-7cd50963fcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:37.708444 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-3b61ab97-12b4-412c-9d58-7cd50963fcc0 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:37.710097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-3b61ab97-12b4-412c-9d58-7cd50963fcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:37.716181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c52aaf-7b7b-44c7-90c0-9c8cbd081824 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:37.728759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:37.737026 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:37.755032 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3c948-8c23-47ec-bbfb-7ebd376eabbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:37.755984 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3c948-8c23-47ec-bbfb-7ebd376eabbd None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:37.756512 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3c948-8c23-47ec-bbfb-7ebd376eabbd None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:37.756931 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3c948-8c23-47ec-bbfb-7ebd376eabbd None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:37.758743 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3c948-8c23-47ec-bbfb-7ebd376eabbd None admin] RBAC: Adding query filter params (name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:37.759914 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3c948-8c23-47ec-bbfb-7ebd376eabbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:37.761471 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3c948-8c23-47ec-bbfb-7ebd376eabbd None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:37.772487 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 238/492] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jun 2 19:02:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:37.773693 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3c948-8c23-47ec-bbfb-7ebd376eabbd None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:37.806604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 255/493] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:37.807840 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61ab97-12b4-412c-9d58-7cd50963fcc0 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:37.913172 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3c948-8c23-47ec-bbfb-7ebd376eabbd None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:37.920696 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61ab97-12b4-412c-9d58-7cd50963fcc0 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:37.951440 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48b2d4-5102-4aed-a7e0-6d42b06f2f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:37.952169 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48b2d4-5102-4aed-a7e0-6d42b06f2f07 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:37.952455 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48b2d4-5102-4aed-a7e0-6d42b06f2f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:37.952727 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48b2d4-5102-4aed-a7e0-6d42b06f2f07 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:37.953723 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48b2d4-5102-4aed-a7e0-6d42b06f2f07 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:37.954038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48b2d4-5102-4aed-a7e0-6d42b06f2f07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:37.955692 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48b2d4-5102-4aed-a7e0-6d42b06f2f07 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:37.969342 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fcc98-4ac8-4512-b0bd-68b86d3b4d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:37.971105 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fcc98-4ac8-4512-b0bd-68b86d3b4d95 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:37.971596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fcc98-4ac8-4512-b0bd-68b86d3b4d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:37.972144 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fcc98-4ac8-4512-b0bd-68b86d3b4d95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:37.984810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163fcc98-4ac8-4512-b0bd-68b86d3b4d95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:37.987239 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163fcc98-4ac8-4512-b0bd-68b86d3b4d95 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:37.990579 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:37.999284 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 239/494] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Jun 2 19:02:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:38.000607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48b2d4-5102-4aed-a7e0-6d42b06f2f07 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:38.015407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-163fcc98-4ac8-4512-b0bd-68b86d3b4d95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:38.015407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:38.015407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:38.015407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:38.015407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:38.015407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:38.015407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:38.015407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:38.015407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:38.015407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:38.015407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:38.015407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:38.015407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:38.015407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:38.015407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:38.016363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:38.016363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:38.016363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:38.016363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:38.016363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:38.016363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:38.016363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:38.016363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:38.016363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:38.016363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:38.016363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:38.016363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:38.016363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:38.016363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:38.016363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:38.016363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:38.016363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:38.017858 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:38.017858 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:38.017858 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:38.017858 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:38.018859 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 256/495] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:38.019543 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fcc98-4ac8-4512-b0bd-68b86d3b4d95 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:38.054642 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:38.138000 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48b2d4-5102-4aed-a7e0-6d42b06f2f07 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:38.147229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fcc98-4ac8-4512-b0bd-68b86d3b4d95 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:38.188412 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f590b-0fe9-4b10-ad15-f41210b0935e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:38.189537 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f590b-0fe9-4b10-ad15-f41210b0935e None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:38.189826 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f590b-0fe9-4b10-ad15-f41210b0935e None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:38.190106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f590b-0fe9-4b10-ad15-f41210b0935e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:38.191352 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f3058-7f55-4916-af42-55fdd0722e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:38.192438 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f3058-7f55-4916-af42-55fdd0722e04 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:38.193333 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f3058-7f55-4916-af42-55fdd0722e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:38.193811 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f3058-7f55-4916-af42-55fdd0722e04 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:38.209392 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f3058-7f55-4916-af42-55fdd0722e04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:38.220926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-1e7f3058-7f55-4916-af42-55fdd0722e04 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:38.220926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:38.220926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:38.220926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:38.220926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:38.220926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:38.220926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:38.220926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:38.220926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:38.220926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:38.220926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:38.220926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:38.220926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:38.220926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:38.220926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:38.220926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:38.221823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:38.221823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:38.221823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:38.221823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:38.221823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:38.221823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:38.221823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:38.221823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:38.221823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:38.221823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:38.221823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:38.221823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:38.221823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:38.221823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:38.221823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:38.221823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:38.222630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:38.222630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:38.222630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:38.222630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:38.222630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:38.222630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:38.222630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:38.222630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:38.222630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:38.222630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:38.222630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:38.222630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:38.230167 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 240/496] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jun 2 19:02:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:38.230167 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f3058-7f55-4916-af42-55fdd0722e04 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:38.274702 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:38.285284 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f590b-0fe9-4b10-ad15-f41210b0935e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:38.294584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f590b-0fe9-4b10-ad15-f41210b0935e None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:38.349398 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:38.353631 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f3058-7f55-4916-af42-55fdd0722e04 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:38.395038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11756f-563b-4219-821b-a67fc5622b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:38.395708 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11756f-563b-4219-821b-a67fc5622b66 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:38.396014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11756f-563b-4219-821b-a67fc5622b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:38.396307 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11756f-563b-4219-821b-a67fc5622b66 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:38.397034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11756f-563b-4219-821b-a67fc5622b66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:38.397344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11756f-563b-4219-821b-a67fc5622b66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:38.402398 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11756f-563b-4219-821b-a67fc5622b66 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:38.402539 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 257/497] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:02:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:38.402539 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f590b-0fe9-4b10-ad15-f41210b0935e None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:38.412752 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 241/498] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:38.415066 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015792c-29d7-471f-96f4-6f4de51dbf83 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:38.415588 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015792c-29d7-471f-96f4-6f4de51dbf83 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:38.416247 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015792c-29d7-471f-96f4-6f4de51dbf83 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:38.418583 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 242/499] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:38.419712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015792c-29d7-471f-96f4-6f4de51dbf83 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:38.504731 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:38.510873 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f590b-0fe9-4b10-ad15-f41210b0935e None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:38.533627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015792c-29d7-471f-96f4-6f4de51dbf83 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:38.544598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f87b5-0716-4a1d-b493-4ede901729f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:38.545268 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f87b5-0716-4a1d-b493-4ede901729f0 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:38.545543 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f87b5-0716-4a1d-b493-4ede901729f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:38.545811 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f87b5-0716-4a1d-b493-4ede901729f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:38.546547 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f87b5-0716-4a1d-b493-4ede901729f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:38.546848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f87b5-0716-4a1d-b493-4ede901729f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:38.548757 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f87b5-0716-4a1d-b493-4ede901729f0 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:38.556602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 258/500] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jun 2 19:02:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:38.557391 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f87b5-0716-4a1d-b493-4ede901729f0 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:38.573048 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a32b95-eb1f-4569-b571-f153c308fb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:38.573840 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a32b95-eb1f-4569-b571-f153c308fb5d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:38.574128 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a32b95-eb1f-4569-b571-f153c308fb5d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:38.574407 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a32b95-eb1f-4569-b571-f153c308fb5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:38.585188 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a32b95-eb1f-4569-b571-f153c308fb5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:38.586651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a32b95-eb1f-4569-b571-f153c308fb5d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:38.604395 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-e4a32b95-eb1f-4569-b571-f153c308fb5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:38.604395 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:38.604395 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:38.604395 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:38.604395 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:38.604395 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:38.604395 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:38.604395 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:38.604395 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:38.604395 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:38.604395 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:38.604395 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:38.604395 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:38.604395 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:38.604395 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:38.605321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:38.605321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:38.605321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:38.605321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:38.605321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:38.605321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:38.605321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:38.605321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:38.605321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:38.605321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:38.605321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:38.605321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:38.605321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:38.605321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:38.605321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:38.605321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:38.605321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:38.606173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:38.606173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:38.606173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:38.606173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:38.606173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 243/501] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:38.606781 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6f353-d1e9-4422-9099-8a882b2fb423 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:38.607047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6f353-d1e9-4422-9099-8a882b2fb423 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:38.607321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6f353-d1e9-4422-9099-8a882b2fb423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:38.623929 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-1aa6f353-d1e9-4422-9099-8a882b2fb423 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:38.625243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1aa6f353-d1e9-4422-9099-8a882b2fb423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:38.627964 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:38.658910 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f87b5-0716-4a1d-b493-4ede901729f0 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:38.690564 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 244/502] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:38.691864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55de87c-27c4-4105-ba7a-402c34787390 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:38.692194 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55de87c-27c4-4105-ba7a-402c34787390 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:38.692467 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55de87c-27c4-4105-ba7a-402c34787390 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:38.692723 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d84f41-96e0-4fb1-b171-ba044b998bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:38.693518 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d84f41-96e0-4fb1-b171-ba044b998bea None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:38.696140 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 245/503] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:38.696282 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d84f41-96e0-4fb1-b171-ba044b998bea None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:38.696282 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d84f41-96e0-4fb1-b171-ba044b998bea None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:38.696429 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55de87c-27c4-4105-ba7a-402c34787390 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:38.709851 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d84f41-96e0-4fb1-b171-ba044b998bea None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:38.711447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d84f41-96e0-4fb1-b171-ba044b998bea None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:38.730397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-f9d84f41-96e0-4fb1-b171-ba044b998bea None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 19:02:38.730397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:38.730397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:38.730397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:38.730397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:38.730397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:38.730397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:38.730397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:38.730397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:38.730397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:38.730397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:38.730397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:38.730397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:02:38.730397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:02:38.730397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:02:38.730397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:02:38.731474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:38.731474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:38.731474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:02:38.731474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:38.731474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:02:38.731474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:38.731474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:38.731474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:38.731474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:38.731474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:38.731474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:38.731474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:38.731474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:38.731474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:38.731474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:38.731474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:38.731474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:38.731474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:38.732546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:38.732546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:38.732546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:02:38.732546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:02:38.732546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:02:38.732546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:02:38.732546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:02:38.732546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:02:38.732546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 19:02:38.732546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:38.732546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 259/504] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:38.733115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d84f41-96e0-4fb1-b171-ba044b998bea None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:38.752769 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:38.806784 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55de87c-27c4-4105-ba7a-402c34787390 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:38.833629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d84f41-96e0-4fb1-b171-ba044b998bea None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:38.841439 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a26453-815f-4b4b-98bd-9e803a1b59be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:38.842496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a26453-815f-4b4b-98bd-9e803a1b59be None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:38.842783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a26453-815f-4b4b-98bd-9e803a1b59be None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:38.843053 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a26453-815f-4b4b-98bd-9e803a1b59be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:38.851751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:38.853979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a26453-815f-4b4b-98bd-9e803a1b59be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:38.855446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a26453-815f-4b4b-98bd-9e803a1b59be None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:38.867985 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25213d63-1157-421d-9ce8-01204a8b98fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:38.868755 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25213d63-1157-421d-9ce8-01204a8b98fb None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:38.869044 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25213d63-1157-421d-9ce8-01204a8b98fb None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:38.869325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25213d63-1157-421d-9ce8-01204a8b98fb None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:38.870067 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25213d63-1157-421d-9ce8-01204a8b98fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:38.870403 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25213d63-1157-421d-9ce8-01204a8b98fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:38.871783 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25213d63-1157-421d-9ce8-01204a8b98fb None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:38.873350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-c5a26453-815f-4b4b-98bd-9e803a1b59be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:38.873350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:38.873350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:38.873350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:38.873350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:38.873350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:38.873350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:38.873350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:38.873350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:38.873350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:38.873350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:38.873350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:38.873350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:38.873350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:38.873350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:38.874186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:38.874186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:38.874186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:38.874186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:38.874186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:38.874186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:38.874186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:38.874186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:38.874186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:38.874186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:38.874186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:38.874186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:38.874186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:38.874186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:38.874186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:38.874186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:38.874186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:38.875056 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:38.875056 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:38.875056 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:38.875056 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:38.875056 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 246/505] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:38.875785 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66096cfb-0e50-4fc5-af34-89e45d419c28 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:38.876077 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66096cfb-0e50-4fc5-af34-89e45d419c28 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:38.876351 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66096cfb-0e50-4fc5-af34-89e45d419c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:38.888811 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 260/506] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:38.888811 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25213d63-1157-421d-9ce8-01204a8b98fb None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:38.894884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-66096cfb-0e50-4fc5-af34-89e45d419c28 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:38.896102 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-66096cfb-0e50-4fc5-af34-89e45d419c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:38.961798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 247/507] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:38.962644 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66096cfb-0e50-4fc5-af34-89e45d419c28 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:38.964527 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:38.986942 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25213d63-1157-421d-9ce8-01204a8b98fb None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:39.021759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a95e5-a329-4aed-9ce2-320528f60d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:39.022551 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a95e5-a329-4aed-9ce2-320528f60d36 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:39.022831 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a95e5-a329-4aed-9ce2-320528f60d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:39.023103 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a95e5-a329-4aed-9ce2-320528f60d36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:39.033687 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a95e5-a329-4aed-9ce2-320528f60d36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:39.041347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-065a95e5-a329-4aed-9ce2-320528f60d36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:39.041347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:39.041347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:39.041347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:39.041347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:39.041347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:39.041347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:39.041347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:39.041347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:39.041347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:39.041347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:39.041347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:39.041347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:39.041347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:39.041347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:39.041347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:39.042262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:39.042262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:39.042262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:39.042262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:39.042262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:39.042262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:39.042262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:39.042262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:39.042262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:39.042262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:39.042262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:39.042262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:39.042262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:39.042262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:39.042262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:39.042262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:39.043302 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:39.043302 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:39.043302 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:39.043302 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:39.043302 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:39.043302 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:39.043302 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:39.043302 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:39.043302 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:39.043302 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:39.043302 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:39.043302 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:39.043302 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 261/508] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jun 2 19:02:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:39.043302 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a95e5-a329-4aed-9ce2-320528f60d36 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:39.077502 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66096cfb-0e50-4fc5-af34-89e45d419c28 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:39.102664 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:39.114677 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43a695-63db-4e7a-b214-8d48f143e888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:39.115365 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43a695-63db-4e7a-b214-8d48f143e888 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:39.115643 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43a695-63db-4e7a-b214-8d48f143e888 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:39.115912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43a695-63db-4e7a-b214-8d48f143e888 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:39.116841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43a695-63db-4e7a-b214-8d48f143e888 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:39.117148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43a695-63db-4e7a-b214-8d48f143e888 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:39.118582 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43a695-63db-4e7a-b214-8d48f143e888 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:39.136014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 248/509] 10.222.0.45 () {56 vars in 1137 bytes} [Thu Jun 2 19:02:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:39.136846 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43a695-63db-4e7a-b214-8d48f143e888 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:39.145735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a95e5-a329-4aed-9ce2-320528f60d36 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:39.180421 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5b1dd-fcd0-437d-a212-6e636c03eb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:39.181114 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5b1dd-fcd0-437d-a212-6e636c03eb3c None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:39.181403 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5b1dd-fcd0-437d-a212-6e636c03eb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:39.181681 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5b1dd-fcd0-437d-a212-6e636c03eb3c None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:39.182433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5b1dd-fcd0-437d-a212-6e636c03eb3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:39.182742 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5b1dd-fcd0-437d-a212-6e636c03eb3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:39.184194 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5b1dd-fcd0-437d-a212-6e636c03eb3c None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:39.192745 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:39.198026 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 262/510] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:39.199010 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5b1dd-fcd0-437d-a212-6e636c03eb3c None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:39.246004 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43a695-63db-4e7a-b214-8d48f143e888 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:39.280086 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674a2e1-59e2-44b6-b709-af31c5737f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:39.280872 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674a2e1-59e2-44b6-b709-af31c5737f98 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:39.281149 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674a2e1-59e2-44b6-b709-af31c5737f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:39.281419 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674a2e1-59e2-44b6-b709-af31c5737f98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:39.288077 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674a2e1-59e2-44b6-b709-af31c5737f98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:39.289505 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674a2e1-59e2-44b6-b709-af31c5737f98 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:39.298526 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5b1dd-fcd0-437d-a212-6e636c03eb3c None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:39.303979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-e674a2e1-59e2-44b6-b709-af31c5737f98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:39.303979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:39.303979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:39.303979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:39.303979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:39.303979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:39.303979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:39.303979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:39.303979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:39.303979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:39.303979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:39.303979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:39.303979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:02:39.303979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:02:39.303979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:02:39.304820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:02:39.304820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:39.304820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:39.304820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:39.304820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:39.304820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:39.304820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:39.304820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:39.304820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:39.304820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:39.304820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:39.304820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:39.304820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:39.304820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:39.304820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:39.304820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:39.304820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:39.305672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:02:39.305672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:02:39.305672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:02:39.305672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:02:39.305672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:02:39.305672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:02:39.305672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:39.305672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:39.305672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 249/511] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:02:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:39.306274 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674a2e1-59e2-44b6-b709-af31c5737f98 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:39.337411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00a92b-0fab-4a78-acec-58fccd7e5cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:39.338242 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00a92b-0fab-4a78-acec-58fccd7e5cce None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:39.338531 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00a92b-0fab-4a78-acec-58fccd7e5cce None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:39.338809 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00a92b-0fab-4a78-acec-58fccd7e5cce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:39.349057 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:39.349912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00a92b-0fab-4a78-acec-58fccd7e5cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:39.351417 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00a92b-0fab-4a78-acec-58fccd7e5cce None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:39.369676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-9a00a92b-0fab-4a78-acec-58fccd7e5cce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:39.369676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:39.369676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:39.369676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:39.369676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:39.369676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:39.369676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:39.369676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:39.369676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:39.369676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:39.369676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:39.369676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:39.369676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:39.369676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:39.369676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:39.370711 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:39.370711 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:39.370711 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:39.370711 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:39.370711 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:39.370711 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:39.370711 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:39.370711 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:39.370711 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:39.370711 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:39.370711 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:39.370711 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:39.370711 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:39.370711 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:39.370711 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:39.370711 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:39.370711 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:39.371755 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:39.371755 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:39.371755 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:39.371755 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:39.373275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 263/512] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:39.374215 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00a92b-0fab-4a78-acec-58fccd7e5cce None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:39.416481 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674a2e1-59e2-44b6-b709-af31c5737f98 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:39.426462 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:39.459699 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6aa7ff-be73-4b59-a667-3933df2ad0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:39.460402 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6aa7ff-be73-4b59-a667-3933df2ad0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:39.460688 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6aa7ff-be73-4b59-a667-3933df2ad0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:39.461012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6aa7ff-be73-4b59-a667-3933df2ad0a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:39.461767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6aa7ff-be73-4b59-a667-3933df2ad0a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:39.462074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6aa7ff-be73-4b59-a667-3933df2ad0a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:39.463454 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6aa7ff-be73-4b59-a667-3933df2ad0a9 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:39.471792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 250/513] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jun 2 19:02:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:39.471792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6aa7ff-be73-4b59-a667-3933df2ad0a9 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:39.476577 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00a92b-0fab-4a78-acec-58fccd7e5cce None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:39.511711 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aab8c8-596a-4474-8b6c-a626a27fcc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:39.512398 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aab8c8-596a-4474-8b6c-a626a27fcc80 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:39.512684 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aab8c8-596a-4474-8b6c-a626a27fcc80 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:39.512963 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aab8c8-596a-4474-8b6c-a626a27fcc80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:39.577325 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6aa7ff-be73-4b59-a667-3933df2ad0a9 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:39.578885 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:39.583726 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aab8c8-596a-4474-8b6c-a626a27fcc80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:39.585256 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aab8c8-596a-4474-8b6c-a626a27fcc80 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:39.615181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25923ed3-2484-4ae9-baa7-81ca139d0d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:39.615901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25923ed3-2484-4ae9-baa7-81ca139d0d03 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:39.616209 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25923ed3-2484-4ae9-baa7-81ca139d0d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:39.616486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25923ed3-2484-4ae9-baa7-81ca139d0d03 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:39.624152 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25923ed3-2484-4ae9-baa7-81ca139d0d03 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:39.625592 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25923ed3-2484-4ae9-baa7-81ca139d0d03 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:39.634424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:39.641381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-25923ed3-2484-4ae9-baa7-81ca139d0d03 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 19:02:39.641381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:39.641381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:39.641381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:39.641381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:39.641381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:39.641381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:39.641381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:39.641381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:39.641381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:39.641381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:39.641381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:39.641381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:02:39.641381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:02:39.641381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:02:39.641381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:02:39.645326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:39.645326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:39.645326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:02:39.645326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:39.645326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:02:39.645326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:39.645326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:39.645326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:39.645326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:39.645326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:39.645326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:39.645326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:39.645326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:39.645326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:39.645326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:39.645326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:39.645326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:39.645326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:39.646248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:39.646248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:39.646248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:02:39.646248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:02:39.646248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:02:39.646248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:02:39.646248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:02:39.646248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:02:39.646248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 19:02:39.646248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:39.646248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 251/514] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:39.646248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25923ed3-2484-4ae9-baa7-81ca139d0d03 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:39.687550 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 264/515] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:02:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:39.688457 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aab8c8-596a-4474-8b6c-a626a27fcc80 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:39.749037 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25923ed3-2484-4ae9-baa7-81ca139d0d03 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:39.785479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6516a-09d0-4d8d-92eb-b006d0bde8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:39.794284 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6516a-09d0-4d8d-92eb-b006d0bde8e4 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:39.794284 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6516a-09d0-4d8d-92eb-b006d0bde8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:39.794284 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6516a-09d0-4d8d-92eb-b006d0bde8e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:39.794284 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6516a-09d0-4d8d-92eb-b006d0bde8e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:39.794284 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6516a-09d0-4d8d-92eb-b006d0bde8e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:39.794284 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6516a-09d0-4d8d-92eb-b006d0bde8e4 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:39.800274 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aab8c8-596a-4474-8b6c-a626a27fcc80 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:39.810095 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 252/516] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:02:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:39.811180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6516a-09d0-4d8d-92eb-b006d0bde8e4 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:39.837159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:39.839384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e981f-ba6e-4869-be52-ef6c92a26082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:39.840083 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e981f-ba6e-4869-be52-ef6c92a26082 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:39.840364 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e981f-ba6e-4869-be52-ef6c92a26082 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:39.840635 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e981f-ba6e-4869-be52-ef6c92a26082 None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:39.841351 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e981f-ba6e-4869-be52-ef6c92a26082 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:39.841655 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e981f-ba6e-4869-be52-ef6c92a26082 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:39.843360 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e981f-ba6e-4869-be52-ef6c92a26082 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:39.855724 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 265/517] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:39.856678 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e981f-ba6e-4869-be52-ef6c92a26082 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:39.871390 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:39.916105 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6516a-09d0-4d8d-92eb-b006d0bde8e4 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:39.949709 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f1a15-f6fb-430e-80c5-ab823b9cebcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:39.950497 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f1a15-f6fb-430e-80c5-ab823b9cebcf None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:39.950776 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f1a15-f6fb-430e-80c5-ab823b9cebcf None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:39.951051 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f1a15-f6fb-430e-80c5-ab823b9cebcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:39.961210 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e981f-ba6e-4869-be52-ef6c92a26082 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:39.962232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f1a15-f6fb-430e-80c5-ab823b9cebcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:39.963716 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f1a15-f6fb-430e-80c5-ab823b9cebcf None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:39.981579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-024f1a15-f6fb-430e-80c5-ab823b9cebcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:39.981579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:39.981579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:39.981579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:39.981579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:39.981579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:39.981579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:39.981579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:39.981579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:39.981579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:39.981579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:39.981579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:39.981579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:39.981579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:39.981579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:39.982626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:39.982626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:39.982626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:39.982626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:39.982626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:39.982626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:39.982626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:39.982626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:39.982626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:39.982626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:39.982626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:39.982626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:39.982626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:39.982626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:39.982626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:39.982626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:39.982626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:39.983712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:39.983712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:39.983712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:39.983712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:39.983712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 253/518] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:39.984064 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f1a15-f6fb-430e-80c5-ab823b9cebcf None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:39.998935 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6e570-fd2d-4ecf-a435-f51f2c9206f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:39.999612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6e570-fd2d-4ecf-a435-f51f2c9206f8 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:39.999895 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6e570-fd2d-4ecf-a435-f51f2c9206f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:40.000204 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6e570-fd2d-4ecf-a435-f51f2c9206f8 None admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:40.001778 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6e570-fd2d-4ecf-a435-f51f2c9206f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:40.002096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6e570-fd2d-4ecf-a435-f51f2c9206f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:40.003609 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6e570-fd2d-4ecf-a435-f51f2c9206f8 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:40.043443 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 266/519] 10.222.0.45 () {56 vars in 1137 bytes} [Thu Jun 2 19:02:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:40.044367 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6e570-fd2d-4ecf-a435-f51f2c9206f8 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:40.066401 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:40.095740 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f1a15-f6fb-430e-80c5-ab823b9cebcf None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:40.121786 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:40.132605 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c7d24-f812-4b9f-8188-0284e108d0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:40.133418 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c7d24-f812-4b9f-8188-0284e108d0cc None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:40.133707 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c7d24-f812-4b9f-8188-0284e108d0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:40.133959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c7d24-f812-4b9f-8188-0284e108d0cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:40.145579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c7d24-f812-4b9f-8188-0284e108d0cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:40.147141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c7d24-f812-4b9f-8188-0284e108d0cc None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:40.156841 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6e570-fd2d-4ecf-a435-f51f2c9206f8 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:40.165963 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-509c7d24-f812-4b9f-8188-0284e108d0cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:40.165963 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:40.165963 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:40.165963 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:40.165963 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:40.165963 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:40.165963 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:40.165963 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:40.165963 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:40.165963 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:40.165963 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:40.165963 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:40.165963 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:40.165963 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:40.165963 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:40.167038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:40.167038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:40.167038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:40.167038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:40.167038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:40.167038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:40.167038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:40.167038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:40.167038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:40.167038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:40.167038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:40.167038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:40.167038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:40.167038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:40.167038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:40.167038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:40.167038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:40.167938 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:40.167938 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:40.167938 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:40.167938 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:40.167938 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 254/520] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:40.168541 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c7d24-f812-4b9f-8188-0284e108d0cc None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:40.194172 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833945a9-6384-46c9-85bd-e0ee1fea5e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:40.194838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833945a9-6384-46c9-85bd-e0ee1fea5e0c None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:40.195122 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833945a9-6384-46c9-85bd-e0ee1fea5e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:40.195399 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833945a9-6384-46c9-85bd-e0ee1fea5e0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:40.196266 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833945a9-6384-46c9-85bd-e0ee1fea5e0c None admin] RBAC: Adding query filter params (role.id=13ff8a5ffa5648c28ec00aa75b69d913, scope.project.id=b11b7e66a993492d8163097bce955c0b, user.id=575f61ef70314f86b5d9dad3ba1b3aab) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:40.196576 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833945a9-6384-46c9-85bd-e0ee1fea5e0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:40.198023 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833945a9-6384-46c9-85bd-e0ee1fea5e0c None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:40.203587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 267/521] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:02:40 2022] GET /identity/v3/role_assignments?user.id=575f61ef70314f86b5d9dad3ba1b3aab&scope.project.id=b11b7e66a993492d8163097bce955c0b&role.id=13ff8a5ffa5648c28ec00aa75b69d913 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:40.204401 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833945a9-6384-46c9-85bd-e0ee1fea5e0c None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:40.298568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c7d24-f812-4b9f-8188-0284e108d0cc None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:40.328158 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:40.337848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833945a9-6384-46c9-85bd-e0ee1fea5e0c None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:40.338454 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3344d-6d66-42a5-8a77-ed7abb59a2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:40.339144 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3344d-6d66-42a5-8a77-ed7abb59a2bd None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:40.339560 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3344d-6d66-42a5-8a77-ed7abb59a2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:40.341292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3344d-6d66-42a5-8a77-ed7abb59a2bd None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:40.341292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3344d-6d66-42a5-8a77-ed7abb59a2bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:40.342355 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3344d-6d66-42a5-8a77-ed7abb59a2bd None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:40.371983 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:40.377592 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816537ec-1214-4463-9b3d-05d3c61f54f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:40.378313 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816537ec-1214-4463-9b3d-05d3c61f54f2 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:40.378599 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816537ec-1214-4463-9b3d-05d3c61f54f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:40.378877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816537ec-1214-4463-9b3d-05d3c61f54f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:40.379622 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816537ec-1214-4463-9b3d-05d3c61f54f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:40.379931 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816537ec-1214-4463-9b3d-05d3c61f54f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:40.381390 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816537ec-1214-4463-9b3d-05d3c61f54f2 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:40.395085 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 268/522] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:40.396174 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816537ec-1214-4463-9b3d-05d3c61f54f2 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:40.438225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 255/523] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jun 2 19:02:40 2022] POST /identity/v3/users => generated 247 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:40.439704 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3344d-6d66-42a5-8a77-ed7abb59a2bd None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:40.521764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816537ec-1214-4463-9b3d-05d3c61f54f2 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:40.564370 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f55d6-4fe7-4b9a-860f-c39235bd72b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:40.565402 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f55d6-4fe7-4b9a-860f-c39235bd72b7 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:40.565912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f55d6-4fe7-4b9a-860f-c39235bd72b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:40.566385 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f55d6-4fe7-4b9a-860f-c39235bd72b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:40.592235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3344d-6d66-42a5-8a77-ed7abb59a2bd None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:40.633044 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3be09a-1980-4b27-b3bd-6ff095d8a036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:40.633746 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3be09a-1980-4b27-b3bd-6ff095d8a036 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:40.634041 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3be09a-1980-4b27-b3bd-6ff095d8a036 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:40.634416 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3be09a-1980-4b27-b3bd-6ff095d8a036 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:40.635244 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3be09a-1980-4b27-b3bd-6ff095d8a036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:40.635558 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3be09a-1980-4b27-b3bd-6ff095d8a036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:40.637195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3be09a-1980-4b27-b3bd-6ff095d8a036 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:40.638259 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:40.650234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f55d6-4fe7-4b9a-860f-c39235bd72b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:40.651858 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f55d6-4fe7-4b9a-860f-c39235bd72b7 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:40.653092 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 256/524] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:40.654318 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3be09a-1980-4b27-b3bd-6ff095d8a036 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:40.705978 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:40.774801 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 269/525] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:02:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:40.776404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f55d6-4fe7-4b9a-860f-c39235bd72b7 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:40.782204 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3be09a-1980-4b27-b3bd-6ff095d8a036 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:40.826474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608fe08-6352-4340-a9b7-d2832d29c01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:40.827868 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608fe08-6352-4340-a9b7-d2832d29c01a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:40.828447 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608fe08-6352-4340-a9b7-d2832d29c01a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:40.829020 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608fe08-6352-4340-a9b7-d2832d29c01a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:40.837925 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608fe08-6352-4340-a9b7-d2832d29c01a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:40.839741 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608fe08-6352-4340-a9b7-d2832d29c01a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:40.856362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-a608fe08-6352-4340-a9b7-d2832d29c01a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 19:02:40.856362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:40.856362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:40.856362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:40.856362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:40.856362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:40.856362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:40.856362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:40.856362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:40.856362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:40.856362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:40.856362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:40.856362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:02:40.856362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:02:40.856362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:02:40.856362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:02:40.857315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:40.857315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:40.857315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:02:40.857315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:40.857315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:02:40.857315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:40.857315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:40.857315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:40.857315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:40.857315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:40.857315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:40.857315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:40.857315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:40.857315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:40.857315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:40.857315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:40.857315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:40.857315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:40.858196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:40.858196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:40.858196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:02:40.858196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:02:40.858196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:02:40.858196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:02:40.858196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:02:40.858196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:02:40.858196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 19:02:40.858196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:40.861151 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 257/526] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jun 2 19:02:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:40.862327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608fe08-6352-4340-a9b7-d2832d29c01a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:40.899818 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:40.909512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f55d6-4fe7-4b9a-860f-c39235bd72b7 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:40.946436 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa4ec6-058a-4a57-8c3f-51a642f2f8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:40.947612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa4ec6-058a-4a57-8c3f-51a642f2f8ec None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:40.948133 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa4ec6-058a-4a57-8c3f-51a642f2f8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:40.948613 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa4ec6-058a-4a57-8c3f-51a642f2f8ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:40.956659 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa4ec6-058a-4a57-8c3f-51a642f2f8ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:40.958397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa4ec6-058a-4a57-8c3f-51a642f2f8ec None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:40.974199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-22fa4ec6-058a-4a57-8c3f-51a642f2f8ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:40.974199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:40.974199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:40.974199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:40.974199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:40.974199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:40.974199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:40.974199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:40.974199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:40.974199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:40.974199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:40.974199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:40.974199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:02:40.974199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:02:40.974199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:02:40.975110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:02:40.975110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:40.975110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:40.975110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:40.975110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:40.975110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:40.975110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:40.975110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:40.975110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:40.975110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:40.975110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:40.975110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:40.975110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:40.975110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:40.975110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:40.975110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:40.975110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:40.975970 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:02:40.975970 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:02:40.975970 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:02:40.975970 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:02:40.975970 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:02:40.975970 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:02:40.975970 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:40.975970 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:40.978202 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 270/527] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:02:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:40.979383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa4ec6-058a-4a57-8c3f-51a642f2f8ec None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:40.984674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608fe08-6352-4340-a9b7-d2832d29c01a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:40.986972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:41.026417 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621434d0-508a-427e-8c04-f923a305f531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:41.027217 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621434d0-508a-427e-8c04-f923a305f531 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:41.027497 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621434d0-508a-427e-8c04-f923a305f531 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:41.027769 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621434d0-508a-427e-8c04-f923a305f531 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:41.040538 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621434d0-508a-427e-8c04-f923a305f531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:41.041698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621434d0-508a-427e-8c04-f923a305f531 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:41.060838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-621434d0-508a-427e-8c04-f923a305f531 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:41.060838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:41.060838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:41.060838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:41.060838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:41.060838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:41.060838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:41.060838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:41.060838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:41.060838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:41.060838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:41.060838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:41.060838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:41.060838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:41.060838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:41.061761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:41.061761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:41.061761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:41.061761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:41.061761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:41.061761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:41.061761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:41.061761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:41.061761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:41.061761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:41.061761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:41.061761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:41.061761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:41.061761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:41.061761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:41.061761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:41.061761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:41.063201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:41.063201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:41.063201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:41.063201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:41.063201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 258/528] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:41.064064 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621434d0-508a-427e-8c04-f923a305f531 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:41.094535 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa4ec6-058a-4a57-8c3f-51a642f2f8ec None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:41.131281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d777626-533f-4cbb-9f22-a330ed291f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:41.132481 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d777626-533f-4cbb-9f22-a330ed291f8b None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:41.132989 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d777626-533f-4cbb-9f22-a330ed291f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:41.133466 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d777626-533f-4cbb-9f22-a330ed291f8b None admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:41.134500 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d777626-533f-4cbb-9f22-a330ed291f8b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:41.135007 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d777626-533f-4cbb-9f22-a330ed291f8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:41.136696 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d777626-533f-4cbb-9f22-a330ed291f8b None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:41.156041 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 271/529] 10.222.0.45 () {56 vars in 1139 bytes} [Thu Jun 2 19:02:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:41.157349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d777626-533f-4cbb-9f22-a330ed291f8b None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:41.169937 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:41.176515 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621434d0-508a-427e-8c04-f923a305f531 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:41.213063 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2665c6-38ea-4256-9a85-66395f342c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:41.213755 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2665c6-38ea-4256-9a85-66395f342c2b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:41.214037 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2665c6-38ea-4256-9a85-66395f342c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:41.214312 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2665c6-38ea-4256-9a85-66395f342c2b None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:41.215333 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2665c6-38ea-4256-9a85-66395f342c2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:41.215529 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2665c6-38ea-4256-9a85-66395f342c2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:41.217365 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2665c6-38ea-4256-9a85-66395f342c2b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:41.232801 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 259/530] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:02:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:41.233442 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2665c6-38ea-4256-9a85-66395f342c2b None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:41.255914 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:41.269612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d777626-533f-4cbb-9f22-a330ed291f8b None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:41.306582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd27f0-e334-4d60-a873-04eb18bf24b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:41.307666 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd27f0-e334-4d60-a873-04eb18bf24b6 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:41.308194 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd27f0-e334-4d60-a873-04eb18bf24b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:41.308670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd27f0-e334-4d60-a873-04eb18bf24b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:41.309598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd27f0-e334-4d60-a873-04eb18bf24b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:41.310102 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd27f0-e334-4d60-a873-04eb18bf24b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:41.311735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd27f0-e334-4d60-a873-04eb18bf24b6 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:41.324962 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 272/531] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:41.326172 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd27f0-e334-4d60-a873-04eb18bf24b6 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:41.351444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2665c6-38ea-4256-9a85-66395f342c2b None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:41.392763 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a949b-0b9f-4c9a-968c-6c52868acf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:41.393430 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a949b-0b9f-4c9a-968c-6c52868acf60 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:41.393712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a949b-0b9f-4c9a-968c-6c52868acf60 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:41.393987 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a949b-0b9f-4c9a-968c-6c52868acf60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:41.406648 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:41.441503 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd27f0-e334-4d60-a873-04eb18bf24b6 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:41.474491 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a949b-0b9f-4c9a-968c-6c52868acf60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:41.475964 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a949b-0b9f-4c9a-968c-6c52868acf60 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:41.487420 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e5679-b4e3-4f96-8d43-be60fb3f2621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:41.488965 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e5679-b4e3-4f96-8d43-be60fb3f2621 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:41.489483 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e5679-b4e3-4f96-8d43-be60fb3f2621 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:41.489971 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e5679-b4e3-4f96-8d43-be60fb3f2621 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:41.491162 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e5679-b4e3-4f96-8d43-be60fb3f2621 None admin] RBAC: Adding query filter params (role.id=13ff8a5ffa5648c28ec00aa75b69d913, scope.project.id=b11b7e66a993492d8163097bce955c0b, user.id=abb1dec309904b009271f36cd9157511) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:41.491320 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:41.492060 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e5679-b4e3-4f96-8d43-be60fb3f2621 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:41.494059 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e5679-b4e3-4f96-8d43-be60fb3f2621 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:41.508026 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 273/532] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:02:41 2022] GET /identity/v3/role_assignments?user.id=abb1dec309904b009271f36cd9157511&scope.project.id=b11b7e66a993492d8163097bce955c0b&role.id=13ff8a5ffa5648c28ec00aa75b69d913 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:41.508026 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e5679-b4e3-4f96-8d43-be60fb3f2621 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:41.625736 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e5679-b4e3-4f96-8d43-be60fb3f2621 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:41.667382 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66919bc-4835-4af6-be19-667ae709c8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:41.668298 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66919bc-4835-4af6-be19-667ae709c8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:41.668702 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66919bc-4835-4af6-be19-667ae709c8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:41.669080 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66919bc-4835-4af6-be19-667ae709c8b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:41.677811 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66919bc-4835-4af6-be19-667ae709c8b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:41.679459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66919bc-4835-4af6-be19-667ae709c8b8 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:41.683342 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:41.698626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-d66919bc-4835-4af6-be19-667ae709c8b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:41.698626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:41.698626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:41.698626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:41.698626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:41.698626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:41.698626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:41.698626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:41.698626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:41.698626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:41.698626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:41.698626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:41.698626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:02:41.698626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:02:41.698626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:02:41.699523 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:02:41.699523 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:41.699523 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:41.699523 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:41.699523 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:41.699523 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:41.699523 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:41.699523 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:41.699523 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:41.699523 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:41.699523 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:41.699523 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:41.699523 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:41.699523 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:41.699523 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:41.699523 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:41.699523 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:41.700513 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:02:41.700513 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:02:41.700513 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:02:41.700513 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:02:41.700513 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:02:41.700513 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:02:41.700513 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:41.700513 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:41.700513 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 274/533] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:02:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:41.706233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66919bc-4835-4af6-be19-667ae709c8b8 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:41.762889 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 260/534] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:02:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:41.768478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a949b-0b9f-4c9a-968c-6c52868acf60 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:41.836641 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66919bc-4835-4af6-be19-667ae709c8b8 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:41.885459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a304a78-a123-40f8-b9a6-93ea61c8646e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:41.886647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a304a78-a123-40f8-b9a6-93ea61c8646e None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:41.887141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a304a78-a123-40f8-b9a6-93ea61c8646e None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:41.887594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a304a78-a123-40f8-b9a6-93ea61c8646e None admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:41.888594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a304a78-a123-40f8-b9a6-93ea61c8646e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:41.889110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a304a78-a123-40f8-b9a6-93ea61c8646e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:41.890869 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a304a78-a123-40f8-b9a6-93ea61c8646e None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:41.929082 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 275/535] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:02:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:41.936096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a304a78-a123-40f8-b9a6-93ea61c8646e None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:41.944613 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a949b-0b9f-4c9a-968c-6c52868acf60 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:41.960370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:41.980838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b360e8-1726-4890-9a5c-2d42dc039fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:41.981693 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b360e8-1726-4890-9a5c-2d42dc039fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:41.983124 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b360e8-1726-4890-9a5c-2d42dc039fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:41.983124 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b360e8-1726-4890-9a5c-2d42dc039fa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:41.995533 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b360e8-1726-4890-9a5c-2d42dc039fa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:41.997187 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b360e8-1726-4890-9a5c-2d42dc039fa1 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:42.005912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:42.016456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-28b360e8-1726-4890-9a5c-2d42dc039fa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:42.016456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:42.016456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:42.016456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:42.016456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:42.016456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:42.016456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:42.016456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:42.016456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:42.016456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:42.016456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:42.016456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:42.016456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:42.016456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:42.016456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:42.018321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:42.018321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:42.018321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:42.018321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:42.018321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:42.018321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:42.018321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:42.018321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:42.018321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:42.018321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:42.018321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:42.018321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:42.018321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:42.018321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:42.018321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:42.018321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:42.018321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:42.019160 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:42.019160 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:42.019160 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:42.019160 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:42.019160 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 261/536] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:02:42.023671 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b360e8-1726-4890-9a5c-2d42dc039fa1 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:42.064479 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a304a78-a123-40f8-b9a6-93ea61c8646e None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:42.111422 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae271a-6990-4797-a6c7-329e64ae0105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:42.112546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae271a-6990-4797-a6c7-329e64ae0105 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:42.113058 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae271a-6990-4797-a6c7-329e64ae0105 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:42.113537 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae271a-6990-4797-a6c7-329e64ae0105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:42.114674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae271a-6990-4797-a6c7-329e64ae0105 None admin] RBAC: Adding query filter params (role.id=13ff8a5ffa5648c28ec00aa75b69d913, scope.project.id=b11b7e66a993492d8163097bce955c0b, user.id=226743f4f93c44c5aef5919a7813bd3c) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:42.115292 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae271a-6990-4797-a6c7-329e64ae0105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:42.116982 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae271a-6990-4797-a6c7-329e64ae0105 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:42.128222 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 276/537] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:02:41 2022] GET /identity/v3/role_assignments?user.id=226743f4f93c44c5aef5919a7813bd3c&scope.project.id=b11b7e66a993492d8163097bce955c0b&role.id=13ff8a5ffa5648c28ec00aa75b69d913 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:42.140677 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b360e8-1726-4890-9a5c-2d42dc039fa1 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:42.214655 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75c9e1-e25a-404e-92cf-917d3d4b1a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:42.215275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75c9e1-e25a-404e-92cf-917d3d4b1a64 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:42.215559 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75c9e1-e25a-404e-92cf-917d3d4b1a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:42.215839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75c9e1-e25a-404e-92cf-917d3d4b1a64 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:42.216647 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75c9e1-e25a-404e-92cf-917d3d4b1a64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:42.217224 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75c9e1-e25a-404e-92cf-917d3d4b1a64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:42.218668 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75c9e1-e25a-404e-92cf-917d3d4b1a64 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:42.238195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 262/538] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:42.243873 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae271a-6990-4797-a6c7-329e64ae0105 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:42.407084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae271a-6990-4797-a6c7-329e64ae0105 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:42.458764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:42.486515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146da86b-45f1-4a1d-b9c0-c74a3497ba9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:42.487404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146da86b-45f1-4a1d-b9c0-c74a3497ba9e None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:42.487689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146da86b-45f1-4a1d-b9c0-c74a3497ba9e None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:42.487962 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146da86b-45f1-4a1d-b9c0-c74a3497ba9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:42.502419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146da86b-45f1-4a1d-b9c0-c74a3497ba9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:42.503895 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146da86b-45f1-4a1d-b9c0-c74a3497ba9e None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:42.525110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-146da86b-45f1-4a1d-b9c0-c74a3497ba9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:42.525110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:42.525110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:42.525110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:42.525110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:42.525110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:42.525110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:42.525110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:42.525110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:42.525110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:42.525110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:42.525110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:42.525110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:02:42.525110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:02:42.525110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:02:42.526024 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:02:42.526024 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:42.526024 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:42.526024 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:42.526024 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:42.526024 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:42.526024 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:42.526024 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:42.526024 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:42.526024 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:42.526024 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:42.526024 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:42.526024 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:42.526024 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:42.526024 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:42.526024 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:42.526024 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:42.526864 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:02:42.526864 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:02:42.526864 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:02:42.526864 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:02:42.526864 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:02:42.526864 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:02:42.526864 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:42.526864 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:42.526864 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 277/539] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:02:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:42.533201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75c9e1-e25a-404e-92cf-917d3d4b1a64 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:42.586397 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:42.684833 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53611393-457d-440a-b2b3-938922f235db None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:42.685185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53611393-457d-440a-b2b3-938922f235db None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:42.685396 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53611393-457d-440a-b2b3-938922f235db None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:42.688129 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 278/540] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:02:42.692767 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b152c3-d62d-402a-9925-ec11510a8dc8 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:42.693056 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b152c3-d62d-402a-9925-ec11510a8dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:42.693340 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b152c3-d62d-402a-9925-ec11510a8dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:42.709906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75c9e1-e25a-404e-92cf-917d3d4b1a64 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:42.725400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-e9b152c3-d62d-402a-9925-ec11510a8dc8 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:42.725400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-e9b152c3-d62d-402a-9925-ec11510a8dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:42.776072 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb187b-95cf-4378-aa20-1d7ff1e89b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:42.776718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb187b-95cf-4378-aa20-1d7ff1e89b20 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:42.776926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb187b-95cf-4378-aa20-1d7ff1e89b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:42.777202 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb187b-95cf-4378-aa20-1d7ff1e89b20 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:42.777998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb187b-95cf-4378-aa20-1d7ff1e89b20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:42.778305 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb187b-95cf-4378-aa20-1d7ff1e89b20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:42.779742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb187b-95cf-4378-aa20-1d7ff1e89b20 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:42.799965 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 263/541] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:02:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:42.805385 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb187b-95cf-4378-aa20-1d7ff1e89b20 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:42.865088 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 279/542] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 19:02:42.909496 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b152c3-d62d-402a-9925-ec11510a8dc8 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:42.964403 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:42.996395 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb187b-95cf-4378-aa20-1d7ff1e89b20 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:43.066083 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc5994-9761-4610-9bb4-96d93a27c9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:43.066674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc5994-9761-4610-9bb4-96d93a27c9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:43.066963 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc5994-9761-4610-9bb4-96d93a27c9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:43.067237 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc5994-9761-4610-9bb4-96d93a27c9a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:43.068111 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc5994-9761-4610-9bb4-96d93a27c9a7 None admin] RBAC: Adding query filter params (role.id=13ff8a5ffa5648c28ec00aa75b69d913, scope.project.id=b11b7e66a993492d8163097bce955c0b, user.id=2efd679ca9314c8591cabbca15f8c61b) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:43.068429 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc5994-9761-4610-9bb4-96d93a27c9a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:43.069885 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc5994-9761-4610-9bb4-96d93a27c9a7 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:43.072094 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b152c3-d62d-402a-9925-ec11510a8dc8 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:43.086219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 264/543] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:02:42 2022] GET /identity/v3/role_assignments?user.id=2efd679ca9314c8591cabbca15f8c61b&scope.project.id=b11b7e66a993492d8163097bce955c0b&role.id=13ff8a5ffa5648c28ec00aa75b69d913 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:43.100398 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:43.120130 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadae780-c107-4045-8e71-09b7d09be8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:43.120981 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadae780-c107-4045-8e71-09b7d09be8cf None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:43.121269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadae780-c107-4045-8e71-09b7d09be8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:43.121545 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadae780-c107-4045-8e71-09b7d09be8cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:43.134600 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadae780-c107-4045-8e71-09b7d09be8cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:43.143459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-dadae780-c107-4045-8e71-09b7d09be8cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:43.143459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:43.143459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:43.143459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:43.143459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:43.143459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:43.143459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:43.143459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:43.143459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:43.143459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:43.143459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:43.143459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:43.143459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:43.143459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:43.143459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:43.143459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:43.144469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:43.144469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:43.144469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:43.144469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:43.144469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:43.144469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:43.144469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:43.144469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:43.144469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:43.144469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:43.144469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:43.144469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:43.144469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:43.144469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:43.144469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:43.144469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:43.145269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:43.145269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:43.145269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:43.145269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:43.145269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:43.145269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:43.145269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:43.145269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:43.145269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:43.145269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:43.145269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:43.145269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:43.145269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 280/544] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jun 2 19:02:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:02:43.153651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc5994-9761-4610-9bb4-96d93a27c9a7 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:43.252510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb5499-9972-4e75-9db3-c870357403e2 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:43.252861 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb5499-9972-4e75-9db3-c870357403e2 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:43.253130 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb5499-9972-4e75-9db3-c870357403e2 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:43.258848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 281/545] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:02:43.263251 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c354bc5-74ff-448c-94bd-9f1729a19892 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:43.263551 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c354bc5-74ff-448c-94bd-9f1729a19892 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:43.263816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c354bc5-74ff-448c-94bd-9f1729a19892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:43.277869 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc5994-9761-4610-9bb4-96d93a27c9a7 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:43.296432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-9c354bc5-74ff-448c-94bd-9f1729a19892 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:43.297664 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-9c354bc5-74ff-448c-94bd-9f1729a19892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:43.326745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6662bf5-87b9-4e6b-9cf6-f59b9e5ae2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:43.327345 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6662bf5-87b9-4e6b-9cf6-f59b9e5ae2af None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:43.327628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6662bf5-87b9-4e6b-9cf6-f59b9e5ae2af None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:43.327903 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6662bf5-87b9-4e6b-9cf6-f59b9e5ae2af None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:43.328712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6662bf5-87b9-4e6b-9cf6-f59b9e5ae2af None admin] RBAC: Adding query filter params (name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:43.329050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6662bf5-87b9-4e6b-9cf6-f59b9e5ae2af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:43.331769 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6662bf5-87b9-4e6b-9cf6-f59b9e5ae2af None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:43.350440 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 265/546] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jun 2 19:02:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:43.362319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6662bf5-87b9-4e6b-9cf6-f59b9e5ae2af None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:43.384469 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:43.458687 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 282/547] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:43.494881 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6662bf5-87b9-4e6b-9cf6-f59b9e5ae2af None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:43.498619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c354bc5-74ff-448c-94bd-9f1729a19892 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:43.532488 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67811c-caf4-4666-ba03-7ee6d66b10cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:43.533310 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67811c-caf4-4666-ba03-7ee6d66b10cc None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:43.533594 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67811c-caf4-4666-ba03-7ee6d66b10cc None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:43.533872 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67811c-caf4-4666-ba03-7ee6d66b10cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:43.545721 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67811c-caf4-4666-ba03-7ee6d66b10cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:43.547220 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67811c-caf4-4666-ba03-7ee6d66b10cc None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:43.567055 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-ce67811c-caf4-4666-ba03-7ee6d66b10cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:43.567055 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:43.567055 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:43.567055 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:43.567055 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:43.567055 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:43.567055 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:43.567055 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:43.567055 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:43.567055 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:43.567055 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:43.567055 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:43.567055 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:43.567055 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:43.567055 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:43.567968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:43.567968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:43.567968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:43.567968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:43.567968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:43.567968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:43.567968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:43.567968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:43.567968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:43.567968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:43.567968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:43.567968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:43.567968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:43.567968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:43.567968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:43.567968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:43.567968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:43.569380 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:43.569380 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:43.569380 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:43.569380 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:43.569380 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 266/548] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:43.575043 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67811c-caf4-4666-ba03-7ee6d66b10cc None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:43.688023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:43.728021 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67811c-caf4-4666-ba03-7ee6d66b10cc None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:43.745117 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:43.753107 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c354bc5-74ff-448c-94bd-9f1729a19892 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:43.763823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acbb9f-ebd1-4808-b859-5746dca8ac51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:43.764557 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acbb9f-ebd1-4808-b859-5746dca8ac51 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:43.764842 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acbb9f-ebd1-4808-b859-5746dca8ac51 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:43.765125 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acbb9f-ebd1-4808-b859-5746dca8ac51 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:43.765902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78acbb9f-ebd1-4808-b859-5746dca8ac51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:43.766214 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78acbb9f-ebd1-4808-b859-5746dca8ac51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:43.768237 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78acbb9f-ebd1-4808-b859-5746dca8ac51 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:43.783496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 267/549] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:43.788969 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acbb9f-ebd1-4808-b859-5746dca8ac51 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:43.835378 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c03b13-efdb-4f9c-bf3b-1c291a5c5a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:43.836231 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c03b13-efdb-4f9c-bf3b-1c291a5c5a07 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:43.836515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c03b13-efdb-4f9c-bf3b-1c291a5c5a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:43.836791 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c03b13-efdb-4f9c-bf3b-1c291a5c5a07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:43.859129 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c03b13-efdb-4f9c-bf3b-1c291a5c5a07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:43.877110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-89c03b13-efdb-4f9c-bf3b-1c291a5c5a07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:43.877110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:43.877110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:43.877110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:43.877110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:43.877110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:43.877110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:43.877110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:43.877110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:43.877110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:43.877110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:43.877110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:43.877110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:43.877110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:43.877110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:43.877110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:43.878515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:43.878515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:43.878515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:43.878515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:43.878515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:43.878515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:43.878515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:43.878515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:43.878515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:43.878515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:43.878515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:43.878515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:43.878515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:43.878515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:43.878515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:43.878515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:43.879333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:43.879333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:43.879333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:43.879333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:43.879333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:43.879333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:43.879333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:43.879333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:43.879333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:43.879333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:43.879333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:43.879333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:43.888089 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 283/550] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jun 2 19:02:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:02:43.889536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c03b13-efdb-4f9c-bf3b-1c291a5c5a07 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:43.995432 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acbb9f-ebd1-4808-b859-5746dca8ac51 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:44.008019 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c03b13-efdb-4f9c-bf3b-1c291a5c5a07 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:44.046578 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:44.056652 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887ec15-89a3-4d4c-94a8-cb607c4b6378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:44.057788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887ec15-89a3-4d4c-94a8-cb607c4b6378 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:44.062911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887ec15-89a3-4d4c-94a8-cb607c4b6378 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:44.062911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887ec15-89a3-4d4c-94a8-cb607c4b6378 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:44.062911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887ec15-89a3-4d4c-94a8-cb607c4b6378 None admin] RBAC: Adding query filter params (name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:44.062911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887ec15-89a3-4d4c-94a8-cb607c4b6378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:44.065678 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887ec15-89a3-4d4c-94a8-cb607c4b6378 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:44.074270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d5161-300a-4cbb-bf1b-ce9e18d0a7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:44.076520 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d5161-300a-4cbb-bf1b-ce9e18d0a7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:44.077001 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d5161-300a-4cbb-bf1b-ce9e18d0a7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:44.078777 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d5161-300a-4cbb-bf1b-ce9e18d0a7a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:44.093696 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 284/551] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jun 2 19:02:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:02:44.097042 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887ec15-89a3-4d4c-94a8-cb607c4b6378 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:44.100715 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d5161-300a-4cbb-bf1b-ce9e18d0a7a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:44.104965 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d5161-300a-4cbb-bf1b-ce9e18d0a7a8 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:44.137015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-860d5161-300a-4cbb-bf1b-ce9e18d0a7a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 19:02:44.137015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:44.137015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:44.137015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:44.137015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:44.137015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:44.137015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:44.137015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:44.137015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:44.137015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:44.137015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:44.137015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:44.137015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:02:44.137015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:02:44.137015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:02:44.137015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:02:44.138196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:44.138196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:44.138196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:02:44.138196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:44.138196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:02:44.138196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:44.138196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:44.138196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:44.138196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:44.138196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:44.138196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:44.138196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:44.138196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:44.138196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:44.138196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:44.138196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:44.138196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:44.138196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:44.139346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:44.139346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:44.139346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:02:44.139346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:02:44.139346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:02:44.139346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:02:44.139346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:02:44.139346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:02:44.139346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 19:02:44.139346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:44.152901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 268/552] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Jun 2 19:02:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:44.164731 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:44.169948 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d5161-300a-4cbb-bf1b-ce9e18d0a7a8 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:44.301198 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887ec15-89a3-4d4c-94a8-cb607c4b6378 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:44.338126 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef127c-d222-4e94-a9b9-a2c12ec80067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:44.339204 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef127c-d222-4e94-a9b9-a2c12ec80067 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:44.339651 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef127c-d222-4e94-a9b9-a2c12ec80067 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:44.340091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef127c-d222-4e94-a9b9-a2c12ec80067 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:44.352742 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef127c-d222-4e94-a9b9-a2c12ec80067 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:44.355798 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef127c-d222-4e94-a9b9-a2c12ec80067 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:44.370546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d5161-300a-4cbb-bf1b-ce9e18d0a7a8 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:44.375759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-acef127c-d222-4e94-a9b9-a2c12ec80067 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:44.375759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:44.375759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:44.375759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:44.375759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:44.375759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:44.375759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:44.375759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:44.375759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:44.375759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:44.375759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:44.375759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:44.375759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:44.375759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:44.375759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:44.377197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:44.377197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:44.377197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:44.377197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:44.377197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:44.377197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:44.377197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:44.377197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:44.377197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:44.377197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:44.377197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:44.377197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:44.377197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:44.377197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:44.377197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:44.377197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:44.377197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:44.378508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:44.378508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:44.378508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:44.378508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:44.382258 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 285/553] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:02:44.383849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25a90d-e367-4ec2-8dbd-97ad72170823 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:44.384334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25a90d-e367-4ec2-8dbd-97ad72170823 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:44.384766 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25a90d-e367-4ec2-8dbd-97ad72170823 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:44.386569 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 286/554] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:44.387428 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25a90d-e367-4ec2-8dbd-97ad72170823 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:44.421651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec54a1a-1439-48f9-a147-1329a53255db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:44.422475 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec54a1a-1439-48f9-a147-1329a53255db None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:44.423357 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec54a1a-1439-48f9-a147-1329a53255db None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:44.423706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec54a1a-1439-48f9-a147-1329a53255db None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:44.425038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec54a1a-1439-48f9-a147-1329a53255db None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:44.425960 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec54a1a-1439-48f9-a147-1329a53255db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:44.427880 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec54a1a-1439-48f9-a147-1329a53255db None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:44.457397 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 269/555] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Jun 2 19:02:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:44.457397 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d9ef9-c037-48c6-9459-60c54e392a62 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:44.457397 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d9ef9-c037-48c6-9459-60c54e392a62 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:44.457397 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d9ef9-c037-48c6-9459-60c54e392a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:44.477516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:44.481034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-110d9ef9-c037-48c6-9459-60c54e392a62 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:44.482484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-110d9ef9-c037-48c6-9459-60c54e392a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:44.512761 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25a90d-e367-4ec2-8dbd-97ad72170823 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:44.531853 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:44.564432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d591f-61a2-4ec9-9bc5-7fbfb71d3d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:44.565587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d591f-61a2-4ec9-9bc5-7fbfb71d3d97 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:44.566048 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d591f-61a2-4ec9-9bc5-7fbfb71d3d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:44.566499 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d591f-61a2-4ec9-9bc5-7fbfb71d3d97 None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:44.572259 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d591f-61a2-4ec9-9bc5-7fbfb71d3d97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:44.572425 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 270/556] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:44.572425 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d9ef9-c037-48c6-9459-60c54e392a62 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:44.573002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d591f-61a2-4ec9-9bc5-7fbfb71d3d97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:44.574552 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d591f-61a2-4ec9-9bc5-7fbfb71d3d97 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:44.600258 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 287/557] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:44.605792 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d591f-61a2-4ec9-9bc5-7fbfb71d3d97 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:44.683039 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d9ef9-c037-48c6-9459-60c54e392a62 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:44.721095 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e81e4-e82d-406b-9cf6-1ba486eacca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:44.722187 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e81e4-e82d-406b-9cf6-1ba486eacca7 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:44.722609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e81e4-e82d-406b-9cf6-1ba486eacca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:44.723023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e81e4-e82d-406b-9cf6-1ba486eacca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:44.730501 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d591f-61a2-4ec9-9bc5-7fbfb71d3d97 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:44.735141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e81e4-e82d-406b-9cf6-1ba486eacca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:44.736882 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e81e4-e82d-406b-9cf6-1ba486eacca7 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:44.755628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-182e81e4-e82d-406b-9cf6-1ba486eacca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:44.755628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:44.755628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:44.755628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:44.755628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:44.755628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:44.755628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:44.755628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:44.755628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:44.755628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:44.755628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:44.755628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:44.755628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:44.755628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:44.755628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:44.757229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:44.757229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:44.757229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:44.757229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:44.757229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:44.757229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:44.757229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:44.757229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:44.757229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:44.757229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:44.757229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:44.757229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:44.757229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:44.757229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:44.757229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:44.757229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:44.757229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:44.758109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:44.758109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:44.758109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:44.758109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:44.760265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 271/558] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:44.761281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e81e4-e82d-406b-9cf6-1ba486eacca7 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:44.764026 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:44.770376 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22102c7f-70a7-43c3-95c0-f4738a37e80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:44.771326 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22102c7f-70a7-43c3-95c0-f4738a37e80a None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:44.771724 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22102c7f-70a7-43c3-95c0-f4738a37e80a None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:44.772101 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22102c7f-70a7-43c3-95c0-f4738a37e80a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:44.780056 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22102c7f-70a7-43c3-95c0-f4738a37e80a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:44.789206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22102c7f-70a7-43c3-95c0-f4738a37e80a None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:44.789959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:44.801275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-22102c7f-70a7-43c3-95c0-f4738a37e80a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 19:02:44.801275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:44.801275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:44.801275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:44.801275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:44.801275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:44.801275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:44.801275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:44.801275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:44.801275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:44.801275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:44.801275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:44.801275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:02:44.801275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:02:44.801275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:02:44.801275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:02:44.802493 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:44.802493 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:44.802493 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:02:44.802493 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:44.802493 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:02:44.802493 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:44.802493 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:44.802493 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:44.802493 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:44.802493 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:44.802493 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:44.802493 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:44.802493 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:44.802493 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:44.802493 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:44.802493 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:44.802493 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:44.802493 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:44.803704 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:44.803704 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:44.803704 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:02:44.803704 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:02:44.803704 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:02:44.803704 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:02:44.803704 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:02:44.803704 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:02:44.803704 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 19:02:44.803704 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:44.810409 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 288/559] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:02:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:02:44.811595 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22102c7f-70a7-43c3-95c0-f4738a37e80a None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:44.874586 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e81e4-e82d-406b-9cf6-1ba486eacca7 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:44.911950 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad70ae-8115-4539-a0ed-3c18a70ea6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:44.912933 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad70ae-8115-4539-a0ed-3c18a70ea6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:44.913324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad70ae-8115-4539-a0ed-3c18a70ea6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:44.913690 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad70ae-8115-4539-a0ed-3c18a70ea6a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:44.922701 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22102c7f-70a7-43c3-95c0-f4738a37e80a None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:44.925564 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad70ae-8115-4539-a0ed-3c18a70ea6a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:44.933461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-5fad70ae-8115-4539-a0ed-3c18a70ea6a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:44.933461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:44.933461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:44.933461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:44.933461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:44.933461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:44.933461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:44.933461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:44.933461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:44.933461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:44.933461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:44.933461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:44.933461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:44.933461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:44.933461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:44.933461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:44.934423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:44.934423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:44.934423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:44.934423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:44.934423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:44.934423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:44.934423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:44.934423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:44.934423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:44.934423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:44.934423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:44.934423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:44.934423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:44.934423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:44.934423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:44.934423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:44.935267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:44.935267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:44.935267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:44.935267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:44.935267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:44.935267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:44.935267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:44.935267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:44.935267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:44.935267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:44.935267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:44.935267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:44.935267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 272/560] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jun 2 19:02:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:44.935959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad70ae-8115-4539-a0ed-3c18a70ea6a0 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:44.974101 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7ad6c-edf7-4c05-bb24-8171cf93c3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:44.974783 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7ad6c-edf7-4c05-bb24-8171cf93c3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:44.975066 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7ad6c-edf7-4c05-bb24-8171cf93c3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:44.975342 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7ad6c-edf7-4c05-bb24-8171cf93c3a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:44.976542 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7ad6c-edf7-4c05-bb24-8171cf93c3a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:44.976851 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7ad6c-edf7-4c05-bb24-8171cf93c3a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:44.978541 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7ad6c-edf7-4c05-bb24-8171cf93c3a4 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:44.998424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 289/561] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:44.998424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7ad6c-edf7-4c05-bb24-8171cf93c3a4 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:45.035088 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:45.052227 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad70ae-8115-4539-a0ed-3c18a70ea6a0 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:45.054014 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:45.094282 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f1bc7-007b-4bfd-a000-2d4f3d174272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:45.095612 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f1bc7-007b-4bfd-a000-2d4f3d174272 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:45.095891 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f1bc7-007b-4bfd-a000-2d4f3d174272 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:45.096189 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f1bc7-007b-4bfd-a000-2d4f3d174272 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:45.097033 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f1bc7-007b-4bfd-a000-2d4f3d174272 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:45.097335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f1bc7-007b-4bfd-a000-2d4f3d174272 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:45.098777 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f1bc7-007b-4bfd-a000-2d4f3d174272 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:45.113051 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7ad6c-edf7-4c05-bb24-8171cf93c3a4 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:45.124051 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 273/562] 10.222.0.45 () {56 vars in 1135 bytes} [Thu Jun 2 19:02:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:45.124051 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a908c2-332a-4a2f-b2f4-4b52094488ad None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:45.124051 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a908c2-332a-4a2f-b2f4-4b52094488ad None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:45.124051 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a908c2-332a-4a2f-b2f4-4b52094488ad None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:45.124051 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 274/563] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:45.124051 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a908c2-332a-4a2f-b2f4-4b52094488ad None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:45.149409 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663889a3-9e60-4ae6-81b7-7a836e4d1645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:45.149985 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663889a3-9e60-4ae6-81b7-7a836e4d1645 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:45.150271 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663889a3-9e60-4ae6-81b7-7a836e4d1645 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:45.150541 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663889a3-9e60-4ae6-81b7-7a836e4d1645 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:45.151280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663889a3-9e60-4ae6-81b7-7a836e4d1645 None admin] RBAC: Adding query filter params (name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:45.151588 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663889a3-9e60-4ae6-81b7-7a836e4d1645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:45.153022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663889a3-9e60-4ae6-81b7-7a836e4d1645 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:45.166230 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 290/564] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jun 2 19:02:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:45.166230 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb579b2-1de4-49cf-ad11-0bfc32b5dc34 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:45.166230 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb579b2-1de4-49cf-ad11-0bfc32b5dc34 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:45.166230 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb579b2-1de4-49cf-ad11-0bfc32b5dc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:45.182464 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-7eb579b2-1de4-49cf-ad11-0bfc32b5dc34 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:45.183639 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-7eb579b2-1de4-49cf-ad11-0bfc32b5dc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:45.239912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a908c2-332a-4a2f-b2f4-4b52094488ad None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:45.252949 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 291/565] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:45.253793 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb579b2-1de4-49cf-ad11-0bfc32b5dc34 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:45.282372 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f01455-e933-42fb-bbb7-a2284f0229a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:45.283173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f01455-e933-42fb-bbb7-a2284f0229a0 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:45.283463 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f01455-e933-42fb-bbb7-a2284f0229a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:45.283734 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f01455-e933-42fb-bbb7-a2284f0229a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:45.290955 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f01455-e933-42fb-bbb7-a2284f0229a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:45.292437 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f01455-e933-42fb-bbb7-a2284f0229a0 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:45.307499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-e4f01455-e933-42fb-bbb7-a2284f0229a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:45.307499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:45.307499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:45.307499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:45.307499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:45.307499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:45.307499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:45.307499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:45.307499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:45.307499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:45.307499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:45.307499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:45.307499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:02:45.307499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:02:45.307499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:02:45.308683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:02:45.308683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:45.308683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:45.308683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:45.308683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:45.308683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:45.308683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:45.308683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:45.308683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:45.308683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:45.308683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:45.308683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:45.308683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:45.308683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:45.308683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:45.308683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:45.308683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:45.309788 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:02:45.309788 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:02:45.309788 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:02:45.309788 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:02:45.309788 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:02:45.309788 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:02:45.309788 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:45.309788 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:45.310317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:45.314304 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 275/566] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:02:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:45.315308 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f01455-e933-42fb-bbb7-a2284f0229a0 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:45.318313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:45.372720 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb579b2-1de4-49cf-ad11-0bfc32b5dc34 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:45.411621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb202d82-1666-4b81-97a4-113ed8536137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:45.412282 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb202d82-1666-4b81-97a4-113ed8536137 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:45.412563 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb202d82-1666-4b81-97a4-113ed8536137 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:45.412833 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb202d82-1666-4b81-97a4-113ed8536137 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:45.428215 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f01455-e933-42fb-bbb7-a2284f0229a0 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:45.466280 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d5194-3a27-436e-89e9-c3c08b48df73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:45.467350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d5194-3a27-436e-89e9-c3c08b48df73 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:45.467633 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d5194-3a27-436e-89e9-c3c08b48df73 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:45.467915 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d5194-3a27-436e-89e9-c3c08b48df73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:45.480807 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d5194-3a27-436e-89e9-c3c08b48df73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:45.482540 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d5194-3a27-436e-89e9-c3c08b48df73 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:45.484457 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb202d82-1666-4b81-97a4-113ed8536137 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:45.485968 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb202d82-1666-4b81-97a4-113ed8536137 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:45.502225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-548d5194-3a27-436e-89e9-c3c08b48df73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:45.502225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:45.502225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:45.502225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:45.502225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:45.502225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:45.502225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:45.502225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:45.502225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:45.502225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:45.502225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:45.502225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:45.502225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:45.502225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:45.502225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:45.503164 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:45.503164 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:45.503164 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:45.503164 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:45.503164 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:45.503164 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:45.503164 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:45.503164 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:45.503164 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:45.503164 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:45.503164 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:45.503164 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:45.503164 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:45.503164 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:45.503164 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:45.503164 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:45.503164 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:45.504094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:45.504094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:45.504094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:45.504094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:45.504094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 276/567] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:45.509112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d5194-3a27-436e-89e9-c3c08b48df73 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:45.535928 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:45.566843 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:45.596214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 292/568] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:02:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:45.597666 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb202d82-1666-4b81-97a4-113ed8536137 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:45.624197 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d5194-3a27-436e-89e9-c3c08b48df73 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:45.663551 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa71dc-1b17-4f85-86c0-533dee0556cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:45.664295 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa71dc-1b17-4f85-86c0-533dee0556cc None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:45.664574 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa71dc-1b17-4f85-86c0-533dee0556cc None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:45.664868 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa71dc-1b17-4f85-86c0-533dee0556cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:45.675802 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa71dc-1b17-4f85-86c0-533dee0556cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:45.683555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-f1fa71dc-1b17-4f85-86c0-533dee0556cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:45.683555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:45.683555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:45.683555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:45.683555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:45.683555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:45.683555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:45.683555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:45.683555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:45.683555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:45.683555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:45.683555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:45.683555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:45.683555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:45.683555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:45.683555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:45.684546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:45.684546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:45.684546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:45.684546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:45.684546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:45.684546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:45.684546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:45.684546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:45.684546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:45.684546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:45.684546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:45.684546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:45.684546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:45.684546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:45.684546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:45.684546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:45.691058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:45.691058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:45.691058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:45.691058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:45.691058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:45.691058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:45.691058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:45.691058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:45.691058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:45.691058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:45.691058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:45.691058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:45.691058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 277/569] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jun 2 19:02:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:45.691058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa71dc-1b17-4f85-86c0-533dee0556cc None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:45.701177 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb202d82-1666-4b81-97a4-113ed8536137 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:45.738964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3a00e-f785-419e-b9f2-b94f9f1b0d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:45.739627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3a00e-f785-419e-b9f2-b94f9f1b0d37 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:45.739911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3a00e-f785-419e-b9f2-b94f9f1b0d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:45.740224 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3a00e-f785-419e-b9f2-b94f9f1b0d37 None admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:45.741004 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3a00e-f785-419e-b9f2-b94f9f1b0d37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:45.741312 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3a00e-f785-419e-b9f2-b94f9f1b0d37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:45.742745 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3a00e-f785-419e-b9f2-b94f9f1b0d37 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:45.754987 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 293/570] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:02:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:45.755788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3a00e-f785-419e-b9f2-b94f9f1b0d37 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:45.760862 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:45.799109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa71dc-1b17-4f85-86c0-533dee0556cc None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:45.813052 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:45.832965 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef7c11-25c8-452e-a393-7a8aa6ddf8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:45.833626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef7c11-25c8-452e-a393-7a8aa6ddf8ce None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:45.833912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef7c11-25c8-452e-a393-7a8aa6ddf8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:45.834187 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef7c11-25c8-452e-a393-7a8aa6ddf8ce None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:45.834907 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef7c11-25c8-452e-a393-7a8aa6ddf8ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:45.835212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef7c11-25c8-452e-a393-7a8aa6ddf8ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:45.836689 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef7c11-25c8-452e-a393-7a8aa6ddf8ce None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:45.853086 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 278/571] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:45.853086 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bd733-9ceb-4828-9523-4c774e337b9a None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:45.853086 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bd733-9ceb-4828-9523-4c774e337b9a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:45.853086 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bd733-9ceb-4828-9523-4c774e337b9a None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:45.853086 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 279/572] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:45.853086 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bd733-9ceb-4828-9523-4c774e337b9a None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:45.864166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3a00e-f785-419e-b9f2-b94f9f1b0d37 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:45.897884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed640d8-455b-47a8-97c1-cdfd2fbb82ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:45.898670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed640d8-455b-47a8-97c1-cdfd2fbb82ed None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:45.898963 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed640d8-455b-47a8-97c1-cdfd2fbb82ed None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:45.899214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed640d8-455b-47a8-97c1-cdfd2fbb82ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:45.910316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed640d8-455b-47a8-97c1-cdfd2fbb82ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:45.911759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed640d8-455b-47a8-97c1-cdfd2fbb82ed None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:45.928750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-3ed640d8-455b-47a8-97c1-cdfd2fbb82ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:45.928750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:45.928750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:45.928750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:45.928750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:45.928750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:45.928750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:45.928750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:45.928750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:45.928750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:45.928750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:45.928750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:45.928750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:45.928750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:45.928750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:45.930116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:45.930116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:45.930116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:45.930116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:45.930116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:45.930116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:45.930116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:45.930116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:45.930116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:45.930116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:45.930116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:45.930116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:45.930116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:45.930116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:45.930116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:45.930116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:45.930116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:45.930983 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:45.930983 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:45.930983 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:45.930983 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:45.930983 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 294/573] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:45.930983 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed640d8-455b-47a8-97c1-cdfd2fbb82ed None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:45.959054 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bd733-9ceb-4828-9523-4c774e337b9a None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:45.987654 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:45.993653 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389189f-39cc-42f5-92a2-afd649156d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:45.994317 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389189f-39cc-42f5-92a2-afd649156d84 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:45.994597 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389189f-39cc-42f5-92a2-afd649156d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:45.994869 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389189f-39cc-42f5-92a2-afd649156d84 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:45.995611 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389189f-39cc-42f5-92a2-afd649156d84 None admin] RBAC: Adding query filter params (name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:45.995915 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389189f-39cc-42f5-92a2-afd649156d84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:45.997342 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389189f-39cc-42f5-92a2-afd649156d84 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:46.005338 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 280/574] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jun 2 19:02:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:46.006159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389189f-39cc-42f5-92a2-afd649156d84 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:46.031883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed640d8-455b-47a8-97c1-cdfd2fbb82ed None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:46.041741 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:46.069600 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf285eb3-3778-48fa-ac45-511af430b26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:46.070504 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf285eb3-3778-48fa-ac45-511af430b26a None admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:46.070786 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf285eb3-3778-48fa-ac45-511af430b26a None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:46.071065 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf285eb3-3778-48fa-ac45-511af430b26a None admin] PATH_INFO: `/v3/projects/b11b7e66a993492d8163097bce955c0b/users/575f61ef70314f86b5d9dad3ba1b3aab/roles/13ff8a5ffa5648c28ec00aa75b69d913` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:46.087090 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf285eb3-3778-48fa-ac45-511af430b26a None admin] RBAC: Authorizing `identity:create_grant(project_id=b11b7e66a993492d8163097bce955c0b, user_id=575f61ef70314f86b5d9dad3ba1b3aab, role_id=13ff8a5ffa5648c28ec00aa75b69d913)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:46.088615 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf285eb3-3778-48fa-ac45-511af430b26a None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:46.112676 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389189f-39cc-42f5-92a2-afd649156d84 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:46.146781 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35528d19-2b6c-4233-9bb7-02561a12d564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:46.147571 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35528d19-2b6c-4233-9bb7-02561a12d564 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:46.150686 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35528d19-2b6c-4233-9bb7-02561a12d564 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:46.150686 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35528d19-2b6c-4233-9bb7-02561a12d564 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:46.156568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35528d19-2b6c-4233-9bb7-02561a12d564 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:46.158051 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35528d19-2b6c-4233-9bb7-02561a12d564 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:46.172263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-35528d19-2b6c-4233-9bb7-02561a12d564 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 19:02:46.172263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:46.172263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:46.172263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:46.172263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:46.172263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:46.172263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:46.172263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:46.172263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:46.172263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:46.172263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:46.172263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:46.172263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:02:46.172263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:02:46.172263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:02:46.172263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:02:46.173299 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:46.173299 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:46.173299 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:02:46.173299 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:46.173299 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:02:46.173299 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:46.173299 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:46.173299 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:46.173299 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:46.173299 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:46.173299 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:46.173299 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:46.173299 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:46.173299 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:46.173299 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:46.173299 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:46.173299 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:46.173299 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:46.174241 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:46.174241 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:46.174241 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:02:46.174241 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:02:46.174241 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:02:46.174241 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:02:46.174241 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:02:46.174241 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:02:46.174241 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 19:02:46.174241 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:46.174241 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 281/575] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:46.175027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018a5d0-9baa-4bd2-a79b-f3ddaed9e070 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:46.175290 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018a5d0-9baa-4bd2-a79b-f3ddaed9e070 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:46.175571 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018a5d0-9baa-4bd2-a79b-f3ddaed9e070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:46.180874 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 295/576] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jun 2 19:02:45 2022] PUT /identity/v3/projects/b11b7e66a993492d8163097bce955c0b/users/575f61ef70314f86b5d9dad3ba1b3aab/roles/13ff8a5ffa5648c28ec00aa75b69d913 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:46.181800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf285eb3-3778-48fa-ac45-511af430b26a None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:46.196584 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-d018a5d0-9baa-4bd2-a79b-f3ddaed9e070 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:46.197955 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d018a5d0-9baa-4bd2-a79b-f3ddaed9e070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:46.286119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 282/577] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:46.287639 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d018a5d0-9baa-4bd2-a79b-f3ddaed9e070 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:46.307552 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf285eb3-3778-48fa-ac45-511af430b26a None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:46.316770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:46.332121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:46.347361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0b0c0-13a3-4a27-88c0-6e37944e704c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:46.348087 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0b0c0-13a3-4a27-88c0-6e37944e704c None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:46.348369 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0b0c0-13a3-4a27-88c0-6e37944e704c None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:46.348640 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0b0c0-13a3-4a27-88c0-6e37944e704c None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:46.349378 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba0b0c0-13a3-4a27-88c0-6e37944e704c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:46.349835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba0b0c0-13a3-4a27-88c0-6e37944e704c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:46.351700 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba0b0c0-13a3-4a27-88c0-6e37944e704c None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:46.369228 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 296/578] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:46.369228 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0b0c0-13a3-4a27-88c0-6e37944e704c None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:46.437755 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d018a5d0-9baa-4bd2-a79b-f3ddaed9e070 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:46.480642 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa75355-47ab-4435-bbca-5e0fe91b51e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:46.481473 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa75355-47ab-4435-bbca-5e0fe91b51e9 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:46.481760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa75355-47ab-4435-bbca-5e0fe91b51e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:46.482034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa75355-47ab-4435-bbca-5e0fe91b51e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:46.493093 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0b0c0-13a3-4a27-88c0-6e37944e704c None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:46.493678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa75355-47ab-4435-bbca-5e0fe91b51e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:46.495187 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa75355-47ab-4435-bbca-5e0fe91b51e9 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:46.513823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-4fa75355-47ab-4435-bbca-5e0fe91b51e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:46.513823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:46.513823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:46.513823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:46.513823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:46.513823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:46.513823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:46.513823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:46.513823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:46.513823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:46.513823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:46.513823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:46.513823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:46.513823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:46.513823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:46.515316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:46.515316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:46.515316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:46.515316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:46.515316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:46.515316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:46.515316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:46.515316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:46.515316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:46.515316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:46.515316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:46.515316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:46.515316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:46.515316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:46.515316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:46.515316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:46.515316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:46.517266 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:46.517266 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:46.517266 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:46.517266 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:46.517266 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 283/579] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:46.517266 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa75355-47ab-4435-bbca-5e0fe91b51e9 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:46.537825 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc4dbf-f0c3-47c3-bab1-4a20bfdf3944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:46.538852 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc4dbf-f0c3-47c3-bab1-4a20bfdf3944 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:46.539398 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc4dbf-f0c3-47c3-bab1-4a20bfdf3944 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:46.539813 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc4dbf-f0c3-47c3-bab1-4a20bfdf3944 None admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:46.540829 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc4dbf-f0c3-47c3-bab1-4a20bfdf3944 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:46.541300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc4dbf-f0c3-47c3-bab1-4a20bfdf3944 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:46.543008 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc4dbf-f0c3-47c3-bab1-4a20bfdf3944 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:46.564552 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 297/580] 10.222.0.45 () {56 vars in 1137 bytes} [Thu Jun 2 19:02:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:46.565744 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc4dbf-f0c3-47c3-bab1-4a20bfdf3944 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:46.593483 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:46.615967 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:46.640183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa75355-47ab-4435-bbca-5e0fe91b51e9 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:46.682320 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f857b7e-4358-4b0d-b243-7e23bc297636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:46.683119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f857b7e-4358-4b0d-b243-7e23bc297636 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:46.683396 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f857b7e-4358-4b0d-b243-7e23bc297636 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:46.683666 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f857b7e-4358-4b0d-b243-7e23bc297636 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:46.684024 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc4dbf-f0c3-47c3-bab1-4a20bfdf3944 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:46.695449 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f857b7e-4358-4b0d-b243-7e23bc297636 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:46.703157 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-8f857b7e-4358-4b0d-b243-7e23bc297636 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:46.703157 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:46.703157 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:46.703157 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:46.703157 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:46.703157 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:46.703157 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:46.703157 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:46.703157 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:46.703157 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:46.703157 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:46.703157 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:46.703157 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:46.703157 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:46.703157 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:46.703157 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:46.705219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:46.705219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:46.705219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:46.705219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:46.705219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:46.705219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:46.705219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:46.705219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:46.705219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:46.705219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:46.705219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:46.705219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:46.705219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:46.705219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:46.705219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:46.705219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:46.706876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:46.706876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:46.706876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:46.706876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:46.706876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:46.706876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:46.706876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:46.706876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:46.706876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:46.706876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:46.706876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:46.706876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:46.706876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 284/581] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jun 2 19:02:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:46.706876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f857b7e-4358-4b0d-b243-7e23bc297636 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:46.731329 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28db1a9-86a6-42f1-9405-329cd29395b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:46.732273 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28db1a9-86a6-42f1-9405-329cd29395b7 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:46.732624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28db1a9-86a6-42f1-9405-329cd29395b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:46.732967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28db1a9-86a6-42f1-9405-329cd29395b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:46.740995 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28db1a9-86a6-42f1-9405-329cd29395b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:46.742549 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28db1a9-86a6-42f1-9405-329cd29395b7 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:46.757950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-d28db1a9-86a6-42f1-9405-329cd29395b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:46.757950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:46.757950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:46.757950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:46.757950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:46.757950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:46.757950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:46.757950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:46.757950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:46.757950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:46.757950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:46.757950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:46.757950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:02:46.757950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:02:46.757950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:02:46.758911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:02:46.758911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:46.758911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:46.758911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:46.758911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:46.758911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:46.758911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:46.758911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:46.758911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:46.758911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:46.758911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:46.758911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:46.758911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:46.758911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:46.758911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:46.758911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:46.758911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:46.759786 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:02:46.759786 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:02:46.759786 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:02:46.759786 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:02:46.759786 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:02:46.759786 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:02:46.759786 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:46.759786 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:46.759786 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 298/582] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:02:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:46.760322 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28db1a9-86a6-42f1-9405-329cd29395b7 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:46.825727 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f857b7e-4358-4b0d-b243-7e23bc297636 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:46.853917 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:46.864042 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222dad6-3e23-4aee-8feb-1e3d4fe0b3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:46.864707 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222dad6-3e23-4aee-8feb-1e3d4fe0b3ee None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:46.867270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222dad6-3e23-4aee-8feb-1e3d4fe0b3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:46.867270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222dad6-3e23-4aee-8feb-1e3d4fe0b3ee None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:46.867270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222dad6-3e23-4aee-8feb-1e3d4fe0b3ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:46.867270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222dad6-3e23-4aee-8feb-1e3d4fe0b3ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:46.867662 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222dad6-3e23-4aee-8feb-1e3d4fe0b3ee None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:46.870732 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28db1a9-86a6-42f1-9405-329cd29395b7 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:46.875481 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:46.886166 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 285/583] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:46.887115 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222dad6-3e23-4aee-8feb-1e3d4fe0b3ee None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:46.915814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d562f-fa79-4c3b-955b-d29c9c2d2ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:46.916647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d562f-fa79-4c3b-955b-d29c9c2d2ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:46.917276 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d562f-fa79-4c3b-955b-d29c9c2d2ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:46.917276 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d562f-fa79-4c3b-955b-d29c9c2d2ba2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:46.928792 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d562f-fa79-4c3b-955b-d29c9c2d2ba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:46.930257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d562f-fa79-4c3b-955b-d29c9c2d2ba2 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:46.948759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-453d562f-fa79-4c3b-955b-d29c9c2d2ba2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:46.948759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:46.948759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:46.948759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:46.948759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:46.948759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:46.948759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:46.948759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:46.948759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:46.948759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:46.948759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:46.948759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:46.948759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:46.948759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:46.948759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:46.949670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:46.949670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:46.949670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:46.949670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:46.949670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:46.949670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:46.949670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:46.949670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:46.949670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:46.949670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:46.949670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:46.949670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:46.949670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:46.949670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:46.949670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:46.949670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:46.949670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:46.950555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:46.950555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:46.950555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:46.950555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:46.950555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 299/584] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:46.950838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d562f-fa79-4c3b-955b-d29c9c2d2ba2 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:47.017975 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222dad6-3e23-4aee-8feb-1e3d4fe0b3ee None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:47.059445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d562f-fa79-4c3b-955b-d29c9c2d2ba2 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:47.065838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd6ee4-b9a1-495b-8db5-794f7ccee4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:47.066727 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd6ee4-b9a1-495b-8db5-794f7ccee4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:47.067624 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd6ee4-b9a1-495b-8db5-794f7ccee4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:47.068139 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd6ee4-b9a1-495b-8db5-794f7ccee4d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:47.069406 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd6ee4-b9a1-495b-8db5-794f7ccee4d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:47.069897 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd6ee4-b9a1-495b-8db5-794f7ccee4d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:47.072174 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd6ee4-b9a1-495b-8db5-794f7ccee4d9 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:47.088159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 286/585] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jun 2 19:02:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:47.089210 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd6ee4-b9a1-495b-8db5-794f7ccee4d9 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:47.100215 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02132f10-1020-43e4-9a9f-75684d173a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:47.100876 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02132f10-1020-43e4-9a9f-75684d173a8e None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:47.101158 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02132f10-1020-43e4-9a9f-75684d173a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:47.101430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02132f10-1020-43e4-9a9f-75684d173a8e None admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:47.102207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02132f10-1020-43e4-9a9f-75684d173a8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:47.102512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02132f10-1020-43e4-9a9f-75684d173a8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:47.103934 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02132f10-1020-43e4-9a9f-75684d173a8e None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:47.106959 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:47.126572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 300/586] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:02:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:47.126572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02132f10-1020-43e4-9a9f-75684d173a8e None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:47.158117 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:47.206282 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd6ee4-b9a1-495b-8db5-794f7ccee4d9 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:47.244255 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02132f10-1020-43e4-9a9f-75684d173a8e None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:47.246166 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7413c0-a287-4380-9b5b-982946c4e6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:47.247167 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7413c0-a287-4380-9b5b-982946c4e6db None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:47.247447 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7413c0-a287-4380-9b5b-982946c4e6db None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:47.247727 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7413c0-a287-4380-9b5b-982946c4e6db None admin] PATH_INFO: `/v3/users/glance` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:47.256884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7413c0-a287-4380-9b5b-982946c4e6db None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:47.258572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7413c0-a287-4380-9b5b-982946c4e6db None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:47.273645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-cd7413c0-a287-4380-9b5b-982946c4e6db None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 19:02:47.273645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:47.273645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:47.273645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:47.273645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:47.273645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:47.273645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:47.273645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:47.273645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:47.273645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:47.273645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:47.273645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:47.273645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:02:47.273645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:02:47.273645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:02:47.273645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:02:47.274680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:47.274680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:47.274680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:02:47.274680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:47.274680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:02:47.274680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:47.274680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:47.274680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:47.274680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:47.274680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:47.274680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:47.274680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:47.274680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:47.274680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:47.274680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:47.274680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:47.274680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:47.274680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:47.275622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:47.275622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:47.275622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:02:47.275622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:02:47.275622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:02:47.275622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:02:47.275622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:02:47.275622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:02:47.275622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 19:02:47.275622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:47.275622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 287/587] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:47.276998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7413c0-a287-4380-9b5b-982946c4e6db None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:47.286316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ee2bf-dce4-4346-b757-8472973cb8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:47.287000 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ee2bf-dce4-4346-b757-8472973cb8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:47.287279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ee2bf-dce4-4346-b757-8472973cb8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:47.287551 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ee2bf-dce4-4346-b757-8472973cb8b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:47.288320 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ee2bf-dce4-4346-b757-8472973cb8b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:47.288623 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ee2bf-dce4-4346-b757-8472973cb8b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:47.290218 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ee2bf-dce4-4346-b757-8472973cb8b7 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:47.308144 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 301/588] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:47.308144 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ee2bf-dce4-4346-b757-8472973cb8b7 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:47.374293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:47.400189 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7413c0-a287-4380-9b5b-982946c4e6db None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:47.424483 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:47.424916 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ee2bf-dce4-4346-b757-8472973cb8b7 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:47.439982 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424327c-2d4c-4674-97b5-c3fda1fb9030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:47.440801 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424327c-2d4c-4674-97b5-c3fda1fb9030 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:47.441079 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424327c-2d4c-4674-97b5-c3fda1fb9030 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:47.441353 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424327c-2d4c-4674-97b5-c3fda1fb9030 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:47.454468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424327c-2d4c-4674-97b5-c3fda1fb9030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:47.455922 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424327c-2d4c-4674-97b5-c3fda1fb9030 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:47.462163 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28a3be-561b-4076-8ada-41f4f63e124c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:47.462767 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28a3be-561b-4076-8ada-41f4f63e124c None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:47.463049 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28a3be-561b-4076-8ada-41f4f63e124c None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:47.463326 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28a3be-561b-4076-8ada-41f4f63e124c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:47.464192 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28a3be-561b-4076-8ada-41f4f63e124c None admin] RBAC: Adding query filter params (role.id=13ff8a5ffa5648c28ec00aa75b69d913, scope.project.id=b11b7e66a993492d8163097bce955c0b, user.id=87ba0ab9510d49c4ab4c634e82790efb) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:47.464508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28a3be-561b-4076-8ada-41f4f63e124c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:47.465967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28a3be-561b-4076-8ada-41f4f63e124c None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:47.480304 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 302/589] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:02:47 2022] GET /identity/v3/role_assignments?user.id=87ba0ab9510d49c4ab4c634e82790efb&scope.project.id=b11b7e66a993492d8163097bce955c0b&role.id=13ff8a5ffa5648c28ec00aa75b69d913 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:47.480304 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28a3be-561b-4076-8ada-41f4f63e124c None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:47.480798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-6424327c-2d4c-4674-97b5-c3fda1fb9030 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:47.480798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:47.480798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:47.480798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:47.480798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:47.480798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:47.480798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:47.480798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:47.480798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:47.480798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:47.480798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:47.480798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:47.480798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:47.480798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:47.480798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:47.481706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:47.481706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:47.481706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:47.481706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:47.481706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:47.481706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:47.481706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:47.481706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:47.481706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:47.481706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:47.481706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:47.481706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:47.481706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:47.481706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:47.481706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:47.481706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:47.481706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:47.482595 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:47.482595 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:47.482595 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:47.482595 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:47.482595 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 288/590] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:47.482595 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424327c-2d4c-4674-97b5-c3fda1fb9030 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:47.627392 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424327c-2d4c-4674-97b5-c3fda1fb9030 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:47.645258 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28a3be-561b-4076-8ada-41f4f63e124c None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:47.671424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:47.673548 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531e958-448f-4d17-93d5-b3791affb957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:47.674768 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531e958-448f-4d17-93d5-b3791affb957 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:47.675491 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531e958-448f-4d17-93d5-b3791affb957 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:47.676361 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531e958-448f-4d17-93d5-b3791affb957 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:47.684947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531e958-448f-4d17-93d5-b3791affb957 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:47.686692 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531e958-448f-4d17-93d5-b3791affb957 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:47.687268 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a22737-df39-434b-8a18-668ff2505f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:47.690946 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a22737-df39-434b-8a18-668ff2505f11 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:47.690946 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a22737-df39-434b-8a18-668ff2505f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:47.690946 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a22737-df39-434b-8a18-668ff2505f11 None admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:47.690946 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a22737-df39-434b-8a18-668ff2505f11 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:47.690946 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a22737-df39-434b-8a18-668ff2505f11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:47.691337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a22737-df39-434b-8a18-668ff2505f11 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:47.703232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-5531e958-448f-4d17-93d5-b3791affb957 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:47.703232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:47.703232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:47.703232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:47.703232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:47.703232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:47.703232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:47.703232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:47.703232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:47.703232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:47.703232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:47.703232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:47.703232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:02:47.703232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:02:47.703232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:02:47.704235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:02:47.704235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:47.704235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:47.704235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:47.704235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:47.704235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:47.704235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:47.704235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:47.704235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:47.704235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:47.704235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:47.704235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:47.704235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:47.704235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:47.704235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:47.704235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:47.704235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:47.705556 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:02:47.705556 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:02:47.705556 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:02:47.705556 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:02:47.705556 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:02:47.705556 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:02:47.705556 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:47.705556 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:47.705556 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 289/591] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:02:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:47.706034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531e958-448f-4d17-93d5-b3791affb957 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:47.713764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 303/592] 10.222.0.45 () {56 vars in 1137 bytes} [Thu Jun 2 19:02:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:47.714745 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a22737-df39-434b-8a18-668ff2505f11 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:47.744737 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:47.820852 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531e958-448f-4d17-93d5-b3791affb957 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:47.831957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a22737-df39-434b-8a18-668ff2505f11 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:47.859119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea8dda-ea5c-4fb1-ba28-b75a57950430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:47.859793 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea8dda-ea5c-4fb1-ba28-b75a57950430 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:47.860931 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea8dda-ea5c-4fb1-ba28-b75a57950430 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:47.861049 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea8dda-ea5c-4fb1-ba28-b75a57950430 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:47.861775 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea8dda-ea5c-4fb1-ba28-b75a57950430 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:47.862072 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea8dda-ea5c-4fb1-ba28-b75a57950430 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:47.863544 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea8dda-ea5c-4fb1-ba28-b75a57950430 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:47.872861 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92361072-9399-43a5-8ce1-45db8d837c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:47.873735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92361072-9399-43a5-8ce1-45db8d837c14 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:47.874230 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92361072-9399-43a5-8ce1-45db8d837c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:47.874670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92361072-9399-43a5-8ce1-45db8d837c14 None admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:47.875605 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92361072-9399-43a5-8ce1-45db8d837c14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:47.876586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92361072-9399-43a5-8ce1-45db8d837c14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:47.878198 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92361072-9399-43a5-8ce1-45db8d837c14 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:47.880937 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 290/593] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:47.881962 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea8dda-ea5c-4fb1-ba28-b75a57950430 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:47.892764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 304/594] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:02:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:47.894066 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92361072-9399-43a5-8ce1-45db8d837c14 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:47.937461 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:47.985994 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:47.996408 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea8dda-ea5c-4fb1-ba28-b75a57950430 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:48.006667 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92361072-9399-43a5-8ce1-45db8d837c14 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:48.035168 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c33a16-e10d-4ff7-8311-2c57afddb9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:48.036506 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c33a16-e10d-4ff7-8311-2c57afddb9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:48.036993 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c33a16-e10d-4ff7-8311-2c57afddb9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:48.037463 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c33a16-e10d-4ff7-8311-2c57afddb9d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:48.043750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e4d03-c04f-4965-af56-d7bca99a67c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:48.044629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e4d03-c04f-4965-af56-d7bca99a67c1 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:48.044911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e4d03-c04f-4965-af56-d7bca99a67c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:48.045186 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e4d03-c04f-4965-af56-d7bca99a67c1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:48.050668 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c33a16-e10d-4ff7-8311-2c57afddb9d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:48.052509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c33a16-e10d-4ff7-8311-2c57afddb9d3 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:48.054069 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e4d03-c04f-4965-af56-d7bca99a67c1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:48.055782 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e4d03-c04f-4965-af56-d7bca99a67c1 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:48.071316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-319e4d03-c04f-4965-af56-d7bca99a67c1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 19:02:48.071316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:48.071316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:48.071316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:48.071316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:48.071316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:48.071316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:48.071316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:48.071316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:48.071316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:48.071316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:48.071316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:48.071316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:02:48.071316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:02:48.071316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:02:48.071316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:02:48.072355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:48.072355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:48.072355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:02:48.072355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:48.072355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:02:48.072355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:48.072355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:48.072355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:48.072355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:48.072355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:48.072355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:48.072355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:48.072355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:48.072355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:48.072355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:48.072355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:48.072355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:48.072355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:48.073278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:48.073278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:48.073278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:02:48.073278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:02:48.073278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:02:48.073278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:02:48.073278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:02:48.073278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:02:48.073278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 19:02:48.073278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:48.074659 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-90c33a16-e10d-4ff7-8311-2c57afddb9d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:48.074659 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:48.074659 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:48.074659 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:48.074659 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:48.074659 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:48.074659 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:48.074659 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:48.074659 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:48.074659 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:48.074659 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:48.074659 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:48.074659 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:48.074659 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:48.074659 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:48.075499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:48.075499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:48.075499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:48.075499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:48.075499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:48.075499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:48.075499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:48.075499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:48.075499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:48.075499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:48.075499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:48.075499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:48.075499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:48.075499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:48.075499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:48.075499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:48.075499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:48.076420 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:48.076420 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:48.076420 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:48.076420 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:48.077811 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 305/595] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jun 2 19:02:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:48.083545 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e4d03-c04f-4965-af56-d7bca99a67c1 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:48.083934 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 291/596] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:48.085069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c33a16-e10d-4ff7-8311-2c57afddb9d3 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:48.184596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:48.188762 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e4d03-c04f-4965-af56-d7bca99a67c1 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:48.195516 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c33a16-e10d-4ff7-8311-2c57afddb9d3 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:48.228089 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5a081-48c6-4557-9808-34d3a0b4f60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:48.229012 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5a081-48c6-4557-9808-34d3a0b4f60d None admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:48.229293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5a081-48c6-4557-9808-34d3a0b4f60d None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:48.229640 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5a081-48c6-4557-9808-34d3a0b4f60d None admin] PATH_INFO: `/v3/projects/b11b7e66a993492d8163097bce955c0b/users/abb1dec309904b009271f36cd9157511/roles/13ff8a5ffa5648c28ec00aa75b69d913` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:48.236614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05ace2-47fb-483e-b708-415e5f3809b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:48.237695 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05ace2-47fb-483e-b708-415e5f3809b2 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:48.238197 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05ace2-47fb-483e-b708-415e5f3809b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:48.238671 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05ace2-47fb-483e-b708-415e5f3809b2 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:48.239902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05ace2-47fb-483e-b708-415e5f3809b2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:48.240469 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05ace2-47fb-483e-b708-415e5f3809b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:48.242185 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05ace2-47fb-483e-b708-415e5f3809b2 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:48.247522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5a081-48c6-4557-9808-34d3a0b4f60d None admin] RBAC: Authorizing `identity:create_grant(project_id=b11b7e66a993492d8163097bce955c0b, user_id=abb1dec309904b009271f36cd9157511, role_id=13ff8a5ffa5648c28ec00aa75b69d913)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:48.249089 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5a081-48c6-4557-9808-34d3a0b4f60d None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:48.264167 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 292/597] 10.222.0.45 () {56 vars in 1139 bytes} [Thu Jun 2 19:02:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:48.265381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05ace2-47fb-483e-b708-415e5f3809b2 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:48.269182 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:48.332351 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 306/598] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jun 2 19:02:48 2022] PUT /identity/v3/projects/b11b7e66a993492d8163097bce955c0b/users/abb1dec309904b009271f36cd9157511/roles/13ff8a5ffa5648c28ec00aa75b69d913 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:48.334143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5a081-48c6-4557-9808-34d3a0b4f60d None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:48.378784 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05ace2-47fb-483e-b708-415e5f3809b2 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:48.419537 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd11c1-c4ff-45f9-af8c-de04280441d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:48.420319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd11c1-c4ff-45f9-af8c-de04280441d8 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:48.420603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd11c1-c4ff-45f9-af8c-de04280441d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:48.420887 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd11c1-c4ff-45f9-af8c-de04280441d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:48.421758 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd11c1-c4ff-45f9-af8c-de04280441d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:48.422065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd11c1-c4ff-45f9-af8c-de04280441d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:48.424220 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd11c1-c4ff-45f9-af8c-de04280441d8 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:48.442186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 293/599] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:48.443220 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd11c1-c4ff-45f9-af8c-de04280441d8 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:48.587978 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:48.603248 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5a081-48c6-4557-9808-34d3a0b4f60d None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:48.637099 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd11c1-c4ff-45f9-af8c-de04280441d8 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:48.648308 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83d03b-7826-42fd-bd47-c790e35a55dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:48.649730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83d03b-7826-42fd-bd47-c790e35a55dc None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:48.650213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83d03b-7826-42fd-bd47-c790e35a55dc None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:48.650825 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83d03b-7826-42fd-bd47-c790e35a55dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:48.664152 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83d03b-7826-42fd-bd47-c790e35a55dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:48.666687 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83d03b-7826-42fd-bd47-c790e35a55dc None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:48.672947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d21bd-430d-4486-aed6-b6c0e8bc566e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:48.673777 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d21bd-430d-4486-aed6-b6c0e8bc566e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:48.674067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d21bd-430d-4486-aed6-b6c0e8bc566e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:48.674340 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d21bd-430d-4486-aed6-b6c0e8bc566e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:48.682108 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d21bd-430d-4486-aed6-b6c0e8bc566e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:48.683608 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d21bd-430d-4486-aed6-b6c0e8bc566e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:48.686415 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:48.691519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-da83d03b-7826-42fd-bd47-c790e35a55dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:48.691519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:48.691519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:48.691519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:48.691519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:48.691519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:48.691519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:48.691519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:48.691519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:48.691519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:48.691519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:48.691519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:48.691519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:48.691519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:48.691519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:48.692442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:48.692442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:48.692442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:48.692442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:48.692442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:48.692442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:48.692442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:48.692442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:48.692442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:48.692442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:48.692442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:48.692442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:48.692442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:48.692442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:48.692442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:48.692442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:48.692442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:48.693319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:48.693319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:48.693319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:48.693319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:48.693319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 307/600] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:48.694207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d7967-46a5-44f9-9305-faaa6a9476cb None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:48.694311 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d7967-46a5-44f9-9305-faaa6a9476cb None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:48.694556 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d7967-46a5-44f9-9305-faaa6a9476cb None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:48.700472 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 308/601] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:48.701257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d7967-46a5-44f9-9305-faaa6a9476cb None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:48.707607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-3e5d21bd-430d-4486-aed6-b6c0e8bc566e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:48.707607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:48.707607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:48.707607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:48.707607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:48.707607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:48.707607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:48.707607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:48.707607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:48.707607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:48.707607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:48.707607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:48.707607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:02:48.707607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:02:48.707607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:02:48.708542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:02:48.708542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:48.708542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:48.708542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:48.708542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:48.708542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:48.708542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:48.708542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:48.708542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:48.708542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:48.708542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:48.708542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:48.708542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:48.708542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:48.708542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:48.708542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:48.708542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:48.709504 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:02:48.709504 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:02:48.709504 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:02:48.709504 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:02:48.709504 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:02:48.709504 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:02:48.709504 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:48.709504 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:48.709504 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 294/602] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:02:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:48.710862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774a333-168c-46d6-b0a8-bcd5fd70dc7a None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:48.713744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774a333-168c-46d6-b0a8-bcd5fd70dc7a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:48.713744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774a333-168c-46d6-b0a8-bcd5fd70dc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:48.732413 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-2774a333-168c-46d6-b0a8-bcd5fd70dc7a None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:48.733751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2774a333-168c-46d6-b0a8-bcd5fd70dc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:48.812212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 295/603] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 19:02:48.813864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774a333-168c-46d6-b0a8-bcd5fd70dc7a None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:48.828868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d7967-46a5-44f9-9305-faaa6a9476cb None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:48.865647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455dfd34-6685-4b92-86b2-50ff9c73402d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:48.866243 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dfd34-6685-4b92-86b2-50ff9c73402d None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:48.866513 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dfd34-6685-4b92-86b2-50ff9c73402d None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:48.866785 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dfd34-6685-4b92-86b2-50ff9c73402d None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:48.867559 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455dfd34-6685-4b92-86b2-50ff9c73402d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:48.867857 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455dfd34-6685-4b92-86b2-50ff9c73402d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:48.869324 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455dfd34-6685-4b92-86b2-50ff9c73402d None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:48.882421 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 309/604] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:48.887532 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455dfd34-6685-4b92-86b2-50ff9c73402d None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:48.924380 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:48.944319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774a333-168c-46d6-b0a8-bcd5fd70dc7a None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:48.951937 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:48.983978 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dec48-af07-4661-bde7-ca52b64593c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:48.984745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dec48-af07-4661-bde7-ca52b64593c7 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:48.985056 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dec48-af07-4661-bde7-ca52b64593c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:48.985333 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dec48-af07-4661-bde7-ca52b64593c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:48.986184 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dec48-af07-4661-bde7-ca52b64593c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:48.986496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dec48-af07-4661-bde7-ca52b64593c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:48.987942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dec48-af07-4661-bde7-ca52b64593c7 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:48.995183 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455dfd34-6685-4b92-86b2-50ff9c73402d None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:49.004319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 296/605] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:02:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:49.005224 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dec48-af07-4661-bde7-ca52b64593c7 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:49.030887 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a265e-f72a-469e-93f8-2a2984b70baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:49.031715 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a265e-f72a-469e-93f8-2a2984b70baf None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:49.032645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a265e-f72a-469e-93f8-2a2984b70baf None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:49.032923 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a265e-f72a-469e-93f8-2a2984b70baf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:49.043465 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a265e-f72a-469e-93f8-2a2984b70baf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:49.051116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-089a265e-f72a-469e-93f8-2a2984b70baf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:49.051116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:49.051116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:49.051116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:49.051116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:49.051116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:49.051116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:49.051116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:49.051116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:49.051116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:49.051116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:49.051116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:49.051116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:49.051116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:49.051116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:49.051116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:49.054883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:49.054883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:49.054883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:49.054883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:49.054883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:49.054883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:49.054883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:49.054883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:49.054883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:49.054883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:49.054883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:49.054883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:49.054883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:49.054883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:49.054883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:49.054883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:49.061450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:49.061450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:49.061450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:49.061450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:49.061450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:49.061450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:49.061450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:49.061450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:49.061450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:49.061450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:49.061450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:49.061450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:49.061450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 310/606] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jun 2 19:02:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:49.061450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a265e-f72a-469e-93f8-2a2984b70baf None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:49.116883 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dec48-af07-4661-bde7-ca52b64593c7 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:49.131601 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:49.155596 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f051dfe-33ef-4a29-a74b-da4bf2501dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:49.156661 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f051dfe-33ef-4a29-a74b-da4bf2501dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:49.157113 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f051dfe-33ef-4a29-a74b-da4bf2501dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:49.157570 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f051dfe-33ef-4a29-a74b-da4bf2501dc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:49.158082 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a265e-f72a-469e-93f8-2a2984b70baf None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:49.166170 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f051dfe-33ef-4a29-a74b-da4bf2501dc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:49.167959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f051dfe-33ef-4a29-a74b-da4bf2501dc0 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:49.178881 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:49.184792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-7f051dfe-33ef-4a29-a74b-da4bf2501dc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:49.184792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:49.184792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:49.184792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:49.184792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:49.184792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:49.184792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:49.184792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:49.184792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:49.184792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:49.184792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:49.184792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:49.184792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:02:49.184792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:02:49.184792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:02:49.185878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:02:49.185878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:49.185878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:49.185878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:49.185878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:49.185878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:49.185878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:49.185878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:49.185878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:49.185878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:49.185878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:49.185878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:49.185878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:49.185878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:49.185878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:49.185878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:49.185878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:49.186854 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:02:49.186854 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:02:49.186854 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:02:49.186854 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:02:49.186854 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:02:49.186854 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:02:49.186854 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:49.186854 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:49.189477 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 297/607] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:02:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:49.195547 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f051dfe-33ef-4a29-a74b-da4bf2501dc0 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:49.199966 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c99059-71ce-4541-b58c-a3b93e59c2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:49.201077 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c99059-71ce-4541-b58c-a3b93e59c2c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:49.201562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c99059-71ce-4541-b58c-a3b93e59c2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:49.202081 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c99059-71ce-4541-b58c-a3b93e59c2c7 None admin] PATH_INFO: `/v3/projects/b11b7e66a993492d8163097bce955c0b/users/226743f4f93c44c5aef5919a7813bd3c/roles/13ff8a5ffa5648c28ec00aa75b69d913` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:49.222660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c99059-71ce-4541-b58c-a3b93e59c2c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b11b7e66a993492d8163097bce955c0b, user_id=226743f4f93c44c5aef5919a7813bd3c, role_id=13ff8a5ffa5648c28ec00aa75b69d913)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:49.224369 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c99059-71ce-4541-b58c-a3b93e59c2c7 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:49.306365 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f051dfe-33ef-4a29-a74b-da4bf2501dc0 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:49.324586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 311/608] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jun 2 19:02:49 2022] PUT /identity/v3/projects/b11b7e66a993492d8163097bce955c0b/users/226743f4f93c44c5aef5919a7813bd3c/roles/13ff8a5ffa5648c28ec00aa75b69d913 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:49.325997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c99059-71ce-4541-b58c-a3b93e59c2c7 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:49.375441 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61647b90-a394-4138-8d54-4e30164c80c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:49.376099 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61647b90-a394-4138-8d54-4e30164c80c4 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:49.376384 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61647b90-a394-4138-8d54-4e30164c80c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:49.376657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61647b90-a394-4138-8d54-4e30164c80c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:49.381856 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61647b90-a394-4138-8d54-4e30164c80c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:49.382203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61647b90-a394-4138-8d54-4e30164c80c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:49.386326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61647b90-a394-4138-8d54-4e30164c80c4 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:49.406747 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 298/609] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jun 2 19:02:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:49.411531 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61647b90-a394-4138-8d54-4e30164c80c4 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:49.531866 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:49.582767 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c99059-71ce-4541-b58c-a3b93e59c2c7 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:49.621098 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61647b90-a394-4138-8d54-4e30164c80c4 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:49.630282 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316f337-cb84-4f26-af80-40463b242f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:49.630882 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316f337-cb84-4f26-af80-40463b242f74 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:49.631164 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316f337-cb84-4f26-af80-40463b242f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:49.631439 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316f337-cb84-4f26-af80-40463b242f74 None admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:49.632270 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316f337-cb84-4f26-af80-40463b242f74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:49.632575 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316f337-cb84-4f26-af80-40463b242f74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:49.634143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316f337-cb84-4f26-af80-40463b242f74 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:49.648898 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 312/610] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:02:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:49.654469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316f337-cb84-4f26-af80-40463b242f74 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:49.659931 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db828b14-db21-4086-b5c5-812b9a800c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:49.660969 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db828b14-db21-4086-b5c5-812b9a800c3f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:49.661393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db828b14-db21-4086-b5c5-812b9a800c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:49.661832 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db828b14-db21-4086-b5c5-812b9a800c3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:49.696935 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db828b14-db21-4086-b5c5-812b9a800c3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:49.698678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db828b14-db21-4086-b5c5-812b9a800c3f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:49.708752 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:49.744165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-db828b14-db21-4086-b5c5-812b9a800c3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:49.744165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:49.744165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:49.744165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:49.744165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:49.744165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:49.744165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:49.744165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:49.744165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:49.744165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:49.744165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:49.744165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:49.744165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:49.744165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:49.744165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:49.745150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:49.745150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:49.745150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:49.745150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:49.745150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:49.745150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:49.745150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:49.745150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:49.745150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:49.745150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:49.745150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:49.745150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:49.745150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:49.745150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:49.745150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:49.745150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:49.745150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:49.746119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:49.746119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:49.746119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:49.746119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:49.751775 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 299/611] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:49.752833 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db828b14-db21-4086-b5c5-812b9a800c3f None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:49.771485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316f337-cb84-4f26-af80-40463b242f74 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:49.811435 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea542d-b552-4aed-a926-cd9a57402d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:49.812457 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea542d-b552-4aed-a926-cd9a57402d4a None admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:49.812802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea542d-b552-4aed-a926-cd9a57402d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:49.813280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea542d-b552-4aed-a926-cd9a57402d4a None admin] PATH_INFO: `/v3/projects/b11b7e66a993492d8163097bce955c0b/users/2efd679ca9314c8591cabbca15f8c61b/roles/13ff8a5ffa5648c28ec00aa75b69d913` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:49.831342 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea542d-b552-4aed-a926-cd9a57402d4a None admin] RBAC: Authorizing `identity:create_grant(project_id=b11b7e66a993492d8163097bce955c0b, user_id=2efd679ca9314c8591cabbca15f8c61b, role_id=13ff8a5ffa5648c28ec00aa75b69d913)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:49.833089 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea542d-b552-4aed-a926-cd9a57402d4a None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:49.903014 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 313/612] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jun 2 19:02:49 2022] PUT /identity/v3/projects/b11b7e66a993492d8163097bce955c0b/users/2efd679ca9314c8591cabbca15f8c61b/roles/13ff8a5ffa5648c28ec00aa75b69d913 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:49.923525 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:49.942278 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db828b14-db21-4086-b5c5-812b9a800c3f None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:49.980966 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8a0a3-aef9-438d-8c08-8470f0bc35bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:49.981643 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8a0a3-aef9-438d-8c08-8470f0bc35bf None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:49.981919 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8a0a3-aef9-438d-8c08-8470f0bc35bf None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:49.982189 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8a0a3-aef9-438d-8c08-8470f0bc35bf None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:49.982979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8a0a3-aef9-438d-8c08-8470f0bc35bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:49.983283 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8a0a3-aef9-438d-8c08-8470f0bc35bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:49.984721 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8a0a3-aef9-438d-8c08-8470f0bc35bf None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:50.004851 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 300/613] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:50.010343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea542d-b552-4aed-a926-cd9a57402d4a None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:50.193409 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:50.214310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea542d-b552-4aed-a926-cd9a57402d4a None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:50.253504 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d24695-1dff-4575-8d20-6b88c247b84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:50.254319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d24695-1dff-4575-8d20-6b88c247b84c None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:50.254601 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d24695-1dff-4575-8d20-6b88c247b84c None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:50.254875 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d24695-1dff-4575-8d20-6b88c247b84c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:50.263221 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d24695-1dff-4575-8d20-6b88c247b84c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:50.264735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d24695-1dff-4575-8d20-6b88c247b84c None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:50.281788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-25d24695-1dff-4575-8d20-6b88c247b84c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 19:02:50.281788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:50.281788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:50.281788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:50.281788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:50.281788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:50.281788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:50.281788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:50.281788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:50.281788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:50.281788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:50.281788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:50.281788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:02:50.281788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:02:50.281788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:02:50.281788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:02:50.284359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:50.284359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:50.284359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:02:50.284359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:50.284359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:02:50.284359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:50.284359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:50.284359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:50.284359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:50.284359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:50.284359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:50.284359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:50.284359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:50.284359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:50.284359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:50.284359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:50.284359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:50.284359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:50.285510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:50.285510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:50.285510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:02:50.285510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:02:50.285510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:02:50.285510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:02:50.285510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:02:50.285510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:02:50.285510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 19:02:50.285510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:50.285510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 314/614] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Jun 2 19:02:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:50.291663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8a0a3-aef9-438d-8c08-8470f0bc35bf None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:50.344234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300edc6-bc94-4815-8a2b-d0aabbbb4a98 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:50.345135 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300edc6-bc94-4815-8a2b-d0aabbbb4a98 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:50.345355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300edc6-bc94-4815-8a2b-d0aabbbb4a98 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:50.346978 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 315/615] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:02:50.352448 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895fddf-2d73-4a4a-b777-5d45b1fe9aff None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:50.352737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895fddf-2d73-4a4a-b777-5d45b1fe9aff None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:50.353011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895fddf-2d73-4a4a-b777-5d45b1fe9aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:50.371140 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-1895fddf-2d73-4a4a-b777-5d45b1fe9aff None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:50.372404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-1895fddf-2d73-4a4a-b777-5d45b1fe9aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:50.447391 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 316/616] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 19:02:50.472260 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895fddf-2d73-4a4a-b777-5d45b1fe9aff None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:50.502772 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8a0a3-aef9-438d-8c08-8470f0bc35bf None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:50.550009 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:50.579029 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895fddf-2d73-4a4a-b777-5d45b1fe9aff None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:50.616772 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e09a0-635d-4e50-a9f2-5f5f117bf961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:50.617469 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e09a0-635d-4e50-a9f2-5f5f117bf961 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:50.617742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e09a0-635d-4e50-a9f2-5f5f117bf961 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:50.618020 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e09a0-635d-4e50-a9f2-5f5f117bf961 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:50.618989 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e09a0-635d-4e50-a9f2-5f5f117bf961 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:50.619400 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e09a0-635d-4e50-a9f2-5f5f117bf961 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:50.621082 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e09a0-635d-4e50-a9f2-5f5f117bf961 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:50.621564 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81245334-8dc8-4520-b91e-cc5057973115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:50.622364 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81245334-8dc8-4520-b91e-cc5057973115 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:50.622643 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81245334-8dc8-4520-b91e-cc5057973115 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:50.623032 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81245334-8dc8-4520-b91e-cc5057973115 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:50.646909 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81245334-8dc8-4520-b91e-cc5057973115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:50.658505 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 301/617] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Jun 2 19:02:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:02:50.659272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-81245334-8dc8-4520-b91e-cc5057973115 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:50.659272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:50.659272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:50.659272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:50.659272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:50.659272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:50.659272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:50.659272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:50.659272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:50.659272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:50.659272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:50.659272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:50.659272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:50.659272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:50.659272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:50.659272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:50.660353 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:50.660353 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:50.660353 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:50.660353 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:50.660353 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:50.660353 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:50.660353 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:50.660353 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:50.660353 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:50.660353 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:50.660353 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:50.660353 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:50.660353 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:50.660353 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:50.660353 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:50.660353 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:50.661525 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:50.661525 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:50.661525 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:50.661525 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:50.661525 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:50.661525 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:50.661525 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:50.661525 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:50.661525 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:50.661525 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:50.661525 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:50.661525 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:50.661525 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 317/618] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jun 2 19:02:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:50.665104 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e09a0-635d-4e50-a9f2-5f5f117bf961 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:50.670462 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81245334-8dc8-4520-b91e-cc5057973115 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:50.672059 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:50.845758 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e09a0-635d-4e50-a9f2-5f5f117bf961 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:50.867023 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81245334-8dc8-4520-b91e-cc5057973115 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:50.894783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4cfc5e-8eac-4bed-b31f-6a9c9a89bafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:50.895449 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cfc5e-8eac-4bed-b31f-6a9c9a89bafa None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:50.895726 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cfc5e-8eac-4bed-b31f-6a9c9a89bafa None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:50.896018 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cfc5e-8eac-4bed-b31f-6a9c9a89bafa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:50.939596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:50.952029 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7a73f-2b36-4ad3-a5d0-7ed7030eace0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:50.953157 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7a73f-2b36-4ad3-a5d0-7ed7030eace0 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:50.953656 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7a73f-2b36-4ad3-a5d0-7ed7030eace0 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:50.954801 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7a73f-2b36-4ad3-a5d0-7ed7030eace0 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:50.959687 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7a73f-2b36-4ad3-a5d0-7ed7030eace0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:50.960079 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7a73f-2b36-4ad3-a5d0-7ed7030eace0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:50.971125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7a73f-2b36-4ad3-a5d0-7ed7030eace0 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:50.980225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 318/619] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jun 2 19:02:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:50.982321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20183d-e521-4dcd-bd00-a543ba4d64a2 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:50.982609 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20183d-e521-4dcd-bd00-a543ba4d64a2 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:50.982885 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20183d-e521-4dcd-bd00-a543ba4d64a2 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:50.984548 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 319/620] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:50.987580 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20183d-e521-4dcd-bd00-a543ba4d64a2 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:51.021667 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4cfc5e-8eac-4bed-b31f-6a9c9a89bafa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:51.023196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4cfc5e-8eac-4bed-b31f-6a9c9a89bafa None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:51.026577 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:51.127730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20183d-e521-4dcd-bd00-a543ba4d64a2 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:51.131609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 302/621] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:02:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:51.132392 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863f1a1-58c0-4dc0-b9cc-c4587bed5079 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:51.132682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863f1a1-58c0-4dc0-b9cc-c4587bed5079 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:51.132962 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863f1a1-58c0-4dc0-b9cc-c4587bed5079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:51.150932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-3863f1a1-58c0-4dc0-b9cc-c4587bed5079 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:51.152384 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3863f1a1-58c0-4dc0-b9cc-c4587bed5079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:51.172305 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050b42b-fb79-4016-bbda-8bc08144a6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:51.173561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050b42b-fb79-4016-bbda-8bc08144a6ba None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:51.174070 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050b42b-fb79-4016-bbda-8bc08144a6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:51.174550 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050b42b-fb79-4016-bbda-8bc08144a6ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:51.187155 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050b42b-fb79-4016-bbda-8bc08144a6ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:51.189099 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050b42b-fb79-4016-bbda-8bc08144a6ba None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:51.212754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-b050b42b-fb79-4016-bbda-8bc08144a6ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:51.212754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:51.212754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:51.212754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:51.212754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:51.212754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:51.212754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:51.212754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:51.212754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:51.212754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:51.212754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:51.212754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:51.212754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:51.212754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:51.212754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:51.213735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:51.213735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:51.213735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:51.213735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:51.213735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:51.213735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:51.213735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:51.213735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:51.213735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:51.213735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:51.213735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:51.213735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:51.213735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:51.213735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:51.213735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:51.213735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:51.213735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:51.214621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:51.214621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:51.214621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:51.214621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:51.217461 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 320/622] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:51.218781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050b42b-fb79-4016-bbda-8bc08144a6ba None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:51.228728 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 303/623] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:51.229604 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863f1a1-58c0-4dc0-b9cc-c4587bed5079 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:51.280624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:51.294441 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:51.353484 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050b42b-fb79-4016-bbda-8bc08144a6ba None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:51.367381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863f1a1-58c0-4dc0-b9cc-c4587bed5079 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:51.404057 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602a264-eb3e-4cc0-bcff-992bdc670cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:51.405303 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602a264-eb3e-4cc0-bcff-992bdc670cbc None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:51.405796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602a264-eb3e-4cc0-bcff-992bdc670cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:51.406304 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602a264-eb3e-4cc0-bcff-992bdc670cbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:51.406499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92262171-cf56-4ff3-9ea7-62c9f5719a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:51.407699 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92262171-cf56-4ff3-9ea7-62c9f5719a3b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:51.407983 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92262171-cf56-4ff3-9ea7-62c9f5719a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:51.408293 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92262171-cf56-4ff3-9ea7-62c9f5719a3b None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:51.409145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92262171-cf56-4ff3-9ea7-62c9f5719a3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:51.409454 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92262171-cf56-4ff3-9ea7-62c9f5719a3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:51.410977 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92262171-cf56-4ff3-9ea7-62c9f5719a3b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:51.424662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602a264-eb3e-4cc0-bcff-992bdc670cbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:51.425282 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 304/624] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:51.426156 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92262171-cf56-4ff3-9ea7-62c9f5719a3b None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:51.427135 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602a264-eb3e-4cc0-bcff-992bdc670cbc None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:51.450634 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-8602a264-eb3e-4cc0-bcff-992bdc670cbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:51.450634 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:51.450634 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:51.450634 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:51.450634 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:51.450634 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:51.450634 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:51.450634 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:51.450634 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:51.450634 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:51.450634 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:51.450634 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:51.450634 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:51.450634 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:51.450634 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:51.451584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:51.451584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:51.451584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:51.451584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:51.451584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:51.451584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:51.451584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:51.451584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:51.451584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:51.451584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:51.451584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:51.451584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:51.451584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:51.451584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:51.451584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:51.451584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:51.451584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:51.452497 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:51.452497 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:51.452497 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:51.452497 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:51.455094 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 321/625] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:51.456295 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602a264-eb3e-4cc0-bcff-992bdc670cbc None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:51.537425 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:51.545680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92262171-cf56-4ff3-9ea7-62c9f5719a3b None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:51.574724 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:51.582850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f60b7-a46b-4900-8b13-4c9902eb4d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:51.583602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602a264-eb3e-4cc0-bcff-992bdc670cbc None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:51.583724 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f60b7-a46b-4900-8b13-4c9902eb4d24 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:51.584012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f60b7-a46b-4900-8b13-4c9902eb4d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:51.584298 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f60b7-a46b-4900-8b13-4c9902eb4d24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:51.598228 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f60b7-a46b-4900-8b13-4c9902eb4d24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:51.606394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-646f60b7-a46b-4900-8b13-4c9902eb4d24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:51.606394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:51.606394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:51.606394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:51.606394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:51.606394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:51.606394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:51.606394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:51.606394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:51.606394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:51.606394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:51.606394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:51.606394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:51.606394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:51.606394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:51.606394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:51.607387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:51.607387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:51.607387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:51.607387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:51.607387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:51.607387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:51.607387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:51.607387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:51.607387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:51.607387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:51.607387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:51.607387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:51.607387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:51.607387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:51.607387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:51.607387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:51.608298 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:51.608298 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:51.608298 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:51.608298 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:51.608298 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:51.608298 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:51.608298 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:51.608298 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:51.608298 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:51.608298 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:51.608298 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:51.608298 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:51.612279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 305/626] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jun 2 19:02:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:51.613205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f60b7-a46b-4900-8b13-4c9902eb4d24 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:51.629785 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398be42-649d-4be0-a758-0aa26f9aa80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:51.632172 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398be42-649d-4be0-a758-0aa26f9aa80b None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:51.633068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398be42-649d-4be0-a758-0aa26f9aa80b None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:51.633560 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398be42-649d-4be0-a758-0aa26f9aa80b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:51.645172 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398be42-649d-4be0-a758-0aa26f9aa80b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:51.647924 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398be42-649d-4be0-a758-0aa26f9aa80b None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:51.669645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-5398be42-649d-4be0-a758-0aa26f9aa80b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 19:02:51.669645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:51.669645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:51.669645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:51.669645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:51.669645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:51.669645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:51.669645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:51.669645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:51.669645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:51.669645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:51.669645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:51.669645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:02:51.669645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:02:51.669645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:02:51.669645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:02:51.670627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:51.670627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:51.670627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:02:51.670627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:51.670627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:02:51.670627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:51.670627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:51.670627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:51.670627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:51.670627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:51.670627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:51.670627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:51.670627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:51.670627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:51.670627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:51.670627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:51.670627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:51.670627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:51.671582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:51.671582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:51.671582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:02:51.671582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:02:51.671582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:02:51.671582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:02:51.671582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:02:51.671582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:02:51.671582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 19:02:51.671582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:51.678730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 322/627] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:02:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:51.678730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398be42-649d-4be0-a758-0aa26f9aa80b None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:51.745537 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f60b7-a46b-4900-8b13-4c9902eb4d24 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:51.797119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5f338-9b32-4818-812b-6bed8c35fe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:51.798788 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5f338-9b32-4818-812b-6bed8c35fe80 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:51.799267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5f338-9b32-4818-812b-6bed8c35fe80 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:51.799736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5f338-9b32-4818-812b-6bed8c35fe80 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:51.800820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5f338-9b32-4818-812b-6bed8c35fe80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:51.802871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5f338-9b32-4818-812b-6bed8c35fe80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:51.804794 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5f338-9b32-4818-812b-6bed8c35fe80 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:51.816949 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398be42-649d-4be0-a758-0aa26f9aa80b None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:51.827179 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 306/628] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:51.829160 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5f338-9b32-4818-812b-6bed8c35fe80 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:51.857243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:51.874362 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b76e8-9081-4976-9f79-9ade27ffd275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:51.875046 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b76e8-9081-4976-9f79-9ade27ffd275 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:51.875331 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b76e8-9081-4976-9f79-9ade27ffd275 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:51.877264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b76e8-9081-4976-9f79-9ade27ffd275 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:51.877264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b76e8-9081-4976-9f79-9ade27ffd275 None admin] RBAC: Adding query filter params (name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:51.877430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b76e8-9081-4976-9f79-9ade27ffd275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:51.878778 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b76e8-9081-4976-9f79-9ade27ffd275 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:51.893061 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 323/629] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jun 2 19:02:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:51.894055 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b76e8-9081-4976-9f79-9ade27ffd275 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:51.916657 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:51.986677 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5f338-9b32-4818-812b-6bed8c35fe80 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:52.025389 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b76e8-9081-4976-9f79-9ade27ffd275 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:52.027567 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b83f5-e595-4131-aae2-33b3d95fd979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:52.028321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b83f5-e595-4131-aae2-33b3d95fd979 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:52.028605 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b83f5-e595-4131-aae2-33b3d95fd979 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:52.028882 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b83f5-e595-4131-aae2-33b3d95fd979 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:52.029777 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b83f5-e595-4131-aae2-33b3d95fd979 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:52.030099 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b83f5-e595-4131-aae2-33b3d95fd979 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:52.031566 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b83f5-e595-4131-aae2-33b3d95fd979 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:52.052941 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 307/630] 10.222.0.45 () {56 vars in 1135 bytes} [Thu Jun 2 19:02:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:52.053860 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b83f5-e595-4131-aae2-33b3d95fd979 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:52.070325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa7531-95bc-4fcb-bdd6-c9824ba7a4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:52.071489 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa7531-95bc-4fcb-bdd6-c9824ba7a4cc None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:52.071917 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa7531-95bc-4fcb-bdd6-c9824ba7a4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:52.072461 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa7531-95bc-4fcb-bdd6-c9824ba7a4cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:52.082685 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa7531-95bc-4fcb-bdd6-c9824ba7a4cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:52.084335 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa7531-95bc-4fcb-bdd6-c9824ba7a4cc None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:52.102323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-39aa7531-95bc-4fcb-bdd6-c9824ba7a4cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:52.102323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:52.102323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:52.102323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:52.102323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:52.102323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:52.102323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:52.102323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:52.102323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:52.102323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:52.102323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:52.102323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:52.102323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:02:52.102323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:02:52.102323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:02:52.103307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:02:52.103307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:52.103307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:52.103307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:52.103307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:52.103307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:52.103307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:52.103307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:52.103307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:52.103307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:52.103307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:52.103307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:52.103307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:52.103307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:52.103307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:52.103307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:52.103307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:52.104207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:02:52.104207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:02:52.104207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:02:52.104207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:02:52.104207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:02:52.104207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:02:52.104207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:52.104207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:52.104207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 324/631] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:02:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:52.105175 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa7531-95bc-4fcb-bdd6-c9824ba7a4cc None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:52.140771 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:52.173743 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b83f5-e595-4131-aae2-33b3d95fd979 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:52.191693 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:52.218212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa7531-95bc-4fcb-bdd6-c9824ba7a4cc None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:52.219168 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667f8eb-36d3-49a4-ac7a-3f4a2c75963a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:52.220507 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667f8eb-36d3-49a4-ac7a-3f4a2c75963a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:52.220899 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667f8eb-36d3-49a4-ac7a-3f4a2c75963a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:52.221349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667f8eb-36d3-49a4-ac7a-3f4a2c75963a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:52.237867 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667f8eb-36d3-49a4-ac7a-3f4a2c75963a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:52.240315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667f8eb-36d3-49a4-ac7a-3f4a2c75963a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:52.271549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-2667f8eb-36d3-49a4-ac7a-3f4a2c75963a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:52.271549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:52.271549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:52.271549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:52.271549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:52.271549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:52.271549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:52.271549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:52.271549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:52.271549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:52.271549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:52.271549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:52.271549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:52.271549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:52.271549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:52.272767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:52.272767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:52.272767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:52.272767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:52.272767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:52.272767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:52.272767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:52.272767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:52.272767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:52.272767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:52.272767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:52.272767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:52.272767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:52.272767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:52.272767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:52.272767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:52.272767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:52.279206 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:52.279206 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:52.279206 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:52.279206 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:52.279206 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 308/632] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:52.279206 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b2f17-2848-4b9c-9d61-49bd57280dcb None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:52.279206 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b2f17-2848-4b9c-9d61-49bd57280dcb None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:52.279206 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b2f17-2848-4b9c-9d61-49bd57280dcb None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:52.279206 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 309/633] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:52.279715 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b2f17-2848-4b9c-9d61-49bd57280dcb None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:52.286438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e956b2-c66e-4070-88ae-b910b3c7665c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:52.287269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e956b2-c66e-4070-88ae-b910b3c7665c None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:52.287548 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e956b2-c66e-4070-88ae-b910b3c7665c None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:52.287823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e956b2-c66e-4070-88ae-b910b3c7665c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:52.300426 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e956b2-c66e-4070-88ae-b910b3c7665c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:52.302312 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e956b2-c66e-4070-88ae-b910b3c7665c None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:52.322154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-26e956b2-c66e-4070-88ae-b910b3c7665c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:52.322154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:52.322154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:52.322154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:52.322154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:52.322154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:52.322154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:52.322154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:52.322154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:52.322154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:52.322154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:52.322154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:52.322154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:52.322154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:52.322154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:52.323141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:52.323141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:52.323141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:52.323141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:52.323141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:52.323141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:52.323141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:52.323141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:52.323141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:52.323141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:52.323141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:52.323141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:52.323141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:52.323141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:52.323141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:52.323141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:52.323141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:52.324056 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:52.324056 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:52.324056 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:52.324056 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:52.328168 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 325/634] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:52.328883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e956b2-c66e-4070-88ae-b910b3c7665c None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:52.400091 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b2f17-2848-4b9c-9d61-49bd57280dcb None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:52.429499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:52.440556 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e956b2-c66e-4070-88ae-b910b3c7665c None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:52.441234 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e43fd-2a73-4ad2-995f-bbcd5c40af09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:52.441829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e43fd-2a73-4ad2-995f-bbcd5c40af09 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:52.442111 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e43fd-2a73-4ad2-995f-bbcd5c40af09 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:52.442381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e43fd-2a73-4ad2-995f-bbcd5c40af09 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:52.443567 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e43fd-2a73-4ad2-995f-bbcd5c40af09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:52.444075 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e43fd-2a73-4ad2-995f-bbcd5c40af09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:52.445559 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e43fd-2a73-4ad2-995f-bbcd5c40af09 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:52.463414 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 310/635] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:02:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:52.463414 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60d5b6-6f3a-4465-bc30-8bbe093e782f None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:52.463414 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60d5b6-6f3a-4465-bc30-8bbe093e782f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:52.463414 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60d5b6-6f3a-4465-bc30-8bbe093e782f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:52.478512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:52.478920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-da60d5b6-6f3a-4465-bc30-8bbe093e782f None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:52.480254 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-da60d5b6-6f3a-4465-bc30-8bbe093e782f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:52.489430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca644d54-821d-4cec-8afa-32854e71b557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:52.490045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca644d54-821d-4cec-8afa-32854e71b557 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:52.490331 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca644d54-821d-4cec-8afa-32854e71b557 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:52.490972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca644d54-821d-4cec-8afa-32854e71b557 None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:52.491717 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca644d54-821d-4cec-8afa-32854e71b557 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:52.492371 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca644d54-821d-4cec-8afa-32854e71b557 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:52.493794 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca644d54-821d-4cec-8afa-32854e71b557 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:52.506363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 326/636] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:52.507924 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca644d54-821d-4cec-8afa-32854e71b557 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:52.556157 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 311/637] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:52.557018 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60d5b6-6f3a-4465-bc30-8bbe093e782f None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:52.632671 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca644d54-821d-4cec-8afa-32854e71b557 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:52.669648 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60d5b6-6f3a-4465-bc30-8bbe093e782f None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:52.670600 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c43bc1-1a8f-40a0-ae13-fb1753133565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:52.671275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c43bc1-1a8f-40a0-ae13-fb1753133565 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:52.671556 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c43bc1-1a8f-40a0-ae13-fb1753133565 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:52.671832 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c43bc1-1a8f-40a0-ae13-fb1753133565 None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:52.672614 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c43bc1-1a8f-40a0-ae13-fb1753133565 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:52.673499 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c43bc1-1a8f-40a0-ae13-fb1753133565 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:52.674896 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c43bc1-1a8f-40a0-ae13-fb1753133565 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:52.685679 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:52.687284 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 327/638] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:52.688749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c43bc1-1a8f-40a0-ae13-fb1753133565 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:52.706601 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47338950-f7f3-4060-80e5-ed3e0036503b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:52.707262 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47338950-f7f3-4060-80e5-ed3e0036503b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:52.707549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47338950-f7f3-4060-80e5-ed3e0036503b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:52.707819 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47338950-f7f3-4060-80e5-ed3e0036503b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:52.708700 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47338950-f7f3-4060-80e5-ed3e0036503b None admin] RBAC: Adding query filter params (role.id=13ff8a5ffa5648c28ec00aa75b69d913, scope.project.id=b11b7e66a993492d8163097bce955c0b, user.id=575f61ef70314f86b5d9dad3ba1b3aab) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:52.709006 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47338950-f7f3-4060-80e5-ed3e0036503b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:52.710448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47338950-f7f3-4060-80e5-ed3e0036503b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:52.717261 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 312/639] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:02:52 2022] GET /identity/v3/role_assignments?user.id=575f61ef70314f86b5d9dad3ba1b3aab&scope.project.id=b11b7e66a993492d8163097bce955c0b&role.id=13ff8a5ffa5648c28ec00aa75b69d913 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:52.718108 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47338950-f7f3-4060-80e5-ed3e0036503b None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:52.752622 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:52.815785 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c43bc1-1a8f-40a0-ae13-fb1753133565 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:52.848420 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47338950-f7f3-4060-80e5-ed3e0036503b None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:52.856738 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66787157-1b0c-4add-b4d2-226d9a5297a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:52.857816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66787157-1b0c-4add-b4d2-226d9a5297a4 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:52.858271 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66787157-1b0c-4add-b4d2-226d9a5297a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:52.858689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66787157-1b0c-4add-b4d2-226d9a5297a4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:52.867505 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66787157-1b0c-4add-b4d2-226d9a5297a4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:52.869285 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66787157-1b0c-4add-b4d2-226d9a5297a4 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:52.886300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-66787157-1b0c-4add-b4d2-226d9a5297a4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 19:02:52.886300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:52.886300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:52.886300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:52.886300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:52.886300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:52.886300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:52.886300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:52.886300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:52.886300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:52.886300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:52.886300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:52.886300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:02:52.886300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:02:52.886300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:02:52.886300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:02:52.887480 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:52.887480 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:52.887480 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:02:52.887480 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:52.887480 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:02:52.887480 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:52.887480 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:52.887480 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:52.887480 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:52.887480 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:52.887480 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:52.887480 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:52.887480 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:52.887480 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:52.887480 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:52.887480 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:52.887480 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:52.887480 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:52.888680 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:52.888680 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:52.888680 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:02:52.888680 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:02:52.888680 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:02:52.888680 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:02:52.888680 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:02:52.888680 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:02:52.888680 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 19:02:52.888680 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:52.890894 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 328/640] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:52.891031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bfc76-abbd-4193-9a0b-e7a245d0172d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:52.892700 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bfc76-abbd-4193-9a0b-e7a245d0172d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:52.892982 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bfc76-abbd-4193-9a0b-e7a245d0172d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:52.893256 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bfc76-abbd-4193-9a0b-e7a245d0172d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:52.893841 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257631f-a624-44b0-a5d6-9ee715ef415b None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:52.894130 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257631f-a624-44b0-a5d6-9ee715ef415b None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:52.894402 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257631f-a624-44b0-a5d6-9ee715ef415b None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:52.900122 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 329/641] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:52.900122 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257631f-a624-44b0-a5d6-9ee715ef415b None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:52.912546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36bfc76-abbd-4193-9a0b-e7a245d0172d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:52.920444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-d36bfc76-abbd-4193-9a0b-e7a245d0172d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:52.920444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:52.920444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:52.920444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:52.920444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:52.920444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:52.920444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:52.920444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:52.920444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:52.920444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:52.920444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:52.920444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:52.920444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:52.920444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:52.920444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:52.920444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:52.921591 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:52.921591 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:52.921591 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:52.921591 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:52.921591 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:52.921591 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:52.921591 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:52.921591 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:52.921591 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:52.921591 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:52.921591 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:52.921591 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:52.921591 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:52.921591 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:52.921591 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:52.921591 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:52.922457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:52.922457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:52.922457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:52.922457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:52.922457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:52.922457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:52.922457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:52.922457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:52.922457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:52.922457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:52.922457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:52.922457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:52.922457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 313/642] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jun 2 19:02:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:52.923806 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bfc76-abbd-4193-9a0b-e7a245d0172d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:52.974098 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:53.025285 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257631f-a624-44b0-a5d6-9ee715ef415b None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:53.037128 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:53.048241 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bfc76-abbd-4193-9a0b-e7a245d0172d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:53.063548 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882e2f1-581c-4e23-9e63-4f0c4bc3faa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:53.064719 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882e2f1-581c-4e23-9e63-4f0c4bc3faa5 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:53.065148 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882e2f1-581c-4e23-9e63-4f0c4bc3faa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:53.065556 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882e2f1-581c-4e23-9e63-4f0c4bc3faa5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:53.073660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882e2f1-581c-4e23-9e63-4f0c4bc3faa5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:53.075490 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882e2f1-581c-4e23-9e63-4f0c4bc3faa5 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:53.088729 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0c13f-5cfa-4621-ad6a-cff0c7a7d7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:53.089425 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0c13f-5cfa-4621-ad6a-cff0c7a7d7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:53.089706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0c13f-5cfa-4621-ad6a-cff0c7a7d7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:53.089976 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0c13f-5cfa-4621-ad6a-cff0c7a7d7c6 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:53.090820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0c13f-5cfa-4621-ad6a-cff0c7a7d7c6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:53.091125 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0c13f-5cfa-4621-ad6a-cff0c7a7d7c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:53.092747 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-e882e2f1-581c-4e23-9e63-4f0c4bc3faa5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:53.092747 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:53.092747 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:53.092747 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:53.092747 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:53.092747 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:53.092747 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:53.092747 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:53.092747 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:53.092747 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:53.092747 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:53.092747 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:53.092747 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:02:53.092747 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:02:53.092747 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:02:53.093790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:02:53.093790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:53.093790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:53.093790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:53.093790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:53.093790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:53.093790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:53.093790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:53.093790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:53.093790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:53.093790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:53.093790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:53.093790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:53.093790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:53.093790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:53.093790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:53.093790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:53.095078 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:02:53.095078 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:02:53.095078 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:02:53.095078 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:02:53.095078 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:02:53.095078 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:02:53.095078 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:53.095078 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:53.095604 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0c13f-5cfa-4621-ad6a-cff0c7a7d7c6 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:53.097172 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 330/643] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:02:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:53.098607 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0d417-fd8d-4003-a023-c45fc3f2a3e3 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:53.099029 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0d417-fd8d-4003-a023-c45fc3f2a3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:53.099432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0d417-fd8d-4003-a023-c45fc3f2a3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:53.114450 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 314/644] 10.222.0.45 () {56 vars in 1137 bytes} [Thu Jun 2 19:02:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:53.115380 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0c13f-5cfa-4621-ad6a-cff0c7a7d7c6 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:53.120269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-6ca0d417-fd8d-4003-a023-c45fc3f2a3e3 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:53.121675 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-6ca0d417-fd8d-4003-a023-c45fc3f2a3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:53.198246 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 331/645] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:53.199104 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0d417-fd8d-4003-a023-c45fc3f2a3e3 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:53.242259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:53.249517 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0c13f-5cfa-4621-ad6a-cff0c7a7d7c6 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:53.283896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569ff11-c21b-4f53-8285-44347423e7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:53.284507 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569ff11-c21b-4f53-8285-44347423e7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:53.284794 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569ff11-c21b-4f53-8285-44347423e7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:53.285068 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569ff11-c21b-4f53-8285-44347423e7a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:53.285813 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569ff11-c21b-4f53-8285-44347423e7a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:53.286116 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569ff11-c21b-4f53-8285-44347423e7a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:53.287490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569ff11-c21b-4f53-8285-44347423e7a1 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:53.298085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 315/646] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jun 2 19:02:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:53.298994 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569ff11-c21b-4f53-8285-44347423e7a1 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:53.312086 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:53.315754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0d417-fd8d-4003-a023-c45fc3f2a3e3 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:53.354967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90cc04-cedb-413b-a4fe-0f7adda2f091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:53.355631 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90cc04-cedb-413b-a4fe-0f7adda2f091 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:53.355909 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90cc04-cedb-413b-a4fe-0f7adda2f091 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:53.356219 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90cc04-cedb-413b-a4fe-0f7adda2f091 None admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:53.357406 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90cc04-cedb-413b-a4fe-0f7adda2f091 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:53.357406 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90cc04-cedb-413b-a4fe-0f7adda2f091 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:53.358819 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90cc04-cedb-413b-a4fe-0f7adda2f091 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:53.372114 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 332/647] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:02:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:53.372730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90cc04-cedb-413b-a4fe-0f7adda2f091 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:53.416284 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569ff11-c21b-4f53-8285-44347423e7a1 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:53.454812 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffac04-de5c-40a5-9ce0-1837a2e0095f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:53.455472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffac04-de5c-40a5-9ce0-1837a2e0095f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:53.455756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffac04-de5c-40a5-9ce0-1837a2e0095f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:53.456097 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffac04-de5c-40a5-9ce0-1837a2e0095f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:53.487636 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:53.494832 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90cc04-cedb-413b-a4fe-0f7adda2f091 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:53.529408 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffac04-de5c-40a5-9ce0-1837a2e0095f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:53.531199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38eb70-95e8-46a5-8cf9-cd1b4becaf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:53.531575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffac04-de5c-40a5-9ce0-1837a2e0095f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:53.532085 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38eb70-95e8-46a5-8cf9-cd1b4becaf75 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:53.532372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38eb70-95e8-46a5-8cf9-cd1b4becaf75 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:53.532716 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38eb70-95e8-46a5-8cf9-cd1b4becaf75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:53.543905 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38eb70-95e8-46a5-8cf9-cd1b4becaf75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:53.552447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-1c38eb70-95e8-46a5-8cf9-cd1b4becaf75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:53.552447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:53.552447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:53.552447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:53.552447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:53.552447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:53.552447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:53.552447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:53.552447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:53.552447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:53.552447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:53.552447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:53.552447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:53.552447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:53.552447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:53.552447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:53.553487 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:53.553487 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:53.553487 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:53.553487 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:53.553487 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:53.553487 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:53.553487 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:53.553487 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:53.553487 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:53.553487 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:53.553487 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:53.553487 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:53.553487 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:53.553487 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:53.553487 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:53.553487 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:53.554781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:53.554781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:53.554781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:53.554781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:53.554781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:53.554781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:53.554781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:53.554781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:53.554781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:53.554781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:53.554781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:53.554781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:53.554781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 333/648] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jun 2 19:02:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:53.555470 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38eb70-95e8-46a5-8cf9-cd1b4becaf75 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:53.578881 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:53.655002 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 316/649] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:02:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:53.660709 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffac04-de5c-40a5-9ce0-1837a2e0095f None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:53.663959 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38eb70-95e8-46a5-8cf9-cd1b4becaf75 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:53.699373 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604da024-ca9d-47f1-af79-036508c34a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:53.700197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604da024-ca9d-47f1-af79-036508c34a0b None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:53.700481 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604da024-ca9d-47f1-af79-036508c34a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:53.700752 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604da024-ca9d-47f1-af79-036508c34a0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:53.712365 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604da024-ca9d-47f1-af79-036508c34a0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:53.713834 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604da024-ca9d-47f1-af79-036508c34a0b None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:53.723320 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:53.733161 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-604da024-ca9d-47f1-af79-036508c34a0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:53.733161 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:53.733161 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:53.733161 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:53.733161 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:53.733161 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:53.733161 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:53.733161 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:53.733161 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:53.733161 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:53.733161 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:53.733161 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:53.733161 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:53.733161 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:53.733161 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:53.734185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:53.734185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:53.734185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:53.734185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:53.734185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:53.734185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:53.734185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:53.734185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:53.734185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:53.734185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:53.734185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:53.734185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:53.734185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:53.734185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:53.734185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:53.734185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:53.734185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:53.736061 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:53.736061 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:53.736061 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:53.736061 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:53.743844 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 334/650] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:53.743844 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604da024-ca9d-47f1-af79-036508c34a0b None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:53.773689 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffac04-de5c-40a5-9ce0-1837a2e0095f None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:53.817975 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa2f1f-eeeb-46d0-9479-b957207fbc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:53.818880 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa2f1f-eeeb-46d0-9479-b957207fbc6a None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:53.819161 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa2f1f-eeeb-46d0-9479-b957207fbc6a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:53.819435 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa2f1f-eeeb-46d0-9479-b957207fbc6a None admin] PATH_INFO: `/v3/projects/b11b7e66a993492d8163097bce955c0b/users/87ba0ab9510d49c4ab4c634e82790efb/roles/13ff8a5ffa5648c28ec00aa75b69d913` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:53.821714 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:53.834942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa2f1f-eeeb-46d0-9479-b957207fbc6a None admin] RBAC: Authorizing `identity:create_grant(project_id=b11b7e66a993492d8163097bce955c0b, user_id=87ba0ab9510d49c4ab4c634e82790efb, role_id=13ff8a5ffa5648c28ec00aa75b69d913)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:53.836429 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa2f1f-eeeb-46d0-9479-b957207fbc6a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:53.852097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604da024-ca9d-47f1-af79-036508c34a0b None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:53.887202 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65da2b8-8f56-4f4d-a206-a0a7647f3ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:53.887872 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65da2b8-8f56-4f4d-a206-a0a7647f3ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:53.888182 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65da2b8-8f56-4f4d-a206-a0a7647f3ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:53.888453 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65da2b8-8f56-4f4d-a206-a0a7647f3ab7 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:53.889208 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65da2b8-8f56-4f4d-a206-a0a7647f3ab7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:53.889494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65da2b8-8f56-4f4d-a206-a0a7647f3ab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:53.890856 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65da2b8-8f56-4f4d-a206-a0a7647f3ab7 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:53.900155 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 317/651] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jun 2 19:02:53 2022] PUT /identity/v3/projects/b11b7e66a993492d8163097bce955c0b/users/87ba0ab9510d49c4ab4c634e82790efb/roles/13ff8a5ffa5648c28ec00aa75b69d913 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:53.901218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa2f1f-eeeb-46d0-9479-b957207fbc6a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:53.904977 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 335/652] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jun 2 19:02:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:53.906022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65da2b8-8f56-4f4d-a206-a0a7647f3ab7 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:54.038825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa2f1f-eeeb-46d0-9479-b957207fbc6a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:54.051354 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65da2b8-8f56-4f4d-a206-a0a7647f3ab7 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:54.072453 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:54.086579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925fcd9-e1dd-48ed-97bc-36d54d37d981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:54.087506 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925fcd9-e1dd-48ed-97bc-36d54d37d981 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:54.087890 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925fcd9-e1dd-48ed-97bc-36d54d37d981 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:54.088198 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925fcd9-e1dd-48ed-97bc-36d54d37d981 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:54.093382 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa256c-2a12-4f2c-9f7c-f04a84396dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:54.099235 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa256c-2a12-4f2c-9f7c-f04a84396dfe None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:54.099235 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa256c-2a12-4f2c-9f7c-f04a84396dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:54.099235 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa256c-2a12-4f2c-9f7c-f04a84396dfe None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:54.099235 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa256c-2a12-4f2c-9f7c-f04a84396dfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:54.099235 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa256c-2a12-4f2c-9f7c-f04a84396dfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:54.099235 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa256c-2a12-4f2c-9f7c-f04a84396dfe None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:54.099755 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:54.102949 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925fcd9-e1dd-48ed-97bc-36d54d37d981 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:54.104547 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925fcd9-e1dd-48ed-97bc-36d54d37d981 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:54.120014 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 336/653] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:54.121132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa256c-2a12-4f2c-9f7c-f04a84396dfe None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:54.130085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-5925fcd9-e1dd-48ed-97bc-36d54d37d981 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:54.130085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:54.130085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:54.130085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:54.130085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:54.130085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:54.130085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:54.130085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:54.130085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:54.130085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:54.130085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:54.130085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:54.130085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:54.130085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:54.130085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:54.131261 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:54.131261 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:54.131261 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:54.131261 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:54.131261 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:54.131261 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:54.131261 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:54.131261 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:54.131261 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:54.131261 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:54.131261 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:54.131261 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:54.131261 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:54.131261 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:54.131261 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:54.131261 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:54.131261 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:54.132590 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:54.132590 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:54.132590 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:54.132590 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:54.139651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 318/654] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:54.140925 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925fcd9-e1dd-48ed-97bc-36d54d37d981 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:54.256369 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925fcd9-e1dd-48ed-97bc-36d54d37d981 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:54.257280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa256c-2a12-4f2c-9f7c-f04a84396dfe None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:54.294393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f60309-8c23-41c3-8502-493747ae4436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:54.295481 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f60309-8c23-41c3-8502-493747ae4436 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:54.295920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f60309-8c23-41c3-8502-493747ae4436 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:54.296435 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f60309-8c23-41c3-8502-493747ae4436 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:54.305095 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f60309-8c23-41c3-8502-493747ae4436 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:54.305274 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7c351-2493-4b9e-9f56-f0e25f56c0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:54.305870 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7c351-2493-4b9e-9f56-f0e25f56c0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:54.306150 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7c351-2493-4b9e-9f56-f0e25f56c0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:54.306425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7c351-2493-4b9e-9f56-f0e25f56c0c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:54.307802 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f60309-8c23-41c3-8502-493747ae4436 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:54.319559 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7c351-2493-4b9e-9f56-f0e25f56c0c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:54.321169 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7c351-2493-4b9e-9f56-f0e25f56c0c6 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:54.324930 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-03f60309-8c23-41c3-8502-493747ae4436 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 19:02:54.324930 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:54.324930 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:54.324930 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:54.324930 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:54.324930 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:54.324930 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:54.324930 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:54.324930 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:54.324930 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:54.324930 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:54.324930 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:54.324930 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:02:54.324930 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:02:54.324930 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:02:54.324930 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:02:54.325900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:54.325900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:54.325900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:02:54.325900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:54.325900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:02:54.325900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:54.325900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:54.325900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:54.325900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:54.325900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:54.325900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:54.325900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:54.325900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:54.325900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:54.325900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:54.325900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:54.325900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:54.325900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:54.326824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:54.326824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:54.326824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:02:54.326824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:02:54.326824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:02:54.326824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:02:54.326824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:02:54.326824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:02:54.326824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 19:02:54.326824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:54.330190 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 319/655] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:54.331245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f60309-8c23-41c3-8502-493747ae4436 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:54.348940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-2be7c351-2493-4b9e-9f56-f0e25f56c0c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:54.348940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:54.348940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:54.348940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:54.348940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:54.348940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:54.348940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:54.348940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:54.348940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:54.348940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:54.348940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:54.348940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:54.348940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:54.348940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:54.348940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:54.349895 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:54.349895 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:54.349895 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:54.349895 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:54.349895 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:54.349895 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:54.349895 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:54.349895 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:54.349895 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:54.349895 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:54.349895 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:54.349895 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:54.349895 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:54.349895 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:54.349895 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:54.349895 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:54.349895 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:54.351429 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:54.351429 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:54.351429 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:54.351429 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:54.351429 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 337/656] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:54.351429 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7c351-2493-4b9e-9f56-f0e25f56c0c6 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:54.363584 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:54.406039 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:54.471916 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7c351-2493-4b9e-9f56-f0e25f56c0c6 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:54.474596 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f60309-8c23-41c3-8502-493747ae4436 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:54.517271 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253fb63a-34c8-492b-b1bc-1fb279ac7157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:54.518888 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fb63a-34c8-492b-b1bc-1fb279ac7157 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:54.519355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fb63a-34c8-492b-b1bc-1fb279ac7157 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:54.519805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fb63a-34c8-492b-b1bc-1fb279ac7157 None admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:54.520861 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253fb63a-34c8-492b-b1bc-1fb279ac7157 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:54.521379 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253fb63a-34c8-492b-b1bc-1fb279ac7157 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:54.522950 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec199e-52c4-4aab-b9c7-dfb7e4ecede2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:54.523262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253fb63a-34c8-492b-b1bc-1fb279ac7157 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:54.523751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec199e-52c4-4aab-b9c7-dfb7e4ecede2 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:54.524133 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec199e-52c4-4aab-b9c7-dfb7e4ecede2 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:54.524478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec199e-52c4-4aab-b9c7-dfb7e4ecede2 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:54.525303 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec199e-52c4-4aab-b9c7-dfb7e4ecede2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:54.525688 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec199e-52c4-4aab-b9c7-dfb7e4ecede2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:54.528384 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec199e-52c4-4aab-b9c7-dfb7e4ecede2 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:54.554319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 338/657] 10.222.0.45 () {56 vars in 1137 bytes} [Thu Jun 2 19:02:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:54.554319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253fb63a-34c8-492b-b1bc-1fb279ac7157 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:54.554597 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 320/658] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:54.557196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec199e-52c4-4aab-b9c7-dfb7e4ecede2 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:54.647233 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:54.670685 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec199e-52c4-4aab-b9c7-dfb7e4ecede2 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:54.673326 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253fb63a-34c8-492b-b1bc-1fb279ac7157 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:54.676866 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:54.730593 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d905824-2fe3-49f5-8bea-41027837e409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:54.731364 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d905824-2fe3-49f5-8bea-41027837e409 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:54.731664 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d905824-2fe3-49f5-8bea-41027837e409 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:54.731973 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d905824-2fe3-49f5-8bea-41027837e409 None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:54.732824 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d905824-2fe3-49f5-8bea-41027837e409 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:54.733316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d905824-2fe3-49f5-8bea-41027837e409 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:54.735663 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d905824-2fe3-49f5-8bea-41027837e409 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:54.738106 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0159f-e894-4e65-821c-1eecf7bf9684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:54.739347 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0159f-e894-4e65-821c-1eecf7bf9684 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:54.739981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0159f-e894-4e65-821c-1eecf7bf9684 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:54.740663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0159f-e894-4e65-821c-1eecf7bf9684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:54.760407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 339/659] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:54.761682 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d905824-2fe3-49f5-8bea-41027837e409 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:54.846049 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0159f-e894-4e65-821c-1eecf7bf9684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:54.847795 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0159f-e894-4e65-821c-1eecf7bf9684 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:54.904892 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d905824-2fe3-49f5-8bea-41027837e409 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:54.935079 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:54.956081 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf7c14-05ec-4c34-8814-9e5a8ae46737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:54.956698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 321/660] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:02:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 19:02:54.957683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0159f-e894-4e65-821c-1eecf7bf9684 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:54.958508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf7c14-05ec-4c34-8814-9e5a8ae46737 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:54.959022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf7c14-05ec-4c34-8814-9e5a8ae46737 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:54.959506 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf7c14-05ec-4c34-8814-9e5a8ae46737 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:54.967963 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf7c14-05ec-4c34-8814-9e5a8ae46737 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:54.970594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf7c14-05ec-4c34-8814-9e5a8ae46737 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:54.988728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-a4cf7c14-05ec-4c34-8814-9e5a8ae46737 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:54.988728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:54.988728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:54.988728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:54.988728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:54.988728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:54.988728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:54.988728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:54.988728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:54.988728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:54.988728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:54.988728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:54.988728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:02:54.988728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:02:54.988728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:02:54.989674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:02:54.989674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:54.989674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:54.989674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:54.989674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:54.989674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:54.989674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:54.989674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:54.989674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:54.989674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:54.989674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:54.989674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:54.989674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:54.989674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:54.989674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:54.989674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:54.989674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:54.990571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:02:54.990571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:02:54.990571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:02:54.990571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:02:54.990571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:02:54.990571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:02:54.990571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:54.990571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:54.993228 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 340/661] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:02:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:54.994285 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf7c14-05ec-4c34-8814-9e5a8ae46737 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:55.030992 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:55.086952 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0159f-e894-4e65-821c-1eecf7bf9684 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:55.123226 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf7c14-05ec-4c34-8814-9e5a8ae46737 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:55.130716 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9c5b0-368c-421c-87b0-f644332ea5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:55.131545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9c5b0-368c-421c-87b0-f644332ea5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:55.131822 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9c5b0-368c-421c-87b0-f644332ea5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:55.132118 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9c5b0-368c-421c-87b0-f644332ea5c1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:55.141008 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9c5b0-368c-421c-87b0-f644332ea5c1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:55.143798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9c5b0-368c-421c-87b0-f644332ea5c1 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:55.161198 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-6ca9c5b0-368c-421c-87b0-f644332ea5c1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 19:02:55.161198 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:55.161198 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:55.161198 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:55.161198 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:55.161198 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:55.161198 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:55.161198 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:55.161198 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:55.161198 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:55.161198 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:55.161198 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:55.161198 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:02:55.161198 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:02:55.161198 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:02:55.161198 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:02:55.162226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:55.162226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:55.162226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:02:55.162226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:55.162226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:02:55.162226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:55.162226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:55.162226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:55.162226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:55.162226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:55.162226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:55.162226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:55.162226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:55.162226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:55.162226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:55.162226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:55.162226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:55.162226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:55.163249 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:55.163249 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:55.163249 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:02:55.163249 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:02:55.163249 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:02:55.163249 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:02:55.163249 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:02:55.163249 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:02:55.163249 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 19:02:55.163249 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:55.163249 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 322/662] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jun 2 19:02:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:55.163857 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9c5b0-368c-421c-87b0-f644332ea5c1 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:55.172945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb21898-7cc8-4a56-ae9e-c17ef4ed3c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:55.173753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb21898-7cc8-4a56-ae9e-c17ef4ed3c78 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:55.174038 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb21898-7cc8-4a56-ae9e-c17ef4ed3c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:55.174317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb21898-7cc8-4a56-ae9e-c17ef4ed3c78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:55.184976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb21898-7cc8-4a56-ae9e-c17ef4ed3c78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:55.186462 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb21898-7cc8-4a56-ae9e-c17ef4ed3c78 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:55.205848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-0eb21898-7cc8-4a56-ae9e-c17ef4ed3c78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:55.205848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:55.205848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:55.205848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:55.205848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:55.205848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:55.205848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:55.205848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:55.205848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:55.205848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:55.205848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:55.205848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:55.205848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:55.205848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:55.205848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:55.206800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:55.206800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:55.206800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:55.206800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:55.206800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:55.206800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:55.206800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:55.206800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:55.206800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:55.206800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:55.206800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:55.206800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:55.206800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:55.206800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:55.206800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:55.206800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:55.206800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:55.207683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:55.207683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:55.207683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:55.207683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:55.207683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 341/663] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:55.208784 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407b3d9-0727-4581-b75b-6751819fb7b1 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:55.209093 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407b3d9-0727-4581-b75b-6751819fb7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:55.209407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407b3d9-0727-4581-b75b-6751819fb7b1 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:55.213121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:55.215165 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 342/664] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:55.215828 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407b3d9-0727-4581-b75b-6751819fb7b1 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:55.277264 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9c5b0-368c-421c-87b0-f644332ea5c1 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:55.309097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:55.312484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad16565-29e4-4b14-9f70-1395f71e68cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:55.313685 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad16565-29e4-4b14-9f70-1395f71e68cb None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:55.313971 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad16565-29e4-4b14-9f70-1395f71e68cb None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:55.314247 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad16565-29e4-4b14-9f70-1395f71e68cb None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:55.315047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad16565-29e4-4b14-9f70-1395f71e68cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:55.315359 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad16565-29e4-4b14-9f70-1395f71e68cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:55.317027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad16565-29e4-4b14-9f70-1395f71e68cb None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:55.330294 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 323/665] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:02:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:55.331161 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad16565-29e4-4b14-9f70-1395f71e68cb None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:55.341909 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407b3d9-0727-4581-b75b-6751819fb7b1 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:55.381774 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775451e-1326-4014-92f8-af6674c3f6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:55.382479 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775451e-1326-4014-92f8-af6674c3f6ae None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:55.382767 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775451e-1326-4014-92f8-af6674c3f6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:55.383209 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775451e-1326-4014-92f8-af6674c3f6ae None admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:55.384095 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775451e-1326-4014-92f8-af6674c3f6ae None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:55.388088 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775451e-1326-4014-92f8-af6674c3f6ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:55.388088 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775451e-1326-4014-92f8-af6674c3f6ae None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:55.410244 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 343/666] 10.222.0.45 () {56 vars in 1139 bytes} [Thu Jun 2 19:02:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:55.411403 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea84274-7a38-49b1-b377-ddc808746fb3 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:55.411703 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea84274-7a38-49b1-b377-ddc808746fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:55.412090 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea84274-7a38-49b1-b377-ddc808746fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:55.430020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-bea84274-7a38-49b1-b377-ddc808746fb3 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:55.431230 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-bea84274-7a38-49b1-b377-ddc808746fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:55.436305 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:55.439211 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad16565-29e4-4b14-9f70-1395f71e68cb None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:55.477615 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6680f-2156-4ed8-baa6-4d6d077a8173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:55.478382 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6680f-2156-4ed8-baa6-4d6d077a8173 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:55.478672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6680f-2156-4ed8-baa6-4d6d077a8173 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:55.478948 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6680f-2156-4ed8-baa6-4d6d077a8173 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:55.479736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6680f-2156-4ed8-baa6-4d6d077a8173 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:55.480063 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6680f-2156-4ed8-baa6-4d6d077a8173 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:55.481549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6680f-2156-4ed8-baa6-4d6d077a8173 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:55.499433 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 324/667] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:55.499433 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6680f-2156-4ed8-baa6-4d6d077a8173 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:55.524663 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 344/668] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:55.524663 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea84274-7a38-49b1-b377-ddc808746fb3 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:55.604526 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:55.620028 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6680f-2156-4ed8-baa6-4d6d077a8173 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:55.650255 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea84274-7a38-49b1-b377-ddc808746fb3 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:55.667056 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881315fe-1310-425f-8e90-5abb9146e051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:55.668095 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881315fe-1310-425f-8e90-5abb9146e051 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:55.668573 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881315fe-1310-425f-8e90-5abb9146e051 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:55.668848 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881315fe-1310-425f-8e90-5abb9146e051 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:55.669719 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881315fe-1310-425f-8e90-5abb9146e051 None admin] RBAC: Adding query filter params (role.id=13ff8a5ffa5648c28ec00aa75b69d913, scope.project.id=b11b7e66a993492d8163097bce955c0b, user.id=abb1dec309904b009271f36cd9157511) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:55.670150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881315fe-1310-425f-8e90-5abb9146e051 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:55.671773 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881315fe-1310-425f-8e90-5abb9146e051 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:55.679499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 325/669] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:02:55 2022] GET /identity/v3/role_assignments?user.id=abb1dec309904b009271f36cd9157511&scope.project.id=b11b7e66a993492d8163097bce955c0b&role.id=13ff8a5ffa5648c28ec00aa75b69d913 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:55.680429 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881315fe-1310-425f-8e90-5abb9146e051 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:55.702834 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f529a3-cd33-4879-a7fe-ef91747f4529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:55.703930 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f529a3-cd33-4879-a7fe-ef91747f4529 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:55.704584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f529a3-cd33-4879-a7fe-ef91747f4529 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:55.705053 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f529a3-cd33-4879-a7fe-ef91747f4529 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:55.730436 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:55.806854 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f529a3-cd33-4879-a7fe-ef91747f4529 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:55.808916 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f529a3-cd33-4879-a7fe-ef91747f4529 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:55.850479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881315fe-1310-425f-8e90-5abb9146e051 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:55.894197 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de1fe5-3b22-42c2-8efd-ebb6d9623d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:55.895391 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de1fe5-3b22-42c2-8efd-ebb6d9623d94 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:55.895857 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:55.896061 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de1fe5-3b22-42c2-8efd-ebb6d9623d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:55.896538 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de1fe5-3b22-42c2-8efd-ebb6d9623d94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:55.926345 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de1fe5-3b22-42c2-8efd-ebb6d9623d94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:55.926345 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de1fe5-3b22-42c2-8efd-ebb6d9623d94 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:55.927766 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-07de1fe5-3b22-42c2-8efd-ebb6d9623d94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:55.927766 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:55.927766 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:55.927766 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:55.927766 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:55.927766 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:55.927766 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:55.927766 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:55.927766 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:55.927766 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:55.927766 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:55.927766 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:55.927766 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:02:55.927766 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:02:55.927766 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:02:55.928873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:02:55.928873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:55.928873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:55.928873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:55.928873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:55.928873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:55.928873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:55.928873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:55.928873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:55.928873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:55.928873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:55.928873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:55.928873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:55.928873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:55.928873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:55.928873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:55.928873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:55.930070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:02:55.930070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:02:55.930070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:02:55.930070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:02:55.930070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:02:55.930070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:02:55.930070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:55.930070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:55.930070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 326/670] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:02:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:55.930070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de1fe5-3b22-42c2-8efd-ebb6d9623d94 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:55.949423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 345/671] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:02:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:55.950508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f529a3-cd33-4879-a7fe-ef91747f4529 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:56.060425 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:56.085465 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de1fe5-3b22-42c2-8efd-ebb6d9623d94 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:56.086391 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f529a3-cd33-4879-a7fe-ef91747f4529 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:56.121629 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adaf597-f7f1-4cd1-ad71-3f98b87adfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:56.122436 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaf597-f7f1-4cd1-ad71-3f98b87adfbf None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:56.122794 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaf597-f7f1-4cd1-ad71-3f98b87adfbf None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:56.123370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaf597-f7f1-4cd1-ad71-3f98b87adfbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:56.133542 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51900002-e0ea-4e30-a7c1-59e7c2621a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:56.134752 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51900002-e0ea-4e30-a7c1-59e7c2621a87 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:56.135228 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adaf597-f7f1-4cd1-ad71-3f98b87adfbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:56.135433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51900002-e0ea-4e30-a7c1-59e7c2621a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:56.135883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51900002-e0ea-4e30-a7c1-59e7c2621a87 None admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:56.136866 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51900002-e0ea-4e30-a7c1-59e7c2621a87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:56.137364 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51900002-e0ea-4e30-a7c1-59e7c2621a87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:56.138995 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51900002-e0ea-4e30-a7c1-59e7c2621a87 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:56.143599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-1adaf597-f7f1-4cd1-ad71-3f98b87adfbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:02:56.143599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:56.143599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:56.143599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:56.143599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:56.143599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:56.143599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:56.143599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:56.143599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:56.143599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:56.143599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:56.143599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:56.143599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:56.143599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:56.143599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:56.143599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:56.144751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:56.144751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:56.144751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:56.144751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:56.144751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:56.144751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:56.144751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:56.144751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:56.144751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:56.144751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:56.144751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:56.144751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:56.144751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:56.144751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:56.144751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:56.144751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:56.145903 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:56.145903 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:56.145903 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:56.145903 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:56.145903 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:56.145903 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:56.145903 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:56.145903 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:56.145903 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:56.145903 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:56.145903 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:02:56.145903 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:56.149765 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 327/672] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:02:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:56.151069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adaf597-f7f1-4cd1-ad71-3f98b87adfbf None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:56.158056 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 346/673] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:02:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:56.159195 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51900002-e0ea-4e30-a7c1-59e7c2621a87 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:56.194642 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:56.270771 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adaf597-f7f1-4cd1-ad71-3f98b87adfbf None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:56.295011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51900002-e0ea-4e30-a7c1-59e7c2621a87 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:56.311878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf500ad-d0a2-4dfa-864d-2b937df1b336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:56.312767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf500ad-d0a2-4dfa-864d-2b937df1b336 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:56.313611 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf500ad-d0a2-4dfa-864d-2b937df1b336 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:56.313960 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf500ad-d0a2-4dfa-864d-2b937df1b336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:56.325863 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf500ad-d0a2-4dfa-864d-2b937df1b336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:56.327593 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf500ad-d0a2-4dfa-864d-2b937df1b336 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:56.330563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:56.340652 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d677bc5-71c1-467b-88f5-606934ca0e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:56.341330 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d677bc5-71c1-467b-88f5-606934ca0e66 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:56.341876 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d677bc5-71c1-467b-88f5-606934ca0e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:56.342149 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d677bc5-71c1-467b-88f5-606934ca0e66 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:56.343829 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d677bc5-71c1-467b-88f5-606934ca0e66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:56.343829 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d677bc5-71c1-467b-88f5-606934ca0e66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:56.344692 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d677bc5-71c1-467b-88f5-606934ca0e66 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:56.347791 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-1cf500ad-d0a2-4dfa-864d-2b937df1b336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:56.347791 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:56.347791 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:56.347791 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:56.347791 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:56.347791 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:56.347791 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:56.347791 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:56.347791 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:56.347791 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:56.347791 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:56.347791 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:56.347791 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:56.347791 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:56.347791 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:56.348681 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:56.348681 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:56.348681 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:56.348681 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:56.348681 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:56.348681 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:56.348681 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:56.348681 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:56.348681 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:56.348681 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:56.348681 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:56.348681 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:56.348681 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:56.348681 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:56.348681 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:56.348681 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:56.348681 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:56.349565 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:56.349565 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:56.349565 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:56.349565 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:56.349565 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 328/674] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:56.351190 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf500ad-d0a2-4dfa-864d-2b937df1b336 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:56.354213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 347/675] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:02:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:56.355654 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c054b0-06ed-4fac-a33c-ad620ad67465 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:56.355977 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c054b0-06ed-4fac-a33c-ad620ad67465 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:56.356436 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c054b0-06ed-4fac-a33c-ad620ad67465 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:56.359181 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 348/676] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:56.360645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c054b0-06ed-4fac-a33c-ad620ad67465 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:56.464461 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:56.471504 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf500ad-d0a2-4dfa-864d-2b937df1b336 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:56.482911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c054b0-06ed-4fac-a33c-ad620ad67465 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:56.509929 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d30348-b5df-4fac-8ccb-1a69408bd8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:56.510602 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d30348-b5df-4fac-8ccb-1a69408bd8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:56.510886 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d30348-b5df-4fac-8ccb-1a69408bd8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:56.511166 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d30348-b5df-4fac-8ccb-1a69408bd8a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:56.512024 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d30348-b5df-4fac-8ccb-1a69408bd8a8 None admin] RBAC: Adding query filter params (role.id=13ff8a5ffa5648c28ec00aa75b69d913, scope.project.id=b11b7e66a993492d8163097bce955c0b, user.id=226743f4f93c44c5aef5919a7813bd3c) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:56.512348 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d30348-b5df-4fac-8ccb-1a69408bd8a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:56.513783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d30348-b5df-4fac-8ccb-1a69408bd8a8 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:56.519772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bc6b2-fd3f-442d-acdb-a9e7d3ec8135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:56.528333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bc6b2-fd3f-442d-acdb-a9e7d3ec8135 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:56.528533 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 329/677] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:02:56 2022] GET /identity/v3/role_assignments?user.id=226743f4f93c44c5aef5919a7813bd3c&scope.project.id=b11b7e66a993492d8163097bce955c0b&role.id=13ff8a5ffa5648c28ec00aa75b69d913 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:56.528617 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bc6b2-fd3f-442d-acdb-a9e7d3ec8135 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:56.528617 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bc6b2-fd3f-442d-acdb-a9e7d3ec8135 None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:56.528769 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d30348-b5df-4fac-8ccb-1a69408bd8a8 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:56.528854 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4bc6b2-fd3f-442d-acdb-a9e7d3ec8135 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:56.528854 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4bc6b2-fd3f-442d-acdb-a9e7d3ec8135 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:56.528854 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4bc6b2-fd3f-442d-acdb-a9e7d3ec8135 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:56.542584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 349/678] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:56.544747 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0d6dc-6128-403c-93ef-6e6397b37871 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:56.545039 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0d6dc-6128-403c-93ef-6e6397b37871 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:56.545317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0d6dc-6128-403c-93ef-6e6397b37871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:56.570238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-7ad0d6dc-6128-403c-93ef-6e6397b37871 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:56.571504 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-7ad0d6dc-6128-403c-93ef-6e6397b37871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:56.607865 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:56.658920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d30348-b5df-4fac-8ccb-1a69408bd8a8 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:56.676458 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 350/679] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:56.677492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0d6dc-6128-403c-93ef-6e6397b37871 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:56.709110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766705a-3e1b-40ed-8f44-b7a46eec5008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:56.710322 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766705a-3e1b-40ed-8f44-b7a46eec5008 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:56.710819 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766705a-3e1b-40ed-8f44-b7a46eec5008 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:56.711323 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766705a-3e1b-40ed-8f44-b7a46eec5008 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:56.728041 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766705a-3e1b-40ed-8f44-b7a46eec5008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:56.729893 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766705a-3e1b-40ed-8f44-b7a46eec5008 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:56.749711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-9766705a-3e1b-40ed-8f44-b7a46eec5008 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:56.749711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:56.749711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:56.749711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:56.749711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:56.749711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:56.749711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:56.749711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:56.749711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:56.749711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:56.749711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:56.749711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:56.749711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:56.749711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:56.749711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:56.750744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:56.750744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:56.750744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:56.750744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:56.750744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:56.750744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:56.750744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:56.750744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:56.750744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:56.750744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:56.750744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:56.750744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:56.750744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:56.750744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:56.750744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:56.750744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:56.750744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:56.751618 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:56.751618 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:56.751618 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:56.751618 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:56.758132 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 330/680] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:56.758132 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766705a-3e1b-40ed-8f44-b7a46eec5008 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:56.782292 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:56.815569 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0d6dc-6128-403c-93ef-6e6397b37871 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:56.857314 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fdcc2-223c-491e-9324-70c9b2cd3fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:56.858473 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fdcc2-223c-491e-9324-70c9b2cd3fbc None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:56.858960 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fdcc2-223c-491e-9324-70c9b2cd3fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:56.859455 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fdcc2-223c-491e-9324-70c9b2cd3fbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:56.869217 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5fdcc2-223c-491e-9324-70c9b2cd3fbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:56.871178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5fdcc2-223c-491e-9324-70c9b2cd3fbc None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:56.887173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-5e5fdcc2-223c-491e-9324-70c9b2cd3fbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:56.887173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:56.887173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:56.887173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:56.887173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:56.887173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:56.887173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:56.887173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:56.887173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:56.887173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:56.887173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:56.887173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:56.887173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:02:56.887173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:02:56.887173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:02:56.888849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:02:56.888849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:56.888849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:56.888849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:56.888849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:56.888849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:56.888849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:56.888849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:56.888849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:56.888849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:56.888849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:56.888849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:56.888849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:56.888849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:56.888849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:56.888849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:56.888849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:56.889737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:02:56.889737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:02:56.889737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:02:56.889737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:02:56.889737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:02:56.889737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:02:56.889737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:56.889737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:56.889737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 351/681] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:02:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:56.889737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fdcc2-223c-491e-9324-70c9b2cd3fbc None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:56.905130 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766705a-3e1b-40ed-8f44-b7a46eec5008 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:56.921821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:56.946683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a2441-1bac-43e5-b6ef-6e0749acbd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:56.947488 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a2441-1bac-43e5-b6ef-6e0749acbd32 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:56.947812 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a2441-1bac-43e5-b6ef-6e0749acbd32 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:56.948170 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a2441-1bac-43e5-b6ef-6e0749acbd32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:56.962397 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a2441-1bac-43e5-b6ef-6e0749acbd32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:02:56.971493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-de8a2441-1bac-43e5-b6ef-6e0749acbd32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:56.971493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:56.971493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:56.971493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:56.971493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:56.971493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:56.971493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:56.971493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:56.971493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:56.971493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:56.971493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:56.971493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:56.971493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:02:56.971493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:02:56.971493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:02:56.971493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:02:56.972575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:02:56.972575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:02:56.972575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:02:56.972575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:02:56.972575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:56.972575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:56.972575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:56.972575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:56.972575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:56.972575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:56.972575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:56.972575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:56.972575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:56.972575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:56.972575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:56.972575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:56.973503 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:56.973503 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:56.973503 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:56.973503 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:56.973503 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:02:56.973503 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:02:56.973503 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:02:56.973503 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:02:56.973503 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:02:56.973503 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:02:56.973503 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:02:56.973503 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:56.973503 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 331/682] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jun 2 19:02:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:56.974200 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a2441-1bac-43e5-b6ef-6e0749acbd32 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:57.006283 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fdcc2-223c-491e-9324-70c9b2cd3fbc None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:57.041050 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925828b-a81a-44a0-b000-1fd08af8026e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:57.041800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925828b-a81a-44a0-b000-1fd08af8026e None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:57.042081 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925828b-a81a-44a0-b000-1fd08af8026e None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:57.042353 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925828b-a81a-44a0-b000-1fd08af8026e None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:57.043079 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925828b-a81a-44a0-b000-1fd08af8026e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:57.043378 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925828b-a81a-44a0-b000-1fd08af8026e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:57.044845 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925828b-a81a-44a0-b000-1fd08af8026e None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:57.048365 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:57.064185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 352/683] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:57.064185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925828b-a81a-44a0-b000-1fd08af8026e None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:57.113404 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a2441-1bac-43e5-b6ef-6e0749acbd32 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:57.158761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45bbf0-406f-4dad-81d8-47e4b628bb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:57.159575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45bbf0-406f-4dad-81d8-47e4b628bb68 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:57.160141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45bbf0-406f-4dad-81d8-47e4b628bb68 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:57.160521 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45bbf0-406f-4dad-81d8-47e4b628bb68 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:57.162179 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45bbf0-406f-4dad-81d8-47e4b628bb68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:57.162613 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45bbf0-406f-4dad-81d8-47e4b628bb68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:57.164725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45bbf0-406f-4dad-81d8-47e4b628bb68 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:57.170025 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925828b-a81a-44a0-b000-1fd08af8026e None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:57.181019 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 332/684] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:02:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:57.182416 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45bbf0-406f-4dad-81d8-47e4b628bb68 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:57.208950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e80d4-120a-44e6-a2ba-354c61d431a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:57.210074 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e80d4-120a-44e6-a2ba-354c61d431a9 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:57.210918 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e80d4-120a-44e6-a2ba-354c61d431a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:57.211457 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e80d4-120a-44e6-a2ba-354c61d431a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:57.212463 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e80d4-120a-44e6-a2ba-354c61d431a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:57.213002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e80d4-120a-44e6-a2ba-354c61d431a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:57.214620 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e80d4-120a-44e6-a2ba-354c61d431a9 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:57.223865 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:57.228156 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 353/685] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jun 2 19:02:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:57.229368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e80d4-120a-44e6-a2ba-354c61d431a9 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:57.298224 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:57.314641 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45bbf0-406f-4dad-81d8-47e4b628bb68 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:57.346983 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e80d4-120a-44e6-a2ba-354c61d431a9 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:57.351033 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083c9c3-1ce2-4cdc-abc7-a271cc7dc2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:57.351671 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083c9c3-1ce2-4cdc-abc7-a271cc7dc2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:57.351955 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083c9c3-1ce2-4cdc-abc7-a271cc7dc2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:57.352348 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083c9c3-1ce2-4cdc-abc7-a271cc7dc2e6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:57.360690 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083c9c3-1ce2-4cdc-abc7-a271cc7dc2e6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:57.362282 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083c9c3-1ce2-4cdc-abc7-a271cc7dc2e6 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:57.378199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-5083c9c3-1ce2-4cdc-abc7-a271cc7dc2e6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 19:02:57.378199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:57.378199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:57.378199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:57.378199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:57.378199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:57.378199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:57.378199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:57.378199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:57.378199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:57.378199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:57.378199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:57.378199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:02:57.378199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:02:57.378199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:02:57.378199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:02:57.379193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:57.379193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:57.379193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:02:57.379193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:57.379193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:02:57.379193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:57.379193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:57.379193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:57.379193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:57.379193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:57.379193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:57.379193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:57.379193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:57.379193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:57.379193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:57.379193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:57.379193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:57.379193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:57.380545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:57.380545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:57.380545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:02:57.380545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:02:57.380545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:02:57.380545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:02:57.380545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:02:57.380545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:02:57.380545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 19:02:57.380545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:57.384123 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 333/686] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Jun 2 19:02:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:57.385057 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083c9c3-1ce2-4cdc-abc7-a271cc7dc2e6 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:57.393432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4a2b6-2f88-49c7-b66a-5186a90e53e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:57.394596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4a2b6-2f88-49c7-b66a-5186a90e53e0 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:57.395077 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4a2b6-2f88-49c7-b66a-5186a90e53e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:57.400143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4a2b6-2f88-49c7-b66a-5186a90e53e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:57.400143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4a2b6-2f88-49c7-b66a-5186a90e53e0 None admin] RBAC: Adding query filter params (role.id=13ff8a5ffa5648c28ec00aa75b69d913, scope.project.id=b11b7e66a993492d8163097bce955c0b, user.id=2efd679ca9314c8591cabbca15f8c61b) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:57.400143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4a2b6-2f88-49c7-b66a-5186a90e53e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:57.400143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4a2b6-2f88-49c7-b66a-5186a90e53e0 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:57.405926 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 354/687] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:02:57 2022] GET /identity/v3/role_assignments?user.id=2efd679ca9314c8591cabbca15f8c61b&scope.project.id=b11b7e66a993492d8163097bce955c0b&role.id=13ff8a5ffa5648c28ec00aa75b69d913 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:57.407221 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4a2b6-2f88-49c7-b66a-5186a90e53e0 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:57.491367 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:57.502137 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083c9c3-1ce2-4cdc-abc7-a271cc7dc2e6 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:57.528588 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4a2b6-2f88-49c7-b66a-5186a90e53e0 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:57.550275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c8d31-f9da-4c49-b20d-b3064c7c8b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:57.551022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c8d31-f9da-4c49-b20d-b3064c7c8b2b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:57.551389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c8d31-f9da-4c49-b20d-b3064c7c8b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:57.551588 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c8d31-f9da-4c49-b20d-b3064c7c8b2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:57.570045 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c8d31-f9da-4c49-b20d-b3064c7c8b2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:57.571689 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c8d31-f9da-4c49-b20d-b3064c7c8b2b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:57.575173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:57.589999 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32066f-bf50-4ff4-b243-6cd729a893a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:57.591173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32066f-bf50-4ff4-b243-6cd729a893a2 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:57.591936 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32066f-bf50-4ff4-b243-6cd729a893a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:57.592452 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32066f-bf50-4ff4-b243-6cd729a893a2 None admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:57.593599 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32066f-bf50-4ff4-b243-6cd729a893a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:57.594816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32066f-bf50-4ff4-b243-6cd729a893a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:57.596660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32066f-bf50-4ff4-b243-6cd729a893a2 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:57.607258 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-7f5c8d31-f9da-4c49-b20d-b3064c7c8b2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:57.607258 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:57.607258 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:57.607258 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:57.607258 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:57.607258 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:57.607258 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:57.607258 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:57.607258 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:57.607258 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:57.607258 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:57.607258 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:57.607258 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:57.607258 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:57.607258 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:57.608275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:57.608275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:57.608275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:57.608275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:57.608275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:57.608275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:57.608275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:57.608275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:57.608275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:57.608275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:57.608275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:57.608275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:57.608275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:57.608275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:57.608275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:57.608275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:57.608275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:57.609181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:57.609181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:57.609181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:57.609181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:57.616799 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 334/688] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:57.628095 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 355/689] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Jun 2 19:02:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:57.636074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c8d31-f9da-4c49-b20d-b3064c7c8b2b None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:57.642407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32066f-bf50-4ff4-b243-6cd729a893a2 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:57.752308 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c8d31-f9da-4c49-b20d-b3064c7c8b2b None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:57.772151 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32066f-bf50-4ff4-b243-6cd729a893a2 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:57.789382 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af91b97-5807-4064-a4cf-228c55bca134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:57.791117 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af91b97-5807-4064-a4cf-228c55bca134 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:57.791299 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af91b97-5807-4064-a4cf-228c55bca134 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:57.793409 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af91b97-5807-4064-a4cf-228c55bca134 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:57.793409 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af91b97-5807-4064-a4cf-228c55bca134 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:57.793409 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af91b97-5807-4064-a4cf-228c55bca134 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:57.794292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af91b97-5807-4064-a4cf-228c55bca134 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:57.811613 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 335/690] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:57.817987 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af91b97-5807-4064-a4cf-228c55bca134 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:57.818786 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8c94b-ca3f-41d6-b678-d4770f3d3636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:57.819531 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8c94b-ca3f-41d6-b678-d4770f3d3636 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:57.820601 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8c94b-ca3f-41d6-b678-d4770f3d3636 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:57.822230 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8c94b-ca3f-41d6-b678-d4770f3d3636 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:57.823856 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:57.887094 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:57.915877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8c94b-ca3f-41d6-b678-d4770f3d3636 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:57.918365 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8c94b-ca3f-41d6-b678-d4770f3d3636 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:57.971275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af91b97-5807-4064-a4cf-228c55bca134 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:58.045521 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 356/691] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:02:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 19:02:58.057262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8c94b-ca3f-41d6-b678-d4770f3d3636 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:58.075790 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86d0f0-ae5e-4755-9fc9-6986efe89a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:58.076585 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86d0f0-ae5e-4755-9fc9-6986efe89a6f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:58.076865 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86d0f0-ae5e-4755-9fc9-6986efe89a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:58.077133 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86d0f0-ae5e-4755-9fc9-6986efe89a6f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:58.094892 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b86d0f0-ae5e-4755-9fc9-6986efe89a6f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:58.096434 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b86d0f0-ae5e-4755-9fc9-6986efe89a6f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:58.131627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-1b86d0f0-ae5e-4755-9fc9-6986efe89a6f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 19:02:58.131627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:58.131627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:58.131627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:58.131627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:58.131627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:58.131627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:58.131627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:58.131627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:58.131627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:58.131627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:58.131627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:58.131627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:02:58.131627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:02:58.131627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:02:58.131627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:02:58.132900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:58.132900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:58.132900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:02:58.132900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:58.132900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:02:58.132900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:02:58.132900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:58.132900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:58.132900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:58.132900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:58.132900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:58.132900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:58.132900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:58.132900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:58.132900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:58.132900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:58.132900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:58.132900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:58.133834 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:58.133834 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:58.133834 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:02:58.133834 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:02:58.133834 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:02:58.133834 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:02:58.133834 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:02:58.133834 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:02:58.133834 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 19:02:58.133834 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:58.133834 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 336/692] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:02:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:58.143494 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86d0f0-ae5e-4755-9fc9-6986efe89a6f None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:58.233010 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:58.270431 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8c94b-ca3f-41d6-b678-d4770f3d3636 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:58.277174 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:58.315821 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0549599-2d81-4643-975a-d0c48f06e5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:58.315821 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0549599-2d81-4643-975a-d0c48f06e5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:58.316172 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0549599-2d81-4643-975a-d0c48f06e5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:58.316249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0549599-2d81-4643-975a-d0c48f06e5e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:58.326918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86d0f0-ae5e-4755-9fc9-6986efe89a6f None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:58.327080 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0549599-2d81-4643-975a-d0c48f06e5e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:58.328475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0549599-2d81-4643-975a-d0c48f06e5e4 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:58.348054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-b0549599-2d81-4643-975a-d0c48f06e5e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:58.348054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:58.348054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:58.348054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:58.348054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:58.348054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:58.348054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:58.348054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:58.348054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:58.348054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:58.348054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:58.348054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:58.348054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:58.348054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:58.348054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:58.349433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:58.349433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:58.349433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:58.349433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:58.349433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:58.349433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:58.349433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:58.349433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:58.349433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:58.349433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:58.349433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:58.349433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:58.349433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:58.349433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:58.349433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:58.349433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:58.349433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:58.350332 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:58.350332 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:58.350332 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:58.350332 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:58.354069 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 357/693] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:58.355488 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585c520-a3e7-4919-9633-bbadf2384864 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:58.355772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585c520-a3e7-4919-9633-bbadf2384864 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:58.356071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585c520-a3e7-4919-9633-bbadf2384864 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:58.357715 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 358/694] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:58.358433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585c520-a3e7-4919-9633-bbadf2384864 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:58.367799 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d76a75-1e66-4b31-8bba-159d62b94067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:58.368676 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d76a75-1e66-4b31-8bba-159d62b94067 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:58.369218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d76a75-1e66-4b31-8bba-159d62b94067 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:58.369385 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d76a75-1e66-4b31-8bba-159d62b94067 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:58.370127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d76a75-1e66-4b31-8bba-159d62b94067 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:58.370435 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d76a75-1e66-4b31-8bba-159d62b94067 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:58.372343 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d76a75-1e66-4b31-8bba-159d62b94067 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:58.398144 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 337/695] 10.222.0.45 () {56 vars in 1135 bytes} [Thu Jun 2 19:02:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:58.399543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b970e9-01e6-4853-a4bb-4c0727c2e098 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:58.399834 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b970e9-01e6-4853-a4bb-4c0727c2e098 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:58.400135 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b970e9-01e6-4853-a4bb-4c0727c2e098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:58.420176 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-30b970e9-01e6-4853-a4bb-4c0727c2e098 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:58.421468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-30b970e9-01e6-4853-a4bb-4c0727c2e098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:58.495770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585c520-a3e7-4919-9633-bbadf2384864 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:58.504954 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 338/696] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:58.505883 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b970e9-01e6-4853-a4bb-4c0727c2e098 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:58.550709 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:58.557275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7096d-1895-443e-9d69-2319244fd000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:58.558031 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7096d-1895-443e-9d69-2319244fd000 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:58.558805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7096d-1895-443e-9d69-2319244fd000 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:58.559319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7096d-1895-443e-9d69-2319244fd000 None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:58.560249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7096d-1895-443e-9d69-2319244fd000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:58.560708 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7096d-1895-443e-9d69-2319244fd000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:58.563555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7096d-1895-443e-9d69-2319244fd000 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:58.569897 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:58.587189 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 359/697] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:58.587189 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7096d-1895-443e-9d69-2319244fd000 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:58.629795 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b970e9-01e6-4853-a4bb-4c0727c2e098 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:58.668847 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03858c-38c8-4094-bfe2-c661fe05c8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:58.669940 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03858c-38c8-4094-bfe2-c661fe05c8ea None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:58.670528 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03858c-38c8-4094-bfe2-c661fe05c8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:58.670997 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03858c-38c8-4094-bfe2-c661fe05c8ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:58.713730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7096d-1895-443e-9d69-2319244fd000 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:58.756215 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0231e-d1dd-409a-bb52-a306a75dc433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:58.757486 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0231e-d1dd-409a-bb52-a306a75dc433 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:58.757969 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0231e-d1dd-409a-bb52-a306a75dc433 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:58.758468 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0231e-d1dd-409a-bb52-a306a75dc433 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:58.759366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f0231e-d1dd-409a-bb52-a306a75dc433 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:58.759629 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03858c-38c8-4094-bfe2-c661fe05c8ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:58.761195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03858c-38c8-4094-bfe2-c661fe05c8ea None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:58.761309 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f0231e-d1dd-409a-bb52-a306a75dc433 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:58.777419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-a3f0231e-d1dd-409a-bb52-a306a75dc433 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 19:02:58.777419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:58.777419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 19:02:58.777419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 19:02:58.777419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 19:02:58.777419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 19:02:58.777419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 19:02:58.777419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:02:58.777419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 19:02:58.777419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:58.777419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:02:58.777419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:58.777419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:58.777419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:58.777419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:58.777419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:58.778469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:58.778469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:58.778469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:58.778469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:58.778469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:58.778469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:58.778469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:58.778469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 19:02:58.778469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 19:02:58.778469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 19:02:58.778469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 19:02:58.778469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:58.778469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:58.778469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:58.778469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:58.778469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:58.779310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:58.779310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:58.779310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:58.779310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:58.779310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:58.779310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:58.779310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:58.779310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:58.779310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:58.779310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:58.779310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:58.779310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 19:02:58.779310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:02:58.779310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 19:02:58.779310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:58.787512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 360/698] 10.222.0.45 () {56 vars in 1129 bytes} [Thu Jun 2 19:02:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:58.788806 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0231e-d1dd-409a-bb52-a306a75dc433 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:58.834551 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:58.859550 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:58.908077 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 339/699] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:02:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 19:02:58.908077 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03858c-38c8-4094-bfe2-c661fe05c8ea None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:58.933314 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0231e-d1dd-409a-bb52-a306a75dc433 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:58.977645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f80cc-d713-41e8-a687-d5cb526dc003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:58.979813 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f80cc-d713-41e8-a687-d5cb526dc003 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:58.980427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f80cc-d713-41e8-a687-d5cb526dc003 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:58.980941 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f80cc-d713-41e8-a687-d5cb526dc003 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:58.990169 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f80cc-d713-41e8-a687-d5cb526dc003 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:58.991919 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f80cc-d713-41e8-a687-d5cb526dc003 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:59.009386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-f14f80cc-d713-41e8-a687-d5cb526dc003 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:59.009386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:59.009386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:59.009386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:59.009386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:59.009386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:59.009386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:59.009386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:59.009386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:59.009386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:59.009386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:59.009386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:59.009386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:02:59.009386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:02:59.009386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:02:59.010343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:02:59.010343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:59.010343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:59.010343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:59.010343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:59.010343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:59.010343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:59.010343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:59.010343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:59.010343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:59.010343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:59.010343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:59.010343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:59.010343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:59.010343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:59.010343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:59.010343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:59.011220 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:02:59.011220 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:02:59.011220 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:02:59.011220 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:02:59.011220 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:02:59.011220 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:02:59.011220 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:59.011220 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:59.018861 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 361/700] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:02:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:59.020178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f80cc-d713-41e8-a687-d5cb526dc003 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:59.033685 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03858c-38c8-4094-bfe2-c661fe05c8ea None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:59.077961 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e8ae5-2e64-4187-b1ce-9b5a6ac16b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:59.078743 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e8ae5-2e64-4187-b1ce-9b5a6ac16b5d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:59.079022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e8ae5-2e64-4187-b1ce-9b5a6ac16b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:59.079292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e8ae5-2e64-4187-b1ce-9b5a6ac16b5d None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:59.080024 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e8ae5-2e64-4187-b1ce-9b5a6ac16b5d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:59.080433 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e8ae5-2e64-4187-b1ce-9b5a6ac16b5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:59.082320 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e8ae5-2e64-4187-b1ce-9b5a6ac16b5d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:59.092034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 340/701] 10.222.0.45 () {56 vars in 1124 bytes} [Thu Jun 2 19:02:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:59.092034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e8ae5-2e64-4187-b1ce-9b5a6ac16b5d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:59.116067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:59.142238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f80cc-d713-41e8-a687-d5cb526dc003 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:59.161411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:59.183500 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd1e71-38ae-43a4-a6a8-1aa579b3e189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:59.184846 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd1e71-38ae-43a4-a6a8-1aa579b3e189 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:59.185135 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd1e71-38ae-43a4-a6a8-1aa579b3e189 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:59.185415 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd1e71-38ae-43a4-a6a8-1aa579b3e189 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:59.200555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd1e71-38ae-43a4-a6a8-1aa579b3e189 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:59.202837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd1e71-38ae-43a4-a6a8-1aa579b3e189 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:59.212967 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e8ae5-2e64-4187-b1ce-9b5a6ac16b5d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:59.223416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-81cd1e71-38ae-43a4-a6a8-1aa579b3e189 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:59.223416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:59.223416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:59.223416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:59.223416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:59.223416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:59.223416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:59.223416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:59.223416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:59.223416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:59.223416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:59.223416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:59.223416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:59.223416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:59.223416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:59.224442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:59.224442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:59.224442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:59.224442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:59.224442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:59.224442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:59.224442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:59.224442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:59.224442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:59.224442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:59.224442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:59.224442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:59.224442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:59.224442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:59.224442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:59.224442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:59.224442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:59.225356 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:59.225356 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:59.225356 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:59.225356 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:59.225356 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 362/702] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:59.225639 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd1e71-38ae-43a4-a6a8-1aa579b3e189 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:59.260094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0dd14d-f2e1-448a-92f3-56245c8ad4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:59.260784 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dd14d-f2e1-448a-92f3-56245c8ad4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:59.261064 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dd14d-f2e1-448a-92f3-56245c8ad4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:59.261337 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dd14d-f2e1-448a-92f3-56245c8ad4c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:59.262145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0dd14d-f2e1-448a-92f3-56245c8ad4c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:59.262451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0dd14d-f2e1-448a-92f3-56245c8ad4c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:59.263921 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0dd14d-f2e1-448a-92f3-56245c8ad4c5 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:59.277899 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 341/703] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:02:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:59.279319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4ebe8-0aca-4522-b82a-9c532aa3fe23 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:59.279608 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4ebe8-0aca-4522-b82a-9c532aa3fe23 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:59.279879 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4ebe8-0aca-4522-b82a-9c532aa3fe23 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:59.284068 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 342/704] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:59.284068 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4ebe8-0aca-4522-b82a-9c532aa3fe23 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:59.355372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd1e71-38ae-43a4-a6a8-1aa579b3e189 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:59.373676 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:59.396359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6819e-011f-491d-972b-6063b787779e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:59.397048 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6819e-011f-491d-972b-6063b787779e None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:59.397328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6819e-011f-491d-972b-6063b787779e None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:59.397874 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6819e-011f-491d-972b-6063b787779e None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:59.398319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6819e-011f-491d-972b-6063b787779e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:59.398635 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6819e-011f-491d-972b-6063b787779e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:59.400089 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6819e-011f-491d-972b-6063b787779e None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:59.401848 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4ebe8-0aca-4522-b82a-9c532aa3fe23 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:59.412370 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 363/705] 10.222.0.45 () {56 vars in 1124 bytes} [Thu Jun 2 19:02:59 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:59.412370 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6819e-011f-491d-972b-6063b787779e None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:59.442453 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df40a8-8e1c-4861-af18-9b34d39446ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:59.443134 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df40a8-8e1c-4861-af18-9b34d39446ba None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:59.444050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df40a8-8e1c-4861-af18-9b34d39446ba None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:59.444552 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df40a8-8e1c-4861-af18-9b34d39446ba None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:59.445799 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df40a8-8e1c-4861-af18-9b34d39446ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:59.446122 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df40a8-8e1c-4861-af18-9b34d39446ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:59.447733 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df40a8-8e1c-4861-af18-9b34d39446ba None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:59.458725 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:59.463444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 343/706] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:59.465065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a8c8c-44e6-44f4-b20e-9e9f5ecca30b None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:59.465522 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a8c8c-44e6-44f4-b20e-9e9f5ecca30b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:59.465870 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a8c8c-44e6-44f4-b20e-9e9f5ecca30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:59.486557 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-2b2a8c8c-44e6-44f4-b20e-9e9f5ecca30b None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:59.487964 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2b2a8c8c-44e6-44f4-b20e-9e9f5ecca30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:59.565899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6819e-011f-491d-972b-6063b787779e None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:59.589393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 344/707] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:02:59.590501 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a8c8c-44e6-44f4-b20e-9e9f5ecca30b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:59.627058 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5d924-9a6f-406f-aaca-ab6be8c1c323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:59.628212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5d924-9a6f-406f-aaca-ab6be8c1c323 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:59.628642 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5d924-9a6f-406f-aaca-ab6be8c1c323 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:59.629068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5d924-9a6f-406f-aaca-ab6be8c1c323 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:59.630070 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5d924-9a6f-406f-aaca-ab6be8c1c323 None admin] RBAC: Adding query filter params (role.id=4588ca63994f4e2d9ce482d475edbabd, scope.project.id=b11b7e66a993492d8163097bce955c0b, user.id=575f61ef70314f86b5d9dad3ba1b3aab) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:59.630658 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5d924-9a6f-406f-aaca-ab6be8c1c323 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:59.632559 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5d924-9a6f-406f-aaca-ab6be8c1c323 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:59.640074 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 364/708] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:02:59 2022] GET /identity/v3/role_assignments?user.id=575f61ef70314f86b5d9dad3ba1b3aab&scope.project.id=b11b7e66a993492d8163097bce955c0b&role.id=4588ca63994f4e2d9ce482d475edbabd => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:59.641848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5d924-9a6f-406f-aaca-ab6be8c1c323 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:59.673952 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:59.739151 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a8c8c-44e6-44f4-b20e-9e9f5ecca30b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:59.759158 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:59.765176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5d924-9a6f-406f-aaca-ab6be8c1c323 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:59.789068 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67ea14-e03a-4bad-a4cf-c34800504513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:59.790136 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67ea14-e03a-4bad-a4cf-c34800504513 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:59.790654 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67ea14-e03a-4bad-a4cf-c34800504513 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:59.791159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67ea14-e03a-4bad-a4cf-c34800504513 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:59.805843 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c73c4-d841-48e1-94ec-0e7df60aa3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:59.806671 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c73c4-d841-48e1-94ec-0e7df60aa3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:59.806954 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c73c4-d841-48e1-94ec-0e7df60aa3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:59.807228 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c73c4-d841-48e1-94ec-0e7df60aa3b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:59.807330 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67ea14-e03a-4bad-a4cf-c34800504513 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:59.809202 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67ea14-e03a-4bad-a4cf-c34800504513 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:59.821417 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c73c4-d841-48e1-94ec-0e7df60aa3b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:59.822931 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c73c4-d841-48e1-94ec-0e7df60aa3b7 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:59.827908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-ea67ea14-e03a-4bad-a4cf-c34800504513 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:59.827908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:59.827908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:59.827908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:59.827908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:59.827908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:59.827908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:59.827908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:59.827908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:59.827908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:59.827908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:59.827908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:59.827908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:02:59.827908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:02:59.827908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:02:59.828947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:02:59.828947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:59.828947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:59.828947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:59.828947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:59.828947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:59.828947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:59.828947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:59.828947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:59.828947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:59.828947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:59.828947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:59.828947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:59.828947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:59.828947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:59.828947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:59.828947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:59.830145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:02:59.830145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:02:59.830145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:02:59.830145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:02:59.830145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:02:59.830145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:02:59.830145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:02:59.830145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:02:59.830145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 345/709] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:02:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:59.836989 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67ea14-e03a-4bad-a4cf-c34800504513 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:59.849059 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-e06c73c4-d841-48e1-94ec-0e7df60aa3b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:59.849059 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:02:59.849059 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:02:59.849059 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:02:59.849059 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:02:59.849059 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:02:59.849059 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:02:59.849059 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:02:59.849059 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:02:59.849059 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:02:59.849059 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:02:59.849059 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:02:59.849059 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:02:59.849059 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:02:59.849059 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:02:59.850030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:02:59.850030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:02:59.850030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:02:59.850030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:02:59.850030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:02:59.850030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:02:59.850030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:02:59.850030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:02:59.850030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:02:59.850030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:02:59.850030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:02:59.850030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:02:59.850030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:02:59.850030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:02:59.850030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:02:59.850030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:02:59.850030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:02:59.851754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:02:59.851754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:02:59.851754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:02:59.851754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:02:59.851754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 365/710] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:02:59.856716 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c73c4-d841-48e1-94ec-0e7df60aa3b7 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:59.973064 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67ea14-e03a-4bad-a4cf-c34800504513 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:00.002089 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:00.010643 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774e40c-011e-48cc-81e0-b41c4ab9bb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:00.011704 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774e40c-011e-48cc-81e0-b41c4ab9bb6a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:00.012249 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774e40c-011e-48cc-81e0-b41c4ab9bb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:00.012760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774e40c-011e-48cc-81e0-b41c4ab9bb6a None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:00.013985 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774e40c-011e-48cc-81e0-b41c4ab9bb6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:00.014507 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774e40c-011e-48cc-81e0-b41c4ab9bb6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:00.021307 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774e40c-011e-48cc-81e0-b41c4ab9bb6a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:00.030630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 346/711] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:02:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:00.039150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774e40c-011e-48cc-81e0-b41c4ab9bb6a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:00.044995 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c73c4-d841-48e1-94ec-0e7df60aa3b7 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:00.088031 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e77f5-cfc5-4f4b-8f39-4f8bca98871c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:00.088031 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e77f5-cfc5-4f4b-8f39-4f8bca98871c None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:00.088031 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e77f5-cfc5-4f4b-8f39-4f8bca98871c None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:00.088031 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e77f5-cfc5-4f4b-8f39-4f8bca98871c None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:00.088566 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e77f5-cfc5-4f4b-8f39-4f8bca98871c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:00.088566 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e77f5-cfc5-4f4b-8f39-4f8bca98871c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:00.088566 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e77f5-cfc5-4f4b-8f39-4f8bca98871c None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:00.099229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 366/712] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:00.104753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e77f5-cfc5-4f4b-8f39-4f8bca98871c None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:00.124410 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:00.229439 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e77f5-cfc5-4f4b-8f39-4f8bca98871c None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:00.246248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774e40c-011e-48cc-81e0-b41c4ab9bb6a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:00.273327 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c52de-4dff-45b0-baa4-53ea8dd85b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:00.274011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c52de-4dff-45b0-baa4-53ea8dd85b3e None admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:00.274294 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c52de-4dff-45b0-baa4-53ea8dd85b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:00.274571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c52de-4dff-45b0-baa4-53ea8dd85b3e None admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:00.275295 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c52de-4dff-45b0-baa4-53ea8dd85b3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:00.277352 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c52de-4dff-45b0-baa4-53ea8dd85b3e None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:00.292326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4734ab-e393-4c23-b680-b88e949ed6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:00.293174 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4734ab-e393-4c23-b680-b88e949ed6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:00.293577 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4734ab-e393-4c23-b680-b88e949ed6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:00.294003 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4734ab-e393-4c23-b680-b88e949ed6b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:00.294996 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4734ab-e393-4c23-b680-b88e949ed6b3 None admin] RBAC: Adding query filter params (role.id=13ff8a5ffa5648c28ec00aa75b69d913, scope.project.id=b11b7e66a993492d8163097bce955c0b, user.id=87ba0ab9510d49c4ab4c634e82790efb) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:00.295411 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4734ab-e393-4c23-b680-b88e949ed6b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:00.296977 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4734ab-e393-4c23-b680-b88e949ed6b3 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:00.304370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 347/713] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:03:00 2022] GET /identity/v3/role_assignments?user.id=87ba0ab9510d49c4ab4c634e82790efb&scope.project.id=b11b7e66a993492d8163097bce955c0b&role.id=13ff8a5ffa5648c28ec00aa75b69d913 => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:00.307440 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed70fa-d9aa-422d-873d-e5ac5f8a568c None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:00.307440 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed70fa-d9aa-422d-873d-e5ac5f8a568c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:00.307440 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed70fa-d9aa-422d-873d-e5ac5f8a568c None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:00.307933 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 348/714] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:00.314415 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ba5c7-efe4-45a4-903a-d84d9375e906 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:00.314845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ba5c7-efe4-45a4-903a-d84d9375e906 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:00.315227 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ba5c7-efe4-45a4-903a-d84d9375e906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:00.338257 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-825ba5c7-efe4-45a4-903a-d84d9375e906 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:00.339570 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-825ba5c7-efe4-45a4-903a-d84d9375e906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:00.382648 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 367/715] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jun 2 19:03:00 2022] POST /identity/v3/users => generated 254 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:00.414021 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:00.441038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 349/716] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:03:00.484750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c52de-4dff-45b0-baa4-53ea8dd85b3e None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:00.574956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:00.624865 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c52de-4dff-45b0-baa4-53ea8dd85b3e None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:00.666826 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10263766-3b72-41bd-8537-f3024c81d3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:00.667657 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10263766-3b72-41bd-8537-f3024c81d3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:00.667939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10263766-3b72-41bd-8537-f3024c81d3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:00.668249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10263766-3b72-41bd-8537-f3024c81d3e5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:00.668925 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10263766-3b72-41bd-8537-f3024c81d3e5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:00.670342 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10263766-3b72-41bd-8537-f3024c81d3e5 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:00.685263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-10263766-3b72-41bd-8537-f3024c81d3e5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 19:03:00.685263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:00.685263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 19:03:00.685263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 19:03:00.685263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 19:03:00.685263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 19:03:00.685263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 19:03:00.685263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:00.685263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 19:03:00.685263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:00.685263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:03:00.685263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:00.685263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:00.685263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:00.685263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:00.685263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:00.685263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:00.686316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:00.686316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:00.686316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:00.686316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:00.686316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:00.686316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:00.686316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 19:03:00.686316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 19:03:00.686316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 19:03:00.686316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 19:03:00.686316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:00.686316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:00.686316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:00.686316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:00.686316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:00.686316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:00.687372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:00.687372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:00.687372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:00.687372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:00.687372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:00.687372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:00.687372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:00.687372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:00.687372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:00.687372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:00.687372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 19:03:00.687372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:00.687372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 19:03:00.687372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:00.687372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 368/717] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:03:00 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:00.694571 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ba5c7-efe4-45a4-903a-d84d9375e906 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:00.820843 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ba5c7-efe4-45a4-903a-d84d9375e906 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:00.856758 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb92d6-933c-4700-938e-a677af5a0857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:00.857434 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb92d6-933c-4700-938e-a677af5a0857 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:00.857715 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb92d6-933c-4700-938e-a677af5a0857 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:00.857990 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb92d6-933c-4700-938e-a677af5a0857 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:00.858709 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb92d6-933c-4700-938e-a677af5a0857 None admin] RBAC: Adding query filter params (name=network) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:00.859017 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb92d6-933c-4700-938e-a677af5a0857 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:00.860947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb92d6-933c-4700-938e-a677af5a0857 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:00.866005 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 350/718] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Jun 2 19:03:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:00.871645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10263766-3b72-41bd-8537-f3024c81d3e5 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:01.020483 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10263766-3b72-41bd-8537-f3024c81d3e5 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:01.052309 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:01.072890 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eb3da-9033-4ac7-a976-c7690fc5530b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:01.073591 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eb3da-9033-4ac7-a976-c7690fc5530b None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:01.073879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eb3da-9033-4ac7-a976-c7690fc5530b None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:01.074152 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eb3da-9033-4ac7-a976-c7690fc5530b None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:01.074932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75eb3da-9033-4ac7-a976-c7690fc5530b None admin] RBAC: Adding query filter params (type=network) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:01.075240 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75eb3da-9033-4ac7-a976-c7690fc5530b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:01.076738 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75eb3da-9033-4ac7-a976-c7690fc5530b None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:01.082455 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 369/719] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Jun 2 19:03:00 2022] GET /identity/v3/services?type=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:02.008276 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed13c0-ca8a-4d5d-8a26-c85137ba3019 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:02.008994 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed13c0-ca8a-4d5d-8a26-c85137ba3019 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:02.008994 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed13c0-ca8a-4d5d-8a26-c85137ba3019 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:02.010639 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 351/720] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:02.015796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d768b-4724-44be-9140-2871c8f57882 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:02.016866 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d768b-4724-44be-9140-2871c8f57882 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:02.017084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d768b-4724-44be-9140-2871c8f57882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:02.039480 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-655d768b-4724-44be-9140-2871c8f57882 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:02.040769 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-655d768b-4724-44be-9140-2871c8f57882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:02.142327 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 370/721] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 19:03:02.185984 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed13c0-ca8a-4d5d-8a26-c85137ba3019 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:02.256531 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:02.319183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed13c0-ca8a-4d5d-8a26-c85137ba3019 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:02.355644 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9910f-3e1a-4554-8684-5fed4655aed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:02.356345 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9910f-3e1a-4554-8684-5fed4655aed2 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:02.356632 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9910f-3e1a-4554-8684-5fed4655aed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:02.356910 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9910f-3e1a-4554-8684-5fed4655aed2 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:02.357750 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9910f-3e1a-4554-8684-5fed4655aed2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:02.359140 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9910f-3e1a-4554-8684-5fed4655aed2 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:02.486301 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 352/722] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jun 2 19:03:02 2022] POST /identity/v3/services => generated 251 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:02.728764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb81a4-b716-4c04-8bf7-7f826530e233 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:02.729165 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb81a4-b716-4c04-8bf7-7f826530e233 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:02.729352 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb81a4-b716-4c04-8bf7-7f826530e233 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:02.731036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 371/723] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:02.737154 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16428d7-52c1-4b33-b271-d6c06fe8f406 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:02.737468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16428d7-52c1-4b33-b271-d6c06fe8f406 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:02.737637 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16428d7-52c1-4b33-b271-d6c06fe8f406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:02.765247 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-c16428d7-52c1-4b33-b271-d6c06fe8f406 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:02.767047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c16428d7-52c1-4b33-b271-d6c06fe8f406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:02.882460 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 353/724] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:02 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:03:02.905484 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb81a4-b716-4c04-8bf7-7f826530e233 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:03.050029 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb81a4-b716-4c04-8bf7-7f826530e233 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:03.084440 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:03.107827 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8552664-9cba-43b0-a437-1691ca4aaa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:03.112157 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8552664-9cba-43b0-a437-1691ca4aaa3e None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:03.112157 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8552664-9cba-43b0-a437-1691ca4aaa3e None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:03.112157 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8552664-9cba-43b0-a437-1691ca4aaa3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:03.123282 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8552664-9cba-43b0-a437-1691ca4aaa3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:03:03.131384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-a8552664-9cba-43b0-a437-1691ca4aaa3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:03:03.131384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:03.131384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:03.131384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:03.131384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:03.131384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:03.131384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:03.131384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:03.131384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:03.131384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:03.131384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:03.131384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:03.131384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:03:03.131384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:03:03.131384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:03:03.131384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:03:03.132505 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:03:03.132505 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:03:03.132505 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:03:03.132505 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:03:03.132505 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:03.132505 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:03.132505 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:03.132505 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:03.132505 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:03.132505 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:03.132505 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:03.132505 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:03.132505 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:03.132505 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:03.132505 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:03.132505 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:03.133447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:03.133447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:03.133447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:03.133447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:03.133447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:03:03.133447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:03:03.133447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:03:03.133447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:03:03.133447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:03:03.133447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:03:03.133447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:03:03.133447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:03.133447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 372/725] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:03:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:03.140619 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16428d7-52c1-4b33-b271-d6c06fe8f406 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:03.206092 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:03.310349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16428d7-52c1-4b33-b271-d6c06fe8f406 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:03.357946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4347895-23f6-4abe-a878-42598dc9a903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:03.358637 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4347895-23f6-4abe-a878-42598dc9a903 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:03.359048 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4347895-23f6-4abe-a878-42598dc9a903 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:03.359326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4347895-23f6-4abe-a878-42598dc9a903 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:03.360682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4347895-23f6-4abe-a878-42598dc9a903 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:03.360987 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4347895-23f6-4abe-a878-42598dc9a903 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:03.361379 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8658b-dd34-47fa-b000-05dba10665df None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:03.361674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8658b-dd34-47fa-b000-05dba10665df None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:03.361959 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8658b-dd34-47fa-b000-05dba10665df None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:03.362379 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4347895-23f6-4abe-a878-42598dc9a903 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:03.363747 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 373/726] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:03.369013 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d8b0f-c72c-4e85-8f3c-a2962c87baa6 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:03.375126 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d8b0f-c72c-4e85-8f3c-a2962c87baa6 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:03.375126 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d8b0f-c72c-4e85-8f3c-a2962c87baa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:03.376088 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 354/727] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:03:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:03.379697 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4347895-23f6-4abe-a878-42598dc9a903 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:03.416046 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-461d8b0f-c72c-4e85-8f3c-a2962c87baa6 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:03.417272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-461d8b0f-c72c-4e85-8f3c-a2962c87baa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:03.488371 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:03.499078 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4347895-23f6-4abe-a878-42598dc9a903 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:03.530185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 374/728] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:03 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:03:03.531819 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30f687-54cf-44d2-bebc-f1d8d5464d64 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:03.532153 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30f687-54cf-44d2-bebc-f1d8d5464d64 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:03.532430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30f687-54cf-44d2-bebc-f1d8d5464d64 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:03.538292 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 375/729] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:03.539965 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b0e22-0f9f-4ac0-a497-cd12a5e2377a None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:03.540296 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b0e22-0f9f-4ac0-a497-cd12a5e2377a None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:03.540618 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b0e22-0f9f-4ac0-a497-cd12a5e2377a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:03.550355 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce745104-6867-456c-a427-22a7b921b9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:03.551208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce745104-6867-456c-a427-22a7b921b9fb None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:03.551490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce745104-6867-456c-a427-22a7b921b9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:03.551811 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce745104-6867-456c-a427-22a7b921b9fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:03.564364 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-2c2b0e22-0f9f-4ac0-a497-cd12a5e2377a None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:03.564554 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce745104-6867-456c-a427-22a7b921b9fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:03.565840 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce745104-6867-456c-a427-22a7b921b9fb None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:03.566261 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-2c2b0e22-0f9f-4ac0-a497-cd12a5e2377a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:03.587734 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-ce745104-6867-456c-a427-22a7b921b9fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:03.587734 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:03.587734 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:03.587734 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:03.587734 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:03.587734 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:03.587734 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:03.587734 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:03.587734 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:03.587734 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:03.587734 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:03.587734 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:03.587734 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:03.587734 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:03.587734 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:03.588760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:03.588760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:03.588760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:03.588760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:03.588760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:03.588760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:03.588760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:03.588760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:03.588760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:03.588760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:03.588760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:03.588760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:03.588760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:03.588760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:03.588760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:03.588760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:03.588760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:03.589656 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:03.589656 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:03.589656 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:03.589656 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:03.589656 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 355/730] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:03.590381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce745104-6867-456c-a427-22a7b921b9fb None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:03.660528 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 376/731] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:03 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:03:03.660528 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b0e22-0f9f-4ac0-a497-cd12a5e2377a None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:03.702729 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:03.737380 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce745104-6867-456c-a427-22a7b921b9fb None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:03.778195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbc759-4f03-48ee-a04e-8663311c9f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:03.779057 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbc759-4f03-48ee-a04e-8663311c9f0b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:03.779344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbc759-4f03-48ee-a04e-8663311c9f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:03.779621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbc759-4f03-48ee-a04e-8663311c9f0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:03.790525 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b0e22-0f9f-4ac0-a497-cd12a5e2377a None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:03.793493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dbc759-4f03-48ee-a04e-8663311c9f0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:03:03.803327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-83dbc759-4f03-48ee-a04e-8663311c9f0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:03:03.803327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:03.803327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:03.803327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:03.803327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:03.803327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:03.803327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:03.803327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:03.803327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:03.803327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:03.803327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:03.803327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:03.803327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:03:03.803327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:03:03.803327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:03:03.803327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:03:03.804341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:03:03.804341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:03:03.804341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:03:03.804341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:03:03.804341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:03.804341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:03.804341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:03.804341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:03.804341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:03.804341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:03.804341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:03.804341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:03.804341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:03.804341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:03.804341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:03.804341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:03.805390 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:03.805390 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:03.805390 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:03.805390 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:03.805390 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:03:03.805390 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:03:03.805390 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:03:03.805390 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:03:03.805390 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:03:03.805390 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:03:03.805390 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:03:03.805390 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:03.805390 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 356/732] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jun 2 19:03:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:03.806225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbc759-4f03-48ee-a04e-8663311c9f0b None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:03.812094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:03.845409 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b23881-13b9-45e3-8951-e233b7d23fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:03.847194 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b23881-13b9-45e3-8951-e233b7d23fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:03.847670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b23881-13b9-45e3-8951-e233b7d23fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:03.848178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b23881-13b9-45e3-8951-e233b7d23fd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:03.849376 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b23881-13b9-45e3-8951-e233b7d23fd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:03.849877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b23881-13b9-45e3-8951-e233b7d23fd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:03.852482 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b23881-13b9-45e3-8951-e233b7d23fd9 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:03.869263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 377/733] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:03.870460 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b23881-13b9-45e3-8951-e233b7d23fd9 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:03.927804 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbc759-4f03-48ee-a04e-8663311c9f0b None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:03.965983 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8541e-def9-40fa-acc8-ebf7c12ab008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:03.967145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8541e-def9-40fa-acc8-ebf7c12ab008 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:03.967597 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8541e-def9-40fa-acc8-ebf7c12ab008 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:03.967938 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8541e-def9-40fa-acc8-ebf7c12ab008 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:03.980280 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be8541e-def9-40fa-acc8-ebf7c12ab008 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:03:03.986027 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b23881-13b9-45e3-8951-e233b7d23fd9 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:03.987899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:03.989943 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-7be8541e-def9-40fa-acc8-ebf7c12ab008 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:03:03.989943 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:03.989943 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:03.989943 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:03.989943 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:03.989943 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:03.989943 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:03.989943 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:03.989943 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:03.989943 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:03.989943 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:03.989943 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:03.989943 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:03:03.989943 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:03:03.989943 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:03:03.989943 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:03:03.990927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:03:03.990927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:03:03.990927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:03:03.990927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:03:03.990927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:03.990927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:03.990927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:03.990927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:03.990927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:03.990927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:03.990927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:03.990927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:03.990927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:03.990927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:03.990927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:03.990927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:03.991799 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:03.991799 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:03.991799 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:03.991799 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:03.991799 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:03:03.991799 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:03:03.991799 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:03:03.991799 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:03:03.991799 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:03:03.991799 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:03:03.991799 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:03:03.991799 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:03.996121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 357/734] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:03:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:04.002103 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8541e-def9-40fa-acc8-ebf7c12ab008 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:04.028571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb3baa-3d2a-49c3-8c22-c3edfb077dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:04.029650 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb3baa-3d2a-49c3-8c22-c3edfb077dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:04.030115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb3baa-3d2a-49c3-8c22-c3edfb077dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:04.030584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb3baa-3d2a-49c3-8c22-c3edfb077dc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:04.032219 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb3baa-3d2a-49c3-8c22-c3edfb077dc0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:04.032883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb3baa-3d2a-49c3-8c22-c3edfb077dc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:04.034507 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb3baa-3d2a-49c3-8c22-c3edfb077dc0 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:04.044295 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 378/735] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jun 2 19:03:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:04.045544 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb3baa-3d2a-49c3-8c22-c3edfb077dc0 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:04.066784 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:04.114450 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8541e-def9-40fa-acc8-ebf7c12ab008 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:04.151954 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddecb8-8b2b-4d09-99c5-55bbff771b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:04.152841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddecb8-8b2b-4d09-99c5-55bbff771b12 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:04.153126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddecb8-8b2b-4d09-99c5-55bbff771b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:04.153392 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddecb8-8b2b-4d09-99c5-55bbff771b12 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:04.163177 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb3baa-3d2a-49c3-8c22-c3edfb077dc0 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:04.163777 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddecb8-8b2b-4d09-99c5-55bbff771b12 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:04.165301 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddecb8-8b2b-4d09-99c5-55bbff771b12 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:04.182461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-a0ddecb8-8b2b-4d09-99c5-55bbff771b12 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 19:03:04.182461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:04.182461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:04.182461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:04.182461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:04.182461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:04.182461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:04.182461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:04.182461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:04.182461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:04.182461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:04.182461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:04.182461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:03:04.182461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:03:04.182461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:03:04.182461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:03:04.183508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:04.183508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:04.183508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:03:04.183508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:04.183508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:03:04.183508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:04.183508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:04.183508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:04.183508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:04.183508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:04.183508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:04.183508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:04.183508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:04.183508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:04.183508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:04.183508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:04.183508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:04.183508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:04.189736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:04.189736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:04.189736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:03:04.189736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:03:04.189736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:03:04.189736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:03:04.189736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:03:04.189736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:03:04.189736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 19:03:04.189736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:04.189736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 358/736] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Jun 2 19:03:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:04.189736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddecb8-8b2b-4d09-99c5-55bbff771b12 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:04.204502 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05bf64-90b5-4dc1-ae2d-1155b1a4b776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:04.205218 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05bf64-90b5-4dc1-ae2d-1155b1a4b776 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:04.205466 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05bf64-90b5-4dc1-ae2d-1155b1a4b776 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:04.205741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05bf64-90b5-4dc1-ae2d-1155b1a4b776 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:04.206485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05bf64-90b5-4dc1-ae2d-1155b1a4b776 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:04.206830 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05bf64-90b5-4dc1-ae2d-1155b1a4b776 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:04.208196 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05bf64-90b5-4dc1-ae2d-1155b1a4b776 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:04.220039 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 379/737] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:03:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:04.220039 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e2e90-223f-4ef6-a0e7-fcbe7dd0f852 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:04.220039 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e2e90-223f-4ef6-a0e7-fcbe7dd0f852 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:04.220039 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e2e90-223f-4ef6-a0e7-fcbe7dd0f852 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:04.221450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 380/738] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:04.222466 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e2e90-223f-4ef6-a0e7-fcbe7dd0f852 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:04.253026 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:04.311069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddecb8-8b2b-4d09-99c5-55bbff771b12 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:04.336078 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:04.337621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e2e90-223f-4ef6-a0e7-fcbe7dd0f852 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:04.347293 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572b06b-a8e5-426a-b206-3e29b9cb3071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:04.353825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572b06b-a8e5-426a-b206-3e29b9cb3071 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:04.353825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572b06b-a8e5-426a-b206-3e29b9cb3071 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:04.353825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572b06b-a8e5-426a-b206-3e29b9cb3071 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:04.359148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572b06b-a8e5-426a-b206-3e29b9cb3071 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:04.361350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572b06b-a8e5-426a-b206-3e29b9cb3071 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:04.379414 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea07d0-a4f2-4137-beba-cd0a9a058c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:04.379414 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea07d0-a4f2-4137-beba-cd0a9a058c47 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:04.379414 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea07d0-a4f2-4137-beba-cd0a9a058c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:04.379414 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea07d0-a4f2-4137-beba-cd0a9a058c47 None admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:04.379798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-9572b06b-a8e5-426a-b206-3e29b9cb3071 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:04.379798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:04.379798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:04.379798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:04.379798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:04.379798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:04.379798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:04.379798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:04.379798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:04.379798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:04.379798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:04.379798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:04.379798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:04.379798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:04.379798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:04.386428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:04.386428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:04.386428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:04.386428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:04.386428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:04.386428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:04.386428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:04.386428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:04.386428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:04.386428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:04.386428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:04.386428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:04.386428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:04.386428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:04.386428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:04.386428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:04.386428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:04.387543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:04.387543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:04.387543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:04.387543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:04.387819 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea07d0-a4f2-4137-beba-cd0a9a058c47 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:04.387819 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea07d0-a4f2-4137-beba-cd0a9a058c47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:04.387986 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 359/739] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:04.387986 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572b06b-a8e5-426a-b206-3e29b9cb3071 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:04.388184 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea07d0-a4f2-4137-beba-cd0a9a058c47 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:04.450656 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 381/740] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Jun 2 19:03:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:04.450656 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c146f7d-ebf0-4071-a6f7-3bf2113ea96a None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:04.450656 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c146f7d-ebf0-4071-a6f7-3bf2113ea96a None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:04.450656 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c146f7d-ebf0-4071-a6f7-3bf2113ea96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:04.465097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-1c146f7d-ebf0-4071-a6f7-3bf2113ea96a None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:04.466296 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-1c146f7d-ebf0-4071-a6f7-3bf2113ea96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:04.507521 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572b06b-a8e5-426a-b206-3e29b9cb3071 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:04.536920 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 382/741] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:04 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 19:03:04.538201 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c146f7d-ebf0-4071-a6f7-3bf2113ea96a None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:04.556116 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06162527-3c7b-4ae0-8175-19fb15cf4260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:04.556918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06162527-3c7b-4ae0-8175-19fb15cf4260 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:04.557194 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06162527-3c7b-4ae0-8175-19fb15cf4260 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:04.557466 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06162527-3c7b-4ae0-8175-19fb15cf4260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:04.564244 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:04.572385 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06162527-3c7b-4ae0-8175-19fb15cf4260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:04.573850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06162527-3c7b-4ae0-8175-19fb15cf4260 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:04.593177 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-06162527-3c7b-4ae0-8175-19fb15cf4260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:04.593177 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:04.593177 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:04.593177 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:04.593177 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:04.593177 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:04.593177 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:04.593177 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:04.593177 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:04.593177 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:04.593177 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:04.593177 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:04.593177 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:04.593177 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:04.593177 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:04.594203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:04.594203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:04.594203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:04.594203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:04.594203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:04.594203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:04.594203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:04.594203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:04.594203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:04.594203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:04.594203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:04.594203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:04.594203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:04.594203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:04.594203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:04.594203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:04.594203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:04.595141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:04.595141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:04.595141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:04.595141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:04.599182 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 360/742] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:04.600321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06162527-3c7b-4ae0-8175-19fb15cf4260 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:04.634920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:04.667118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c146f7d-ebf0-4071-a6f7-3bf2113ea96a None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:04.708713 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9fcae-e747-4a21-ac6c-11320ffa09f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:04.709464 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06162527-3c7b-4ae0-8175-19fb15cf4260 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:04.709979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9fcae-e747-4a21-ac6c-11320ffa09f1 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:04.710448 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9fcae-e747-4a21-ac6c-11320ffa09f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:04.711033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9fcae-e747-4a21-ac6c-11320ffa09f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:04.712122 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9fcae-e747-4a21-ac6c-11320ffa09f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:04.712439 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9fcae-e747-4a21-ac6c-11320ffa09f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:04.713845 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9fcae-e747-4a21-ac6c-11320ffa09f1 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:04.732576 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 383/743] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:04.732576 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9fcae-e747-4a21-ac6c-11320ffa09f1 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:04.752985 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aaddd2-5c36-47a8-aa5e-69edbb7f235c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:04.753782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aaddd2-5c36-47a8-aa5e-69edbb7f235c None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:04.754063 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aaddd2-5c36-47a8-aa5e-69edbb7f235c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:04.754337 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aaddd2-5c36-47a8-aa5e-69edbb7f235c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:04.765261 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aaddd2-5c36-47a8-aa5e-69edbb7f235c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:04.767267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aaddd2-5c36-47a8-aa5e-69edbb7f235c None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:04.785127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-83aaddd2-5c36-47a8-aa5e-69edbb7f235c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:04.785127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:04.785127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:04.785127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:04.785127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:04.785127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:04.785127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:04.785127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:04.785127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:04.785127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:04.785127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:04.785127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:04.785127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:04.785127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:04.785127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:04.786300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:04.786300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:04.786300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:04.786300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:04.786300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:04.786300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:04.786300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:04.786300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:04.786300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:04.786300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:04.786300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:04.786300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:04.786300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:04.786300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:04.786300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:04.786300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:04.786300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:04.787242 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:04.787242 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:04.787242 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:04.787242 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:04.787242 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 361/744] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:04.787242 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aaddd2-5c36-47a8-aa5e-69edbb7f235c None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:04.823470 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:04.849690 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9fcae-e747-4a21-ac6c-11320ffa09f1 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:04.879802 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:04.889354 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cdab7-4fc8-47ad-a23f-2031b1c5c81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:04.889996 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cdab7-4fc8-47ad-a23f-2031b1c5c81d None admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:04.890280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cdab7-4fc8-47ad-a23f-2031b1c5c81d None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:04.890560 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cdab7-4fc8-47ad-a23f-2031b1c5c81d None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:04.891920 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3cdab7-4fc8-47ad-a23f-2031b1c5c81d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:04.893355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3cdab7-4fc8-47ad-a23f-2031b1c5c81d None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:04.900842 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aaddd2-5c36-47a8-aa5e-69edbb7f235c None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:04.936079 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029904e-4ee9-4dcc-9188-41f144a4d08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:04.936743 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029904e-4ee9-4dcc-9188-41f144a4d08b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:04.937028 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029904e-4ee9-4dcc-9188-41f144a4d08b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:04.937301 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029904e-4ee9-4dcc-9188-41f144a4d08b None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:04.938556 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029904e-4ee9-4dcc-9188-41f144a4d08b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:04.938858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029904e-4ee9-4dcc-9188-41f144a4d08b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:04.940434 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029904e-4ee9-4dcc-9188-41f144a4d08b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:04.952932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 362/745] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:04.954555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029904e-4ee9-4dcc-9188-41f144a4d08b None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:04.989129 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 384/746] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jun 2 19:03:04 2022] POST /identity/v3/services => generated 240 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:04.990229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cdab7-4fc8-47ad-a23f-2031b1c5c81d None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:05.085857 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029904e-4ee9-4dcc-9188-41f144a4d08b None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:05.140111 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beef717-db07-4f39-b702-773ea381c7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:05.141956 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beef717-db07-4f39-b702-773ea381c7fa None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:05.142071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cdab7-4fc8-47ad-a23f-2031b1c5c81d None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:05.142568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beef717-db07-4f39-b702-773ea381c7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:05.143025 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beef717-db07-4f39-b702-773ea381c7fa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:05.146841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:05.152725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beef717-db07-4f39-b702-773ea381c7fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:05.155141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beef717-db07-4f39-b702-773ea381c7fa None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:05.171972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-6beef717-db07-4f39-b702-773ea381c7fa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 19:03:05.171972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:05.171972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:05.171972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:05.171972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:05.171972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:05.171972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:05.171972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:05.171972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:05.171972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:05.171972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:05.171972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:05.171972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:03:05.171972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:03:05.171972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:03:05.171972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:03:05.173663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:05.173663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:05.173663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:03:05.173663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:05.173663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:03:05.173663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:05.173663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:05.173663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:05.173663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:05.173663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:05.173663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:05.173663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:05.173663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:05.173663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:05.173663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:05.173663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:05.173663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:05.173663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:05.174605 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:05.174605 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:05.174605 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:03:05.174605 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:03:05.174605 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:03:05.174605 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:03:05.174605 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:03:05.174605 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:03:05.174605 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 19:03:05.174605 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:05.177412 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 363/747] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Jun 2 19:03:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:05.178598 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beef717-db07-4f39-b702-773ea381c7fa None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:05.181531 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:05.190902 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5aa1eb-507b-4a7e-85d7-5d9c4d7fc429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:05.192468 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5aa1eb-507b-4a7e-85d7-5d9c4d7fc429 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:05.192872 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5aa1eb-507b-4a7e-85d7-5d9c4d7fc429 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:05.193307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5aa1eb-507b-4a7e-85d7-5d9c4d7fc429 None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:05.194315 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5aa1eb-507b-4a7e-85d7-5d9c4d7fc429 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:05.194780 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5aa1eb-507b-4a7e-85d7-5d9c4d7fc429 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:05.197699 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5aa1eb-507b-4a7e-85d7-5d9c4d7fc429 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:05.213006 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 385/748] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:05.214164 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5aa1eb-507b-4a7e-85d7-5d9c4d7fc429 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:05.297855 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beef717-db07-4f39-b702-773ea381c7fa None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:05.335987 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b690810-177e-44d5-be9e-22a3e05a94bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:05.336841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b690810-177e-44d5-be9e-22a3e05a94bd None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:05.337121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b690810-177e-44d5-be9e-22a3e05a94bd None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:05.337394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b690810-177e-44d5-be9e-22a3e05a94bd None admin] PATH_INFO: `/v3/users/swift` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:05.337654 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5aa1eb-507b-4a7e-85d7-5d9c4d7fc429 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:05.347643 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b690810-177e-44d5-be9e-22a3e05a94bd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:05.349480 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b690810-177e-44d5-be9e-22a3e05a94bd None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:05.365968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-9b690810-177e-44d5-be9e-22a3e05a94bd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 19:03:05.365968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:05.365968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:05.365968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:05.365968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:05.365968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:05.365968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:05.365968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:05.365968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:05.365968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:05.365968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:05.365968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:05.365968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:03:05.365968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:03:05.365968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:03:05.365968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:03:05.367110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:05.367110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:05.367110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:03:05.367110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:05.367110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:03:05.367110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:05.367110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:05.367110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:05.367110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:05.367110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:05.367110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:05.367110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:05.367110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:05.367110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:05.367110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:05.367110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:05.367110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:05.367110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:05.368242 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:05.368242 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:05.368242 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:03:05.368242 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:03:05.368242 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:03:05.368242 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:03:05.368242 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:03:05.368242 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:03:05.368242 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 19:03:05.368242 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:05.373994 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 364/749] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:03:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:05.373994 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b690810-177e-44d5-be9e-22a3e05a94bd None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:05.388373 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f00476-ab79-44b4-b431-7465bbdc0342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:05.389419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f00476-ab79-44b4-b431-7465bbdc0342 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:05.389859 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f00476-ab79-44b4-b431-7465bbdc0342 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:05.390390 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f00476-ab79-44b4-b431-7465bbdc0342 None admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:05.391475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f00476-ab79-44b4-b431-7465bbdc0342 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:05.391966 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f00476-ab79-44b4-b431-7465bbdc0342 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:05.393565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f00476-ab79-44b4-b431-7465bbdc0342 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:05.480804 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 386/750] 10.222.0.45 () {56 vars in 1149 bytes} [Thu Jun 2 19:03:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:05.480804 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932ef56-b6ad-4434-8161-c902e62ae713 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:05.480804 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932ef56-b6ad-4434-8161-c902e62ae713 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:05.480804 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932ef56-b6ad-4434-8161-c902e62ae713 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:05.480804 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 387/751] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:05.480804 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932ef56-b6ad-4434-8161-c902e62ae713 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:05.494471 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:05.536529 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:05.538984 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b690810-177e-44d5-be9e-22a3e05a94bd None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:05.574977 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502af45-c18b-4f75-a862-e50780801353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:05.575781 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502af45-c18b-4f75-a862-e50780801353 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:05.576090 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502af45-c18b-4f75-a862-e50780801353 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:05.576375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502af45-c18b-4f75-a862-e50780801353 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:05.584843 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502af45-c18b-4f75-a862-e50780801353 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:05.586292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502af45-c18b-4f75-a862-e50780801353 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:05.591119 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932ef56-b6ad-4434-8161-c902e62ae713 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:05.602207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-a502af45-c18b-4f75-a862-e50780801353 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:05.602207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:05.602207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:05.602207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:05.602207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:05.602207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:05.602207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:05.602207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:05.602207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:05.602207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:05.602207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:05.602207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:05.602207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:03:05.602207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:03:05.602207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:03:05.603246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:03:05.603246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:05.603246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:05.603246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:05.603246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:05.603246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:05.603246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:05.603246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:05.603246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:05.603246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:05.603246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:05.603246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:05.603246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:05.603246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:05.603246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:05.603246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:05.603246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:05.604154 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:03:05.604154 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:03:05.604154 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:03:05.604154 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:03:05.604154 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:03:05.604154 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:03:05.604154 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:05.604154 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:05.604154 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 365/752] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:03:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:05.604671 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502af45-c18b-4f75-a862-e50780801353 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:05.636024 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f61a8-113f-45eb-bbb2-237973b25691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:05.636707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f61a8-113f-45eb-bbb2-237973b25691 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:05.636987 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f61a8-113f-45eb-bbb2-237973b25691 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:05.637256 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f61a8-113f-45eb-bbb2-237973b25691 None admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:05.638093 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f61a8-113f-45eb-bbb2-237973b25691 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:05.638395 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f61a8-113f-45eb-bbb2-237973b25691 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:05.639840 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f61a8-113f-45eb-bbb2-237973b25691 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:05.662606 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 388/753] 10.222.0.45 () {56 vars in 1135 bytes} [Thu Jun 2 19:03:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:05.663816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d3309-6921-4076-911e-e6770f08b09c None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:05.664142 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d3309-6921-4076-911e-e6770f08b09c None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:05.664417 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d3309-6921-4076-911e-e6770f08b09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:05.683013 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-959d3309-6921-4076-911e-e6770f08b09c None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:05.684232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-959d3309-6921-4076-911e-e6770f08b09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:05.722922 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502af45-c18b-4f75-a862-e50780801353 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:05.742059 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:05.760046 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf09df-935a-4357-ab75-cacae044a28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:05.760699 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf09df-935a-4357-ab75-cacae044a28e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:05.760987 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf09df-935a-4357-ab75-cacae044a28e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:05.761262 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf09df-935a-4357-ab75-cacae044a28e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:05.764474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 389/754] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:03:05.769514 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d3309-6921-4076-911e-e6770f08b09c None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:05.811288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:05.843779 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf09df-935a-4357-ab75-cacae044a28e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:05.845380 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf09df-935a-4357-ab75-cacae044a28e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:05.882242 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d3309-6921-4076-911e-e6770f08b09c None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:05.921276 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2722a5-409c-4db2-a8d7-1c1763e642f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:05.922035 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2722a5-409c-4db2-a8d7-1c1763e642f9 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:05.922959 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2722a5-409c-4db2-a8d7-1c1763e642f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:05.923341 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2722a5-409c-4db2-a8d7-1c1763e642f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:05.924271 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2722a5-409c-4db2-a8d7-1c1763e642f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:05.924583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2722a5-409c-4db2-a8d7-1c1763e642f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:05.926034 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2722a5-409c-4db2-a8d7-1c1763e642f9 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:05.937813 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 390/755] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:03:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:05.938650 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2722a5-409c-4db2-a8d7-1c1763e642f9 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:05.961767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 366/756] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:03:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 19:03:05.962625 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf09df-935a-4357-ab75-cacae044a28e None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:05.983712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:06.051691 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:06.057414 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2722a5-409c-4db2-a8d7-1c1763e642f9 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:06.073463 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf09df-935a-4357-ab75-cacae044a28e None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:06.099862 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ce1ab-a17a-4cb1-8c6b-285a73c5cc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:06.100580 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ce1ab-a17a-4cb1-8c6b-285a73c5cc89 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:06.100868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ce1ab-a17a-4cb1-8c6b-285a73c5cc89 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:06.101202 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ce1ab-a17a-4cb1-8c6b-285a73c5cc89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:06.116783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5f234-36b0-4e60-afad-c665008da3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:06.117599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5f234-36b0-4e60-afad-c665008da3fd None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:06.117880 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5f234-36b0-4e60-afad-c665008da3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:06.118157 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5f234-36b0-4e60-afad-c665008da3fd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:06.118814 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5f234-36b0-4e60-afad-c665008da3fd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:06.120211 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5f234-36b0-4e60-afad-c665008da3fd None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:06.135238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-56d5f234-36b0-4e60-afad-c665008da3fd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 19:03:06.135238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:06.135238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 19:03:06.135238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 19:03:06.135238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 19:03:06.135238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 19:03:06.135238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 19:03:06.135238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:06.135238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 19:03:06.135238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:06.135238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:03:06.135238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:06.135238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:06.135238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:06.135238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:06.135238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:06.136360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:06.136360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:06.136360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:06.136360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:06.136360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:06.136360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:06.136360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:06.136360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 19:03:06.136360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 19:03:06.136360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 19:03:06.136360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 19:03:06.136360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:06.136360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:06.136360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:06.136360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:06.136360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:06.137208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:06.137208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:06.137208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:06.137208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:06.137208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:06.137208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:06.137208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:06.137208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:06.137208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:06.137208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:06.137208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:06.137208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 19:03:06.137208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:06.137208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 19:03:06.137208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:06.141939 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 367/757] 10.222.0.45 () {56 vars in 1129 bytes} [Thu Jun 2 19:03:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:06.142816 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5f234-36b0-4e60-afad-c665008da3fd None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:06.179340 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ce1ab-a17a-4cb1-8c6b-285a73c5cc89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:06.180940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ce1ab-a17a-4cb1-8c6b-285a73c5cc89 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:06.235398 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:06.257460 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5f234-36b0-4e60-afad-c665008da3fd None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:06.290732 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:06.294798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23314ae5-6251-4f09-a8ce-fd76b35bb424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:06.295754 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23314ae5-6251-4f09-a8ce-fd76b35bb424 None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:06.296145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23314ae5-6251-4f09-a8ce-fd76b35bb424 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:06.296482 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23314ae5-6251-4f09-a8ce-fd76b35bb424 None admin] PATH_INFO: `/v3/projects/b11b7e66a993492d8163097bce955c0b/users/575f61ef70314f86b5d9dad3ba1b3aab/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:06.303261 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 391/758] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:03:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 19:03:06.303466 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23314ae5-6251-4f09-a8ce-fd76b35bb424 None admin] RBAC: Authorizing `identity:create_grant(project_id=b11b7e66a993492d8163097bce955c0b, user_id=575f61ef70314f86b5d9dad3ba1b3aab, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:06.303564 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ce1ab-a17a-4cb1-8c6b-285a73c5cc89 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:06.303667 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23314ae5-6251-4f09-a8ce-fd76b35bb424 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:06.384037 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 368/759] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jun 2 19:03:06 2022] PUT /identity/v3/projects/b11b7e66a993492d8163097bce955c0b/users/575f61ef70314f86b5d9dad3ba1b3aab/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:06.384037 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23314ae5-6251-4f09-a8ce-fd76b35bb424 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:06.427971 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ce1ab-a17a-4cb1-8c6b-285a73c5cc89 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:06.480405 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95321ccd-0dcf-4098-bb22-c5c3a8c57a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:06.481464 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95321ccd-0dcf-4098-bb22-c5c3a8c57a63 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:06.481754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95321ccd-0dcf-4098-bb22-c5c3a8c57a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:06.482039 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95321ccd-0dcf-4098-bb22-c5c3a8c57a63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:06.499680 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95321ccd-0dcf-4098-bb22-c5c3a8c57a63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:06.502772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95321ccd-0dcf-4098-bb22-c5c3a8c57a63 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:06.531817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-95321ccd-0dcf-4098-bb22-c5c3a8c57a63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:06.531817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:06.531817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:06.531817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:06.531817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:06.531817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:06.531817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:06.531817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:06.531817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:06.531817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:06.531817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:06.531817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:06.531817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:06.531817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:06.531817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:06.532991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:06.532991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:06.532991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:06.532991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:06.532991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:06.532991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:06.532991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:06.532991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:06.532991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:06.532991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:06.532991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:06.532991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:06.532991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:06.532991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:06.532991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:06.532991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:06.532991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:06.534394 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:06.534394 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:06.534394 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:06.534394 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:06.534394 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 392/760] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:06.534394 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95321ccd-0dcf-4098-bb22-c5c3a8c57a63 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:06.535875 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23314ae5-6251-4f09-a8ce-fd76b35bb424 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:06.590099 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a74a50-3c1c-4808-b543-73b09de7b2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:06.591530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a74a50-3c1c-4808-b543-73b09de7b2de None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:06.591827 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a74a50-3c1c-4808-b543-73b09de7b2de None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:06.592330 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a74a50-3c1c-4808-b543-73b09de7b2de None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:06.593241 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a74a50-3c1c-4808-b543-73b09de7b2de None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:06.593557 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a74a50-3c1c-4808-b543-73b09de7b2de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:06.596535 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a74a50-3c1c-4808-b543-73b09de7b2de None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:06.599370 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:06.604473 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 369/761] 10.222.0.45 () {56 vars in 1124 bytes} [Thu Jun 2 19:03:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:06.606405 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a74a50-3c1c-4808-b543-73b09de7b2de None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:06.611689 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:06.677206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95321ccd-0dcf-4098-bb22-c5c3a8c57a63 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:06.729926 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac721c43-c3ea-431f-9092-4d5f8a9b56c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:06.731248 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac721c43-c3ea-431f-9092-4d5f8a9b56c9 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:06.731547 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac721c43-c3ea-431f-9092-4d5f8a9b56c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:06.731900 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac721c43-c3ea-431f-9092-4d5f8a9b56c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:06.747395 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac721c43-c3ea-431f-9092-4d5f8a9b56c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:06.747782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a74a50-3c1c-4808-b543-73b09de7b2de None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:06.749090 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac721c43-c3ea-431f-9092-4d5f8a9b56c9 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:06.775973 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-ac721c43-c3ea-431f-9092-4d5f8a9b56c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:06.775973 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:06.775973 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:06.775973 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:06.775973 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:06.775973 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:06.775973 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:06.775973 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:06.775973 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:06.775973 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:06.775973 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:06.775973 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:06.775973 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:06.775973 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:06.775973 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:06.777143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:06.777143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:06.777143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:06.777143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:06.777143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:06.777143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:06.777143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:06.777143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:06.777143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:06.777143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:06.777143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:06.777143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:06.777143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:06.777143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:06.777143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:06.777143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:06.777143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:06.778213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:06.778213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:06.778213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:06.778213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:06.784111 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 393/762] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:06.785136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac721c43-c3ea-431f-9092-4d5f8a9b56c9 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:06.798620 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28073f8-33f1-456b-bb63-305048caf661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:06.799311 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28073f8-33f1-456b-bb63-305048caf661 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:06.799636 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28073f8-33f1-456b-bb63-305048caf661 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:06.799918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28073f8-33f1-456b-bb63-305048caf661 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:06.800721 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28073f8-33f1-456b-bb63-305048caf661 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:06.801245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28073f8-33f1-456b-bb63-305048caf661 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:06.802689 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28073f8-33f1-456b-bb63-305048caf661 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:06.817181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 370/763] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:06.818214 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28073f8-33f1-456b-bb63-305048caf661 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:06.893662 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:06.933481 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28073f8-33f1-456b-bb63-305048caf661 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:06.933887 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:06.937953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac721c43-c3ea-431f-9092-4d5f8a9b56c9 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:06.977166 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50323842-7460-4ac8-81dd-c8a8b082c5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:06.977873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50323842-7460-4ac8-81dd-c8a8b082c5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:06.978196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50323842-7460-4ac8-81dd-c8a8b082c5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:06.978480 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50323842-7460-4ac8-81dd-c8a8b082c5a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:06.979189 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50323842-7460-4ac8-81dd-c8a8b082c5a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:06.979489 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50323842-7460-4ac8-81dd-c8a8b082c5a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:06.980920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50323842-7460-4ac8-81dd-c8a8b082c5a7 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:06.986257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edcfbb-b0ec-412b-8877-cccf3c67293c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:06.987241 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edcfbb-b0ec-412b-8877-cccf3c67293c None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:06.987721 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edcfbb-b0ec-412b-8877-cccf3c67293c None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:06.988500 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edcfbb-b0ec-412b-8877-cccf3c67293c None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:06.989113 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5edcfbb-b0ec-412b-8877-cccf3c67293c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:06.989423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5edcfbb-b0ec-412b-8877-cccf3c67293c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:06.991057 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5edcfbb-b0ec-412b-8877-cccf3c67293c None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:06.999876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 371/765] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:07.001175 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 394/765] 10.222.0.45 () {56 vars in 1124 bytes} [Thu Jun 2 19:03:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:07.001548 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50323842-7460-4ac8-81dd-c8a8b082c5a7 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:07.002204 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edcfbb-b0ec-412b-8877-cccf3c67293c None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:07.129061 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edcfbb-b0ec-412b-8877-cccf3c67293c None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:07.148095 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50323842-7460-4ac8-81dd-c8a8b082c5a7 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:07.173989 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:07.182209 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d6b99-8800-4c3f-a464-0bd2e3228274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:07.191464 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d6b99-8800-4c3f-a464-0bd2e3228274 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:07.191464 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d6b99-8800-4c3f-a464-0bd2e3228274 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:07.191464 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d6b99-8800-4c3f-a464-0bd2e3228274 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:07.191464 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d6b99-8800-4c3f-a464-0bd2e3228274 None admin] RBAC: Adding query filter params (interface=public, service_id=827b763eacc34fa8abec71a1d2dcda8b, region_id=RegionOne) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:07.191464 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d6b99-8800-4c3f-a464-0bd2e3228274 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:07.191854 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a21c48-1fee-4ca6-939c-2f1810130859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:07.191854 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a21c48-1fee-4ca6-939c-2f1810130859 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:07.192045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d6b99-8800-4c3f-a464-0bd2e3228274 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:07.192119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a21c48-1fee-4ca6-939c-2f1810130859 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:07.192119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a21c48-1fee-4ca6-939c-2f1810130859 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:07.195214 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a21c48-1fee-4ca6-939c-2f1810130859 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:07.196762 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a21c48-1fee-4ca6-939c-2f1810130859 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:07.198101 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 395/766] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Jun 2 19:03:07 2022] GET /identity/v3/endpoints?service_id=827b763eacc34fa8abec71a1d2dcda8b&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:07.199246 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d6b99-8800-4c3f-a464-0bd2e3228274 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:07.219451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-22a21c48-1fee-4ca6-939c-2f1810130859 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:07.219451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:07.219451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:07.219451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:07.219451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:07.219451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:07.219451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:07.219451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:07.219451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:07.219451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:07.219451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:07.219451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:07.219451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:03:07.219451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:03:07.219451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:03:07.220472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:03:07.220472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:07.220472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:07.220472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:07.220472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:07.220472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:07.220472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:07.220472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:07.220472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:07.220472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:07.220472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:07.220472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:07.220472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:07.220472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:07.220472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:07.220472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:07.220472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:07.221442 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:03:07.221442 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:03:07.221442 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:03:07.221442 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:03:07.221442 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:03:07.221442 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:03:07.221442 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:07.221442 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:07.221442 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 372/767] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:03:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:07.221922 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a21c48-1fee-4ca6-939c-2f1810130859 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:07.240366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:07.341860 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a21c48-1fee-4ca6-939c-2f1810130859 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:07.342398 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d6b99-8800-4c3f-a464-0bd2e3228274 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:07.380895 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4490f4-c850-4427-8783-107a3078dd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:07.381986 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4490f4-c850-4427-8783-107a3078dd0e None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:07.382249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4490f4-c850-4427-8783-107a3078dd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:07.382617 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4490f4-c850-4427-8783-107a3078dd0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:07.390584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4490f4-c850-4427-8783-107a3078dd0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:07.391704 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01074cb7-7229-423d-b459-dcac5abe26d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:07.392615 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01074cb7-7229-423d-b459-dcac5abe26d0 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:07.392910 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4490f4-c850-4427-8783-107a3078dd0e None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:07.393260 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01074cb7-7229-423d-b459-dcac5abe26d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:07.393862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01074cb7-7229-423d-b459-dcac5abe26d0 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:07.394702 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01074cb7-7229-423d-b459-dcac5abe26d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:07.397026 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01074cb7-7229-423d-b459-dcac5abe26d0 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:07.403744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 373/768] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Jun 2 19:03:07 2022] GET /identity/v3/services => generated 772 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:07.404873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01074cb7-7229-423d-b459-dcac5abe26d0 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:07.412836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-8c4490f4-c850-4427-8783-107a3078dd0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:07.412836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:07.412836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:07.412836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:07.412836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:07.412836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:07.412836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:07.412836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:07.412836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:07.412836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:07.412836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:07.412836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:07.412836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:03:07.412836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:03:07.412836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:03:07.413814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:03:07.413814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:07.413814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:07.413814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:07.413814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:07.413814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:07.413814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:07.413814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:07.413814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:07.413814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:07.413814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:07.413814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:07.413814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:07.413814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:07.413814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:07.413814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:07.413814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:07.414725 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:03:07.414725 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:03:07.414725 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:03:07.414725 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:03:07.414725 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:03:07.414725 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:03:07.414725 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:07.414725 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:07.417737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 396/769] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:03:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:07.419216 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe889d91-db16-4802-9736-8973ef9c7c36 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:07.419504 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe889d91-db16-4802-9736-8973ef9c7c36 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:07.419780 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe889d91-db16-4802-9736-8973ef9c7c36 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:07.424613 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 397/770] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:07.425855 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe889d91-db16-4802-9736-8973ef9c7c36 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:07.484337 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:07.534952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:07.549113 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe889d91-db16-4802-9736-8973ef9c7c36 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:07.568209 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01074cb7-7229-423d-b459-dcac5abe26d0 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:07.590071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d34de3-e4af-4d0c-8b66-15d8c2ce7c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:07.590915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d34de3-e4af-4d0c-8b66-15d8c2ce7c0f None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:07.591568 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d34de3-e4af-4d0c-8b66-15d8c2ce7c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:07.591949 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d34de3-e4af-4d0c-8b66-15d8c2ce7c0f None admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:07.592891 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d34de3-e4af-4d0c-8b66-15d8c2ce7c0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:07.593337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d34de3-e4af-4d0c-8b66-15d8c2ce7c0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:07.595028 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d34de3-e4af-4d0c-8b66-15d8c2ce7c0f None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:07.608694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 398/771] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:03:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:07.611392 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0863ae-0f43-4550-9495-07542866a6e0 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:07.611791 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0863ae-0f43-4550-9495-07542866a6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:07.612210 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0863ae-0f43-4550-9495-07542866a6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:07.623081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20400137-2c3c-488b-94ab-838ceff5e9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:07.623762 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20400137-2c3c-488b-94ab-838ceff5e9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:07.624087 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20400137-2c3c-488b-94ab-838ceff5e9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:07.624370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20400137-2c3c-488b-94ab-838ceff5e9c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:07.625826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20400137-2c3c-488b-94ab-838ceff5e9c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:07.626143 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20400137-2c3c-488b-94ab-838ceff5e9c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:07.627605 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20400137-2c3c-488b-94ab-838ceff5e9c1 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:07.637282 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-8a0863ae-0f43-4550-9495-07542866a6e0 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:07.638656 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-8a0863ae-0f43-4550-9495-07542866a6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:07.644614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 374/772] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:03:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:07.645508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20400137-2c3c-488b-94ab-838ceff5e9c1 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:07.725168 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 399/773] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:03:07.726384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0863ae-0f43-4550-9495-07542866a6e0 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:07.772967 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20400137-2c3c-488b-94ab-838ceff5e9c1 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:07.784699 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:07.818897 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3b786-6f5d-47ed-bdb2-d3c5e00c4412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:07.819572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3b786-6f5d-47ed-bdb2-d3c5e00c4412 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:07.819958 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3b786-6f5d-47ed-bdb2-d3c5e00c4412 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:07.820280 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3b786-6f5d-47ed-bdb2-d3c5e00c4412 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:07.821125 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3b786-6f5d-47ed-bdb2-d3c5e00c4412 None admin] RBAC: Adding query filter params (role.id=4588ca63994f4e2d9ce482d475edbabd, scope.project.id=b11b7e66a993492d8163097bce955c0b, user.id=87ba0ab9510d49c4ab4c634e82790efb) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:07.821438 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3b786-6f5d-47ed-bdb2-d3c5e00c4412 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:07.822883 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3b786-6f5d-47ed-bdb2-d3c5e00c4412 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:07.829412 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 375/774] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:03:07 2022] GET /identity/v3/role_assignments?user.id=87ba0ab9510d49c4ab4c634e82790efb&scope.project.id=b11b7e66a993492d8163097bce955c0b&role.id=4588ca63994f4e2d9ce482d475edbabd => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:07.830363 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3b786-6f5d-47ed-bdb2-d3c5e00c4412 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:07.870881 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:07.924058 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0863ae-0f43-4550-9495-07542866a6e0 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:08.012804 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efe0e3-a159-4116-a011-ebebc6b55a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:08.015174 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efe0e3-a159-4116-a011-ebebc6b55a6a None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:08.016895 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efe0e3-a159-4116-a011-ebebc6b55a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:08.017640 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efe0e3-a159-4116-a011-ebebc6b55a6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:08.019502 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efe0e3-a159-4116-a011-ebebc6b55a6a None admin] RBAC: Adding query filter params (role.id=13ff8a5ffa5648c28ec00aa75b69d913, scope.project.id=b11b7e66a993492d8163097bce955c0b, user.id=235042beafd246c5b227b3926098c8c8) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:08.020351 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efe0e3-a159-4116-a011-ebebc6b55a6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:08.024410 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efe0e3-a159-4116-a011-ebebc6b55a6a None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:08.038492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 400/775] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:03:07 2022] GET /identity/v3/role_assignments?user.id=235042beafd246c5b227b3926098c8c8&scope.project.id=b11b7e66a993492d8163097bce955c0b&role.id=13ff8a5ffa5648c28ec00aa75b69d913 => generated 259 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:08.053769 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3b786-6f5d-47ed-bdb2-d3c5e00c4412 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:08.130774 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c4ec9-f0a0-4c26-8a10-c8969ec7e8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:08.132310 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c4ec9-f0a0-4c26-8a10-c8969ec7e8ba None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:08.132875 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c4ec9-f0a0-4c26-8a10-c8969ec7e8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:08.133441 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c4ec9-f0a0-4c26-8a10-c8969ec7e8ba None admin] PATH_INFO: `/v3/services/network` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:08.134755 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c4ec9-f0a0-4c26-8a10-c8969ec7e8ba None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:08.137536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c4ec9-f0a0-4c26-8a10-c8969ec7e8ba None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:08.163076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-e28c4ec9-f0a0-4c26-8a10-c8969ec7e8ba None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 19:03:08.163076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:08.163076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 19:03:08.163076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 19:03:08.163076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 19:03:08.163076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 19:03:08.163076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 19:03:08.163076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:08.163076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 19:03:08.163076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:08.163076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:03:08.163076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:08.163076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:08.163076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:08.163076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:08.163076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:08.163076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:08.164341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:08.164341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:08.164341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:08.164341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:08.164341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:08.164341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:08.164341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 19:03:08.164341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 19:03:08.164341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 19:03:08.164341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 19:03:08.164341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:08.164341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:08.164341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:08.164341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:08.164341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:08.164341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:08.165360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:08.165360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:08.165360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:08.165360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:08.165360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:08.165360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:08.165360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:08.165360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:08.165360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:08.165360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:08.165360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 19:03:08.165360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:08.165360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 19:03:08.165360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:08.168652 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 376/776] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:03:07 2022] GET /identity/v3/services/network => generated 88 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:08.175115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efe0e3-a159-4116-a011-ebebc6b55a6a None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:08.318877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efe0e3-a159-4116-a011-ebebc6b55a6a None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:08.356668 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e098d0-0841-4796-9eaa-9b6bf38a34b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:08.357392 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e098d0-0841-4796-9eaa-9b6bf38a34b1 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:08.357674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e098d0-0841-4796-9eaa-9b6bf38a34b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:08.357949 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e098d0-0841-4796-9eaa-9b6bf38a34b1 None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:08.358692 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e098d0-0841-4796-9eaa-9b6bf38a34b1 None admin] RBAC: Adding query filter params (name=network) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:08.358996 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e098d0-0841-4796-9eaa-9b6bf38a34b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:08.360437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e098d0-0841-4796-9eaa-9b6bf38a34b1 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:08.365708 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 401/777] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Jun 2 19:03:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:08.371001 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c4ec9-f0a0-4c26-8a10-c8969ec7e8ba None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:08.445214 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:08.541737 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c4ec9-f0a0-4c26-8a10-c8969ec7e8ba None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:08.587667 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00fc13-b258-4329-899b-1ab6e3f2368c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:08.588380 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00fc13-b258-4329-899b-1ab6e3f2368c None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:08.588669 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00fc13-b258-4329-899b-1ab6e3f2368c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:08.588949 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00fc13-b258-4329-899b-1ab6e3f2368c None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:08.589667 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00fc13-b258-4329-899b-1ab6e3f2368c None admin] RBAC: Adding query filter params (type=network) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:08.589974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00fc13-b258-4329-899b-1ab6e3f2368c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:08.591628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00fc13-b258-4329-899b-1ab6e3f2368c None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:08.598886 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 377/778] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Jun 2 19:03:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:08.604635 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e098d0-0841-4796-9eaa-9b6bf38a34b1 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:08.614225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:08.734337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e098d0-0841-4796-9eaa-9b6bf38a34b1 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:08.793220 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c4561-8eea-47dd-833e-44357f261764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:08.796027 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c4561-8eea-47dd-833e-44357f261764 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:08.796027 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c4561-8eea-47dd-833e-44357f261764 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:08.796027 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c4561-8eea-47dd-833e-44357f261764 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:08.796027 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c4561-8eea-47dd-833e-44357f261764 None admin] RBAC: Adding query filter params (interface=public, service_id=2cb6a3b23781407d87c47d95144cb054, region_id=RegionOne) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:08.796027 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c4561-8eea-47dd-833e-44357f261764 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:08.797828 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c4561-8eea-47dd-833e-44357f261764 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:08.808563 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 402/779] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Jun 2 19:03:08 2022] GET /identity/v3/endpoints?service_id=2cb6a3b23781407d87c47d95144cb054&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:08.814643 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00fc13-b258-4329-899b-1ab6e3f2368c None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:08.935751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:08.944325 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00fc13-b258-4329-899b-1ab6e3f2368c None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:08.992752 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6b6b7-678d-4565-aaa8-a95aa40eb449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:08.993368 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6b6b7-678d-4565-aaa8-a95aa40eb449 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:08.993654 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6b6b7-678d-4565-aaa8-a95aa40eb449 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:08.993931 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6b6b7-678d-4565-aaa8-a95aa40eb449 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:08.994665 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6b6b7-678d-4565-aaa8-a95aa40eb449 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:08.996193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6b6b7-678d-4565-aaa8-a95aa40eb449 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:09.003446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 378/780] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Jun 2 19:03:08 2022] GET /identity/v3/services => generated 772 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:09.058584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483f69e-8b68-42bc-8398-212e6e308f7b None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:09.058889 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483f69e-8b68-42bc-8398-212e6e308f7b None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:09.059152 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483f69e-8b68-42bc-8398-212e6e308f7b None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:09.061000 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 403/781] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:09.067946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134dd5c-6654-4bf7-af18-258c10657c70 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:09.068268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134dd5c-6654-4bf7-af18-258c10657c70 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:09.068551 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134dd5c-6654-4bf7-af18-258c10657c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:09.091796 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-4134dd5c-6654-4bf7-af18-258c10657c70 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:09.093074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4134dd5c-6654-4bf7-af18-258c10657c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:09.198765 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 379/782] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:03:09.238427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483f69e-8b68-42bc-8398-212e6e308f7b None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:09.456825 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:09.492695 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483f69e-8b68-42bc-8398-212e6e308f7b None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:09.538730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65765f18-7f16-47e6-a22d-d791cadc4a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:09.539616 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65765f18-7f16-47e6-a22d-d791cadc4a12 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:09.539897 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65765f18-7f16-47e6-a22d-d791cadc4a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:09.540195 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65765f18-7f16-47e6-a22d-d791cadc4a12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:09.558079 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65765f18-7f16-47e6-a22d-d791cadc4a12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:03:09.566068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-65765f18-7f16-47e6-a22d-d791cadc4a12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:03:09.566068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:09.566068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:09.566068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:09.566068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:09.566068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:09.566068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:09.566068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:09.566068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:09.566068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:09.566068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:09.566068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:09.566068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:03:09.566068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:03:09.566068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:03:09.566068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:03:09.567018 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:03:09.567018 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:03:09.567018 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:03:09.567018 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:03:09.567018 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:09.567018 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:09.567018 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:09.567018 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:09.567018 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:09.567018 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:09.567018 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:09.567018 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:09.567018 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:09.567018 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:09.567018 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:09.567018 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:09.568232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:09.568232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:09.568232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:09.568232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:09.568232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:03:09.568232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:03:09.568232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:03:09.568232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:03:09.568232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:03:09.568232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:03:09.568232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:03:09.568232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:09.568232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 404/783] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:03:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:09.575100 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134dd5c-6654-4bf7-af18-258c10657c70 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:09.738023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:09.751532 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134dd5c-6654-4bf7-af18-258c10657c70 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:09.805987 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f7cf5-8dd3-42fe-a713-38927d6f56eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:09.807001 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f7cf5-8dd3-42fe-a713-38927d6f56eb None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:09.807511 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f7cf5-8dd3-42fe-a713-38927d6f56eb None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:09.807976 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f7cf5-8dd3-42fe-a713-38927d6f56eb None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:09.809001 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f7cf5-8dd3-42fe-a713-38927d6f56eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:09.809500 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f7cf5-8dd3-42fe-a713-38927d6f56eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:09.811066 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f7cf5-8dd3-42fe-a713-38927d6f56eb None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:09.825733 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 380/784] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:03:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:09.831565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65765f18-7f16-47e6-a22d-d791cadc4a12 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:09.990444 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65765f18-7f16-47e6-a22d-d791cadc4a12 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:10.033583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:10.042878 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30ff75-1a97-4adc-aff7-90e7b690c260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:10.048977 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30ff75-1a97-4adc-aff7-90e7b690c260 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:10.048977 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30ff75-1a97-4adc-aff7-90e7b690c260 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:10.048977 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30ff75-1a97-4adc-aff7-90e7b690c260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:10.055236 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30ff75-1a97-4adc-aff7-90e7b690c260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:10.056779 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30ff75-1a97-4adc-aff7-90e7b690c260 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:10.076789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-5e30ff75-1a97-4adc-aff7-90e7b690c260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:10.076789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:10.076789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:10.076789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:10.076789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:10.076789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:10.076789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:10.076789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:10.076789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:10.076789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:10.076789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:10.076789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:10.076789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:10.076789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:10.076789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:10.077746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:10.077746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:10.077746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:10.077746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:10.077746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:10.077746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:10.077746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:10.077746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:10.077746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:10.077746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:10.077746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:10.077746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:10.077746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:10.077746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:10.077746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:10.077746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:10.077746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:10.079842 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:10.079842 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:10.079842 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:10.079842 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:10.079842 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 405/785] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:10.084109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f7cf5-8dd3-42fe-a713-38927d6f56eb None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:10.239675 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f7cf5-8dd3-42fe-a713-38927d6f56eb None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:10.293896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bedf48-4fcc-4e20-aee3-cbc80dde3428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:10.294503 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bedf48-4fcc-4e20-aee3-cbc80dde3428 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:10.294791 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bedf48-4fcc-4e20-aee3-cbc80dde3428 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:10.295061 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bedf48-4fcc-4e20-aee3-cbc80dde3428 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:10.295802 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bedf48-4fcc-4e20-aee3-cbc80dde3428 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:10.296218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bedf48-4fcc-4e20-aee3-cbc80dde3428 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:10.298219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bedf48-4fcc-4e20-aee3-cbc80dde3428 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:10.319878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 381/786] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:10.325202 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30ff75-1a97-4adc-aff7-90e7b690c260 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:10.490891 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30ff75-1a97-4adc-aff7-90e7b690c260 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:10.536402 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83bc5e-1130-4f93-8506-2193cd2769e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:10.537213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83bc5e-1130-4f93-8506-2193cd2769e8 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:10.537499 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83bc5e-1130-4f93-8506-2193cd2769e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:10.537776 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83bc5e-1130-4f93-8506-2193cd2769e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:10.551095 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83bc5e-1130-4f93-8506-2193cd2769e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:10.552642 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83bc5e-1130-4f93-8506-2193cd2769e8 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:10.568237 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-3c83bc5e-1130-4f93-8506-2193cd2769e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 19:03:10.568237 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:10.568237 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:10.568237 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:10.568237 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:10.568237 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:10.568237 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:10.568237 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:10.568237 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:10.568237 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:10.568237 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:10.568237 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:10.568237 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:03:10.568237 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:03:10.568237 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:03:10.568237 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:03:10.569319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:10.569319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:10.569319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:03:10.569319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:10.569319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:03:10.569319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:10.569319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:10.569319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:10.569319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:10.569319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:10.569319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:10.569319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:10.569319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:10.569319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:10.569319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:10.569319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:10.569319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:10.569319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:10.570876 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:10.570876 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:10.570876 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:03:10.570876 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:03:10.570876 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:03:10.570876 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:03:10.570876 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:03:10.570876 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:03:10.570876 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 19:03:10.570876 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:10.570876 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 406/787] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Jun 2 19:03:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:10.575113 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bedf48-4fcc-4e20-aee3-cbc80dde3428 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:10.605427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b4cad-6a31-496f-ac54-3e7b880acdfb None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:10.605752 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b4cad-6a31-496f-ac54-3e7b880acdfb None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:10.605988 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b4cad-6a31-496f-ac54-3e7b880acdfb None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:10.607728 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:10.607958 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 407/788] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:10.614892 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06883c-bd3f-44b5-878a-63ee4cfe449a None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:10.615179 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06883c-bd3f-44b5-878a-63ee4cfe449a None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:10.615461 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06883c-bd3f-44b5-878a-63ee4cfe449a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:10.641414 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-2f06883c-bd3f-44b5-878a-63ee4cfe449a None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:10.642959 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-2f06883c-bd3f-44b5-878a-63ee4cfe449a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:10.720396 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:10.763175 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bedf48-4fcc-4e20-aee3-cbc80dde3428 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:10.776783 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 408/789] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:03:10.784189 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09168941-0d1a-4e59-a150-f02c36c01bbb None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:10.784189 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09168941-0d1a-4e59-a150-f02c36c01bbb None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:10.784189 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09168941-0d1a-4e59-a150-f02c36c01bbb None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:10.784189 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 409/790] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:10.790442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692be97d-21e7-4999-9a1e-f3666a91895a None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:10.790725 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692be97d-21e7-4999-9a1e-f3666a91895a None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:10.791002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692be97d-21e7-4999-9a1e-f3666a91895a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:10.818751 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-692be97d-21e7-4999-9a1e-f3666a91895a None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:10.820096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-692be97d-21e7-4999-9a1e-f3666a91895a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:10.821723 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3f865-d478-4e2b-98d5-7e8e9e9192d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:10.822749 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3f865-d478-4e2b-98d5-7e8e9e9192d3 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:10.823424 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3f865-d478-4e2b-98d5-7e8e9e9192d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:10.823951 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3f865-d478-4e2b-98d5-7e8e9e9192d3 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:10.825075 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3f865-d478-4e2b-98d5-7e8e9e9192d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:10.825584 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3f865-d478-4e2b-98d5-7e8e9e9192d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:10.827272 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3f865-d478-4e2b-98d5-7e8e9e9192d3 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:10.848585 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 382/791] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Jun 2 19:03:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:10.849960 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3f865-d478-4e2b-98d5-7e8e9e9192d3 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:10.894445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 410/792] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:03:10.895014 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692be97d-21e7-4999-9a1e-f3666a91895a None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:10.933876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:10.966888 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3f865-d478-4e2b-98d5-7e8e9e9192d3 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:11.013018 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dbf95-7571-4dc0-b92a-12757c80aec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:11.014035 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dbf95-7571-4dc0-b92a-12757c80aec8 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:11.014411 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dbf95-7571-4dc0-b92a-12757c80aec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:11.015111 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dbf95-7571-4dc0-b92a-12757c80aec8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:11.016364 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dbf95-7571-4dc0-b92a-12757c80aec8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:11.018552 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dbf95-7571-4dc0-b92a-12757c80aec8 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:11.037010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-0a1dbf95-7571-4dc0-b92a-12757c80aec8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 19:03:11.037010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:11.037010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 19:03:11.037010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 19:03:11.037010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 19:03:11.037010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 19:03:11.037010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 19:03:11.037010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:11.037010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 19:03:11.037010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:11.037010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:03:11.037010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:11.037010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:11.037010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:11.037010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:11.037010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:11.038011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:11.038011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:11.038011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:11.038011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:11.038011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:11.038011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:11.038011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:11.038011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 19:03:11.038011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 19:03:11.038011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 19:03:11.038011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 19:03:11.038011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:11.038011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:11.038011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:11.038011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:11.038011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:11.038841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:11.038841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:11.038841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:11.038841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:11.038841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:11.038841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:11.038841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:11.038841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:11.038841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:11.038841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:11.038841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:11.038841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 19:03:11.038841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:11.038841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 19:03:11.038841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:11.040162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 383/793] 10.222.0.45 () {56 vars in 1129 bytes} [Thu Jun 2 19:03:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:11.041404 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dbf95-7571-4dc0-b92a-12757c80aec8 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:11.050056 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692be97d-21e7-4999-9a1e-f3666a91895a None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:11.051964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:11.090453 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87687763-9c7d-4137-8ab6-66521c4f3e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:11.091470 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87687763-9c7d-4137-8ab6-66521c4f3e45 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:11.091818 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87687763-9c7d-4137-8ab6-66521c4f3e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:11.092246 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87687763-9c7d-4137-8ab6-66521c4f3e45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:11.158423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dbf95-7571-4dc0-b92a-12757c80aec8 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:11.165767 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87687763-9c7d-4137-8ab6-66521c4f3e45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:11.167269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87687763-9c7d-4137-8ab6-66521c4f3e45 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:11.198646 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63567d60-7391-4289-b7ae-eef5c43215cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:11.199442 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63567d60-7391-4289-b7ae-eef5c43215cd None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:11.199723 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63567d60-7391-4289-b7ae-eef5c43215cd None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:11.200203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63567d60-7391-4289-b7ae-eef5c43215cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:11.208258 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:11.212873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63567d60-7391-4289-b7ae-eef5c43215cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:03:11.220902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-63567d60-7391-4289-b7ae-eef5c43215cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:03:11.220902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:11.220902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:11.220902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:11.220902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:11.220902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:11.220902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:11.220902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:11.220902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:11.220902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:11.220902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:11.220902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:11.220902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:03:11.220902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:03:11.220902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:03:11.220902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:03:11.233248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:03:11.233248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:03:11.233248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:03:11.233248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:03:11.233248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:11.233248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:11.233248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:11.233248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:11.233248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:11.233248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:11.233248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:11.233248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:11.233248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:11.233248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:11.233248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:11.233248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:11.234094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:11.234094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:11.234094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:11.234094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:11.234094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:03:11.234094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:03:11.234094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:03:11.234094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:03:11.234094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:03:11.234094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:03:11.234094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:03:11.234094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:11.234094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 384/794] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:03:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:11.234094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63567d60-7391-4289-b7ae-eef5c43215cd None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:11.284962 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 411/795] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:03:10 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 19:03:11.286053 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cbd29-c3f8-44cf-99e8-61c31b914220 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:11.286330 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cbd29-c3f8-44cf-99e8-61c31b914220 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:11.286598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cbd29-c3f8-44cf-99e8-61c31b914220 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:11.292245 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 412/796] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:11.292245 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cbd29-c3f8-44cf-99e8-61c31b914220 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:11.295525 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:11.349200 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63567d60-7391-4289-b7ae-eef5c43215cd None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:11.385528 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3afc9-f2aa-4058-a994-75279c2b2898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:11.386355 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3afc9-f2aa-4058-a994-75279c2b2898 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:11.386640 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3afc9-f2aa-4058-a994-75279c2b2898 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:11.386964 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3afc9-f2aa-4058-a994-75279c2b2898 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:11.387677 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3afc9-f2aa-4058-a994-75279c2b2898 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:11.387980 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3afc9-f2aa-4058-a994-75279c2b2898 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:11.389449 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3afc9-f2aa-4058-a994-75279c2b2898 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:11.394887 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 385/797] 10.222.0.45 () {56 vars in 1124 bytes} [Thu Jun 2 19:03:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:11.395680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3afc9-f2aa-4058-a994-75279c2b2898 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:11.410028 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cbd29-c3f8-44cf-99e8-61c31b914220 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:11.446363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72932b21-1e7e-4493-9c16-ca35590efd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:11.447035 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72932b21-1e7e-4493-9c16-ca35590efd34 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:11.447314 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72932b21-1e7e-4493-9c16-ca35590efd34 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:11.447597 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72932b21-1e7e-4493-9c16-ca35590efd34 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:11.448407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72932b21-1e7e-4493-9c16-ca35590efd34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:11.448710 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72932b21-1e7e-4493-9c16-ca35590efd34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:11.450094 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72932b21-1e7e-4493-9c16-ca35590efd34 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:11.459678 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 413/798] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:03:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:11.460968 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15f8fd-3c2c-4828-8343-eb17187bab3c None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:11.461250 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15f8fd-3c2c-4828-8343-eb17187bab3c None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:11.461523 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15f8fd-3c2c-4828-8343-eb17187bab3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:11.471370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:11.478524 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-ca15f8fd-3c2c-4828-8343-eb17187bab3c None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:11.479704 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-ca15f8fd-3c2c-4828-8343-eb17187bab3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:11.514836 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3afc9-f2aa-4058-a994-75279c2b2898 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:11.542973 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:11.553136 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2091a-443c-42fe-ba89-474e80ff8684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:11.553957 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2091a-443c-42fe-ba89-474e80ff8684 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:11.554324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2091a-443c-42fe-ba89-474e80ff8684 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:11.554601 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2091a-443c-42fe-ba89-474e80ff8684 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:11.558881 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 414/799] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:03:11.559988 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15f8fd-3c2c-4828-8343-eb17187bab3c None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:11.566188 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2091a-443c-42fe-ba89-474e80ff8684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:11.567653 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2091a-443c-42fe-ba89-474e80ff8684 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:11.587109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-5da2091a-443c-42fe-ba89-474e80ff8684 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:11.587109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:11.587109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:11.587109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:11.587109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:11.587109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:11.587109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:11.587109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:11.587109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:11.587109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:11.587109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:11.587109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:11.587109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:11.587109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:11.587109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:11.588690 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:11.588690 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:11.588690 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:11.588690 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:11.588690 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:11.588690 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:11.588690 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:11.588690 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:11.588690 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:11.588690 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:11.588690 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:11.588690 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:11.588690 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:11.588690 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:11.588690 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:11.588690 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:11.588690 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:11.589783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:11.589783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:11.589783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:11.589783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:11.592931 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 386/800] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:11.594407 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2091a-443c-42fe-ba89-474e80ff8684 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:11.684610 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15f8fd-3c2c-4828-8343-eb17187bab3c None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:11.720189 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2091a-443c-42fe-ba89-474e80ff8684 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:11.725801 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f80c7-9cff-40f9-8839-3587fb4f320a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:11.726471 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f80c7-9cff-40f9-8839-3587fb4f320a None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:11.726747 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f80c7-9cff-40f9-8839-3587fb4f320a None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:11.727016 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f80c7-9cff-40f9-8839-3587fb4f320a None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:11.727713 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f80c7-9cff-40f9-8839-3587fb4f320a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:11.728483 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f80c7-9cff-40f9-8839-3587fb4f320a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:11.730202 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f80c7-9cff-40f9-8839-3587fb4f320a None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:11.735413 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:11.737148 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 415/801] 10.222.0.45 () {56 vars in 1124 bytes} [Thu Jun 2 19:03:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:11.741673 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f80c7-9cff-40f9-8839-3587fb4f320a None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:11.761667 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b2a04-dd88-4c1f-bd2a-ecb894146598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:11.762454 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b2a04-dd88-4c1f-bd2a-ecb894146598 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:11.762735 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b2a04-dd88-4c1f-bd2a-ecb894146598 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:11.763114 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b2a04-dd88-4c1f-bd2a-ecb894146598 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:11.775471 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b2a04-dd88-4c1f-bd2a-ecb894146598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:11.776957 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b2a04-dd88-4c1f-bd2a-ecb894146598 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:11.797923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-6c3b2a04-dd88-4c1f-bd2a-ecb894146598 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:11.797923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:11.797923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:11.797923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:11.797923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:11.797923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:11.797923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:11.797923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:11.797923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:11.797923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:11.797923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:11.797923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:11.797923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:11.797923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:11.797923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:11.799012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:11.799012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:11.799012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:11.799012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:11.799012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:11.799012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:11.799012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:11.799012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:11.799012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:11.799012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:11.799012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:11.799012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:11.799012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:11.799012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:11.799012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:11.799012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:11.799012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:11.799922 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:11.799922 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:11.799922 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:11.799922 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:11.799922 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 387/802] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:11.800225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b2a04-dd88-4c1f-bd2a-ecb894146598 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:11.809897 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:11.856906 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f80c7-9cff-40f9-8839-3587fb4f320a None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:11.898939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4817c-c468-47a3-8c6b-a4c4bce153a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:11.899766 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4817c-c468-47a3-8c6b-a4c4bce153a4 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:11.900084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4817c-c468-47a3-8c6b-a4c4bce153a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:11.900344 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4817c-c468-47a3-8c6b-a4c4bce153a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:11.912525 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4817c-c468-47a3-8c6b-a4c4bce153a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:03:11.917225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b2a04-dd88-4c1f-bd2a-ecb894146598 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:11.920324 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-90f4817c-c468-47a3-8c6b-a4c4bce153a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:03:11.920324 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:11.920324 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:11.920324 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:11.920324 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:11.920324 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:11.920324 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:11.920324 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:11.920324 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:11.920324 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:11.920324 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:11.920324 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:11.920324 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:03:11.920324 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:03:11.920324 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:03:11.920324 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:03:11.921254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:03:11.921254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:03:11.921254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:03:11.921254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:03:11.921254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:11.921254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:11.921254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:11.921254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:11.921254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:11.921254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:11.921254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:11.921254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:11.921254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:11.921254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:11.921254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:11.921254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:11.928433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:11.928433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:11.928433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:11.928433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:11.928433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:03:11.928433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:03:11.928433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:03:11.928433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:03:11.928433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:03:11.928433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:03:11.928433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:03:11.928433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:11.928433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 416/803] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jun 2 19:03:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:11.928433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4817c-c468-47a3-8c6b-a4c4bce153a4 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:11.958592 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bef47e-8ad4-4477-836d-9ad1459b0fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:11.959185 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bef47e-8ad4-4477-836d-9ad1459b0fae None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:11.959474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bef47e-8ad4-4477-836d-9ad1459b0fae None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:11.959741 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bef47e-8ad4-4477-836d-9ad1459b0fae None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:11.960502 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bef47e-8ad4-4477-836d-9ad1459b0fae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:11.960803 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bef47e-8ad4-4477-836d-9ad1459b0fae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:11.962174 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bef47e-8ad4-4477-836d-9ad1459b0fae None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:11.976500 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 388/804] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:11.976500 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bef47e-8ad4-4477-836d-9ad1459b0fae None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:12.004012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:12.035054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4817c-c468-47a3-8c6b-a4c4bce153a4 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:12.052665 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:12.070018 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b60c5-ab0f-46f3-b484-4b8e8e66ddb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:12.070776 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b60c5-ab0f-46f3-b484-4b8e8e66ddb9 None admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:12.071063 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b60c5-ab0f-46f3-b484-4b8e8e66ddb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:12.071343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b60c5-ab0f-46f3-b484-4b8e8e66ddb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:12.072214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b60c5-ab0f-46f3-b484-4b8e8e66ddb9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:12.073625 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b60c5-ab0f-46f3-b484-4b8e8e66ddb9 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:12.082565 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bef47e-8ad4-4477-836d-9ad1459b0fae None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:12.116797 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c100f-44b4-437e-8b56-66ea72f3874e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:12.117480 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c100f-44b4-437e-8b56-66ea72f3874e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:12.117758 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c100f-44b4-437e-8b56-66ea72f3874e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:12.118032 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c100f-44b4-437e-8b56-66ea72f3874e None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:12.118750 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c100f-44b4-437e-8b56-66ea72f3874e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:12.119079 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c100f-44b4-437e-8b56-66ea72f3874e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:12.120449 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c100f-44b4-437e-8b56-66ea72f3874e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:12.133053 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 389/805] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:12.135094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c100f-44b4-437e-8b56-66ea72f3874e None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:12.153041 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 417/806] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Jun 2 19:03:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:12.154727 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b92b96-50cf-43cd-b8a1-05c8b7ec0a58 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:12.162565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b92b96-50cf-43cd-b8a1-05c8b7ec0a58 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:12.162565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b92b96-50cf-43cd-b8a1-05c8b7ec0a58 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:12.162565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 418/807] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:12.162565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b92b96-50cf-43cd-b8a1-05c8b7ec0a58 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:12.248136 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:12.266511 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c100f-44b4-437e-8b56-66ea72f3874e None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:12.284802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b92b96-50cf-43cd-b8a1-05c8b7ec0a58 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:12.308357 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e511f-4fd6-4ee0-b795-f7dae57d0a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:12.309653 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e511f-4fd6-4ee0-b795-f7dae57d0a3e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:12.310033 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e511f-4fd6-4ee0-b795-f7dae57d0a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:12.310296 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e511f-4fd6-4ee0-b795-f7dae57d0a3e None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:12.311082 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e511f-4fd6-4ee0-b795-f7dae57d0a3e None admin] RBAC: Adding query filter params (name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:12.311393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e511f-4fd6-4ee0-b795-f7dae57d0a3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:12.313602 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e511f-4fd6-4ee0-b795-f7dae57d0a3e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:12.321347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420eccb5-cc4d-4949-9841-f081e8899624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:12.322167 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420eccb5-cc4d-4949-9841-f081e8899624 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:12.322449 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420eccb5-cc4d-4949-9841-f081e8899624 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:12.322727 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420eccb5-cc4d-4949-9841-f081e8899624 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:12.328007 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 390/808] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jun 2 19:03:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:12.328007 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e511f-4fd6-4ee0-b795-f7dae57d0a3e None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:12.335597 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420eccb5-cc4d-4949-9841-f081e8899624 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:12.337125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420eccb5-cc4d-4949-9841-f081e8899624 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:12.353272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-420eccb5-cc4d-4949-9841-f081e8899624 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:12.353272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:12.353272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:12.353272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:12.353272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:12.353272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:12.353272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:12.353272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:12.353272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:12.353272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:12.353272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:12.353272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:12.353272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:03:12.353272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:03:12.353272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:03:12.354408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:03:12.354408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:12.354408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:12.354408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:12.354408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:12.354408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:12.354408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:12.354408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:12.354408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:12.354408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:12.354408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:12.354408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:12.354408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:12.354408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:12.354408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:12.354408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:12.354408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:12.355321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:03:12.355321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:03:12.355321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:03:12.355321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:03:12.355321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:03:12.355321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:03:12.355321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:12.355321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:12.355321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 419/809] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:03:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:12.355808 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea70ee5-6dc5-491e-babb-f57e85b1271d None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:12.356264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea70ee5-6dc5-491e-babb-f57e85b1271d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:12.356264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea70ee5-6dc5-491e-babb-f57e85b1271d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:12.377027 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-5ea70ee5-6dc5-491e-babb-f57e85b1271d None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:12.378222 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5ea70ee5-6dc5-491e-babb-f57e85b1271d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:12.411400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:12.448752 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e511f-4fd6-4ee0-b795-f7dae57d0a3e None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:12.464558 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 420/810] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:03:12.465350 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea70ee5-6dc5-491e-babb-f57e85b1271d None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:12.498809 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cd125-b146-4e74-9f11-d7de7325b032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:12.499909 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cd125-b146-4e74-9f11-d7de7325b032 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:12.501149 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cd125-b146-4e74-9f11-d7de7325b032 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:12.501431 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cd125-b146-4e74-9f11-d7de7325b032 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:12.511696 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cd125-b146-4e74-9f11-d7de7325b032 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:12.513206 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cd125-b146-4e74-9f11-d7de7325b032 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:12.529706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-b85cd125-b146-4e74-9f11-d7de7325b032 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 19:03:12.529706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:12.529706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:12.529706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:12.529706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:12.529706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:12.529706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:12.529706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:12.529706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:12.529706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:12.529706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:12.529706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:12.529706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:03:12.529706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:03:12.529706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:03:12.529706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:03:12.530711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:12.530711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:12.530711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:03:12.530711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:12.530711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:03:12.530711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:12.530711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:12.530711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:12.530711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:12.530711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:12.530711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:12.530711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:12.530711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:12.530711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:12.530711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:12.530711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:12.530711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:12.530711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:12.531876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:12.531876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:12.531876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:03:12.531876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:03:12.531876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:03:12.531876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:03:12.531876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:03:12.531876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:03:12.531876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 19:03:12.531876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:12.531876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 391/811] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:03:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:12.533346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cd125-b146-4e74-9f11-d7de7325b032 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:12.545218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:12.580339 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea70ee5-6dc5-491e-babb-f57e85b1271d None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:12.622278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74866989-94f0-4456-ae63-967f9a001e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:12.623220 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74866989-94f0-4456-ae63-967f9a001e2a None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:12.623501 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74866989-94f0-4456-ae63-967f9a001e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:12.623797 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74866989-94f0-4456-ae63-967f9a001e2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:12.635491 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74866989-94f0-4456-ae63-967f9a001e2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:12.637047 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74866989-94f0-4456-ae63-967f9a001e2a None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:12.648142 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cd125-b146-4e74-9f11-d7de7325b032 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:12.656132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-74866989-94f0-4456-ae63-967f9a001e2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:12.656132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:12.656132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:12.656132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:12.656132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:12.656132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:12.656132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:12.656132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:12.656132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:12.656132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:12.656132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:12.656132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:12.656132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:12.656132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:12.656132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:12.657790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:12.657790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:12.657790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:12.657790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:12.657790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:12.657790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:12.657790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:12.657790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:12.657790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:12.657790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:12.657790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:12.657790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:12.657790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:12.657790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:12.657790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:12.657790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:12.657790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:12.658819 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:12.658819 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:12.658819 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:12.658819 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:12.658819 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 421/812] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:12.659209 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74866989-94f0-4456-ae63-967f9a001e2a None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:12.675146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:12.691847 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d366b57-6931-4c23-a438-116deda7b471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:12.694794 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d366b57-6931-4c23-a438-116deda7b471 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:12.694794 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d366b57-6931-4c23-a438-116deda7b471 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:12.694794 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d366b57-6931-4c23-a438-116deda7b471 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:12.694794 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d366b57-6931-4c23-a438-116deda7b471 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:12.694794 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d366b57-6931-4c23-a438-116deda7b471 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:12.695626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d366b57-6931-4c23-a438-116deda7b471 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:12.711963 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 392/813] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:03:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:12.712846 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d366b57-6931-4c23-a438-116deda7b471 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:12.774486 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74866989-94f0-4456-ae63-967f9a001e2a None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:12.790901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:12.821029 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53427029-2c03-42dc-bd20-1adcbeef26a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:12.821879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53427029-2c03-42dc-bd20-1adcbeef26a8 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:12.822163 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53427029-2c03-42dc-bd20-1adcbeef26a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:12.822436 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53427029-2c03-42dc-bd20-1adcbeef26a8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:12.823096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53427029-2c03-42dc-bd20-1adcbeef26a8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:12.824519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53427029-2c03-42dc-bd20-1adcbeef26a8 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:12.836856 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d366b57-6931-4c23-a438-116deda7b471 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:12.837030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-53427029-2c03-42dc-bd20-1adcbeef26a8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 19:03:12.837030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:12.837030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 19:03:12.837030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 19:03:12.837030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 19:03:12.837030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 19:03:12.837030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 19:03:12.837030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:12.837030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 19:03:12.837030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:12.837030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:03:12.837030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:12.837030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:12.837030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:12.837030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:12.837030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:12.837030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:12.838166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:12.838166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:12.838166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:12.838166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:12.838166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:12.838166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:12.838166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 19:03:12.838166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 19:03:12.838166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 19:03:12.838166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 19:03:12.838166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:12.838166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:12.838166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:12.838166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:12.838166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:12.838166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:12.839033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:12.839033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:12.839033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:12.839033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:12.839033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:12.839033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:12.839033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:12.839033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:12.839033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:12.839033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:12.839033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 19:03:12.839033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:12.839033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 19:03:12.839033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:12.839033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 422/814] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:03:12 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:12.839839 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53427029-2c03-42dc-bd20-1adcbeef26a8 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:12.880394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7f9be-957d-4494-a713-eda598e32234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:12.881234 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7f9be-957d-4494-a713-eda598e32234 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:12.881609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7f9be-957d-4494-a713-eda598e32234 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:12.881981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7f9be-957d-4494-a713-eda598e32234 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:12.882942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7f9be-957d-4494-a713-eda598e32234 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:12.883376 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7f9be-957d-4494-a713-eda598e32234 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:12.884970 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7f9be-957d-4494-a713-eda598e32234 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:12.904564 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 393/815] 10.222.0.45 () {56 vars in 1135 bytes} [Thu Jun 2 19:03:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:12.905383 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7f9be-957d-4494-a713-eda598e32234 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:12.928837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:12.953604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53427029-2c03-42dc-bd20-1adcbeef26a8 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:12.988979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f9c36-f4a9-481e-9887-f4a0a711c327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:12.989791 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f9c36-f4a9-481e-9887-f4a0a711c327 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:12.990176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f9c36-f4a9-481e-9887-f4a0a711c327 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:12.990661 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f9c36-f4a9-481e-9887-f4a0a711c327 None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:12.991458 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f9c36-f4a9-481e-9887-f4a0a711c327 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:12.991835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f9c36-f4a9-481e-9887-f4a0a711c327 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:12.993296 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f9c36-f4a9-481e-9887-f4a0a711c327 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:13.010886 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 423/816] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:13.010886 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f9c36-f4a9-481e-9887-f4a0a711c327 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:13.023692 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7f9be-957d-4494-a713-eda598e32234 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:13.055770 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:13.065909 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee49c91-ab6a-4e65-9005-f1eab7ff12f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:13.066584 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee49c91-ab6a-4e65-9005-f1eab7ff12f2 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:13.066869 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee49c91-ab6a-4e65-9005-f1eab7ff12f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:13.067150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee49c91-ab6a-4e65-9005-f1eab7ff12f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:13.069952 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee49c91-ab6a-4e65-9005-f1eab7ff12f2 None admin] RBAC: Adding query filter params (role.id=4588ca63994f4e2d9ce482d475edbabd, scope.project.id=b11b7e66a993492d8163097bce955c0b, user.id=575f61ef70314f86b5d9dad3ba1b3aab) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:13.069952 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee49c91-ab6a-4e65-9005-f1eab7ff12f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:13.070224 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee49c91-ab6a-4e65-9005-f1eab7ff12f2 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:13.088029 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 394/817] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:03:12 2022] GET /identity/v3/role_assignments?user.id=575f61ef70314f86b5d9dad3ba1b3aab&scope.project.id=b11b7e66a993492d8163097bce955c0b&role.id=4588ca63994f4e2d9ce482d475edbabd => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:13.088029 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee49c91-ab6a-4e65-9005-f1eab7ff12f2 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:13.132011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f9c36-f4a9-481e-9887-f4a0a711c327 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:13.175932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d089a-e934-4fc5-92ba-8785f3ff0877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:13.176641 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d089a-e934-4fc5-92ba-8785f3ff0877 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:13.176925 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d089a-e934-4fc5-92ba-8785f3ff0877 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:13.177239 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d089a-e934-4fc5-92ba-8785f3ff0877 None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:13.177958 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d089a-e934-4fc5-92ba-8785f3ff0877 None admin] RBAC: Adding query filter params (name=network) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:13.178264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d089a-e934-4fc5-92ba-8785f3ff0877 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:13.179650 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d089a-e934-4fc5-92ba-8785f3ff0877 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:13.182184 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:13.186107 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 424/818] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Jun 2 19:03:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:13.187116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d089a-e934-4fc5-92ba-8785f3ff0877 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:13.233063 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee49c91-ab6a-4e65-9005-f1eab7ff12f2 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:13.281097 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be2596-227a-4102-9f0f-e1bb2fbc8527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:13.281942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be2596-227a-4102-9f0f-e1bb2fbc8527 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:13.282221 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be2596-227a-4102-9f0f-e1bb2fbc8527 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:13.282492 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be2596-227a-4102-9f0f-e1bb2fbc8527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:13.299783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be2596-227a-4102-9f0f-e1bb2fbc8527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:13.301903 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be2596-227a-4102-9f0f-e1bb2fbc8527 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:13.316302 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d089a-e934-4fc5-92ba-8785f3ff0877 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:13.329029 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-10be2596-227a-4102-9f0f-e1bb2fbc8527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:13.329029 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:13.329029 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:13.329029 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:13.329029 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:13.329029 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:13.329029 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:13.329029 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:13.329029 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:13.329029 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:13.329029 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:13.329029 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:13.329029 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:13.329029 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:13.329029 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:13.330016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:13.330016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:13.330016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:13.330016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:13.330016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:13.330016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:13.330016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:13.330016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:13.330016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:13.330016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:13.330016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:13.330016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:13.330016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:13.330016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:13.330016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:13.330016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:13.330016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:13.330919 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:13.330919 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:13.330919 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:13.330919 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:13.331151 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 395/819] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:13.336431 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be2596-227a-4102-9f0f-e1bb2fbc8527 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:13.366725 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595970a-dce3-423d-bcab-e57049c7fe8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:13.369287 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595970a-dce3-423d-bcab-e57049c7fe8d None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:13.370040 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595970a-dce3-423d-bcab-e57049c7fe8d None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:13.370316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595970a-dce3-423d-bcab-e57049c7fe8d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:13.381447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595970a-dce3-423d-bcab-e57049c7fe8d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:13.383716 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595970a-dce3-423d-bcab-e57049c7fe8d None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:13.395531 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:13.399071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-b595970a-dce3-423d-bcab-e57049c7fe8d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 19:03:13.399071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:13.399071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:13.399071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:13.399071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:13.399071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:13.399071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:13.399071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:13.399071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:13.399071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:13.399071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:13.399071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:13.399071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:03:13.399071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:03:13.399071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:03:13.399071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:03:13.400091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:13.400091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:13.400091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:03:13.400091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:13.400091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:03:13.400091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:13.400091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:13.400091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:13.400091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:13.400091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:13.400091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:13.400091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:13.400091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:13.400091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:13.400091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:13.400091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:13.400091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:13.400091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:13.401809 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:13.401809 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:13.401809 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:03:13.401809 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:03:13.401809 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:03:13.401809 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:03:13.401809 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:03:13.401809 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:03:13.401809 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 19:03:13.401809 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:13.401809 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 425/820] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Jun 2 19:03:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:13.401809 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595970a-dce3-423d-bcab-e57049c7fe8d None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:13.489158 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be2596-227a-4102-9f0f-e1bb2fbc8527 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:13.500942 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:13.534990 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ed78b-4eae-4fb6-a7b3-c55450dcbce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:13.536065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ed78b-4eae-4fb6-a7b3-c55450dcbce9 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:13.536550 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ed78b-4eae-4fb6-a7b3-c55450dcbce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:13.537021 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ed78b-4eae-4fb6-a7b3-c55450dcbce9 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:13.537945 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ed78b-4eae-4fb6-a7b3-c55450dcbce9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:13.538445 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ed78b-4eae-4fb6-a7b3-c55450dcbce9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:13.540059 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ed78b-4eae-4fb6-a7b3-c55450dcbce9 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:13.545015 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595970a-dce3-423d-bcab-e57049c7fe8d None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:13.546290 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 396/821] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Jun 2 19:03:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:13.547979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ed78b-4eae-4fb6-a7b3-c55450dcbce9 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:13.584471 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c16b13-526d-480d-8506-f0a03d8d1303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:13.585190 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c16b13-526d-480d-8506-f0a03d8d1303 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:13.585430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c16b13-526d-480d-8506-f0a03d8d1303 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:13.585712 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c16b13-526d-480d-8506-f0a03d8d1303 None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:13.586447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c16b13-526d-480d-8506-f0a03d8d1303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:13.586759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c16b13-526d-480d-8506-f0a03d8d1303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:13.588290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c16b13-526d-480d-8506-f0a03d8d1303 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:13.606904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 426/822] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:13.607933 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c16b13-526d-480d-8506-f0a03d8d1303 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:13.663302 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ed78b-4eae-4fb6-a7b3-c55450dcbce9 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:13.671772 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:13.701862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf48ac-a8ba-42f9-894c-7d16955668b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:13.702902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf48ac-a8ba-42f9-894c-7d16955668b1 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:13.703403 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf48ac-a8ba-42f9-894c-7d16955668b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:13.703898 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf48ac-a8ba-42f9-894c-7d16955668b1 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:13.705018 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf48ac-a8ba-42f9-894c-7d16955668b1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:13.705639 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf48ac-a8ba-42f9-894c-7d16955668b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:13.707464 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf48ac-a8ba-42f9-894c-7d16955668b1 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:13.721703 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c16b13-526d-480d-8506-f0a03d8d1303 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:13.736421 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 397/823] 10.222.0.45 () {56 vars in 1149 bytes} [Thu Jun 2 19:03:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:13.737772 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf48ac-a8ba-42f9-894c-7d16955668b1 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:13.757100 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:13.777295 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a491aa-eaa9-4fd9-b415-c3296f573a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:13.779098 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a491aa-eaa9-4fd9-b415-c3296f573a4a None admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:13.779656 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a491aa-eaa9-4fd9-b415-c3296f573a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:13.780472 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a491aa-eaa9-4fd9-b415-c3296f573a4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:13.781944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a491aa-eaa9-4fd9-b415-c3296f573a4a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:13.784088 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a491aa-eaa9-4fd9-b415-c3296f573a4a None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:13.870742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf48ac-a8ba-42f9-894c-7d16955668b1 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:13.877611 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 427/824] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Jun 2 19:03:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:13.878884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a491aa-eaa9-4fd9-b415-c3296f573a4a None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:13.961166 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f160c60-13b9-4464-b625-6259f7037548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:13.962094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f160c60-13b9-4464-b625-6259f7037548 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:13.962379 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f160c60-13b9-4464-b625-6259f7037548 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:13.962652 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f160c60-13b9-4464-b625-6259f7037548 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:13.982350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f160c60-13b9-4464-b625-6259f7037548 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:13.983093 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f160c60-13b9-4464-b625-6259f7037548 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:14.017267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-6f160c60-13b9-4464-b625-6259f7037548 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:14.017267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:14.017267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:14.017267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:14.017267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:14.017267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:14.017267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:14.017267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:14.017267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:14.017267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:14.017267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:14.017267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:14.017267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:03:14.017267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:03:14.017267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:03:14.018281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:03:14.018281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:14.018281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:14.018281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:14.018281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:14.018281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:14.018281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:14.018281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:14.018281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:14.018281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:14.018281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:14.018281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:14.018281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:14.018281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:14.018281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:14.018281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:14.018281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:14.019868 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:03:14.019868 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:03:14.019868 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:03:14.019868 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:03:14.019868 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:03:14.019868 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:03:14.019868 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:14.019868 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:14.019868 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 398/825] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:03:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:14.024657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f160c60-13b9-4464-b625-6259f7037548 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:14.026002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a491aa-eaa9-4fd9-b415-c3296f573a4a None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:14.074013 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143e63d-6e0d-4a5e-b277-bd8a167394ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:14.075240 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143e63d-6e0d-4a5e-b277-bd8a167394ae None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:14.076643 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:14.077314 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143e63d-6e0d-4a5e-b277-bd8a167394ae None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:14.078872 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143e63d-6e0d-4a5e-b277-bd8a167394ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:14.093560 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143e63d-6e0d-4a5e-b277-bd8a167394ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:14.096552 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143e63d-6e0d-4a5e-b277-bd8a167394ae None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:14.120953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-4143e63d-6e0d-4a5e-b277-bd8a167394ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:14.120953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:14.120953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:14.120953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:14.120953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:14.120953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:14.120953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:14.120953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:14.120953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:14.120953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:14.120953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:14.120953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:14.120953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:14.120953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:14.120953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:14.121932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:14.121932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:14.121932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:14.121932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:14.121932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:14.121932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:14.121932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:14.121932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:14.121932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:14.121932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:14.121932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:14.121932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:14.121932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:14.121932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:14.121932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:14.121932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:14.121932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:14.122835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:14.122835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:14.122835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:14.122835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:14.125825 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 428/826] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:14.131411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143e63d-6e0d-4a5e-b277-bd8a167394ae None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:14.172474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:14.261877 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f160c60-13b9-4464-b625-6259f7037548 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:14.271321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143e63d-6e0d-4a5e-b277-bd8a167394ae None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:14.310625 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d8e82-0978-4ada-b05c-cf9b3ccf3a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:14.311296 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d8e82-0978-4ada-b05c-cf9b3ccf3a79 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:14.311578 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d8e82-0978-4ada-b05c-cf9b3ccf3a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:14.311854 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d8e82-0978-4ada-b05c-cf9b3ccf3a79 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:14.313237 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d8e82-0978-4ada-b05c-cf9b3ccf3a79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:14.313545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d8e82-0978-4ada-b05c-cf9b3ccf3a79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:14.314990 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d8e82-0978-4ada-b05c-cf9b3ccf3a79 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:14.329065 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d085a90-fd60-4e64-9005-a9774b18fabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:14.330053 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 399/827] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:03:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:14.330365 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d085a90-fd60-4e64-9005-a9774b18fabc None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:14.330730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d085a90-fd60-4e64-9005-a9774b18fabc None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:14.331014 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d085a90-fd60-4e64-9005-a9774b18fabc None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:14.331786 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d085a90-fd60-4e64-9005-a9774b18fabc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:14.333107 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d085a90-fd60-4e64-9005-a9774b18fabc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:14.333644 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d085a90-fd60-4e64-9005-a9774b18fabc None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:14.335466 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d8e82-0978-4ada-b05c-cf9b3ccf3a79 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:14.350197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 429/828] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:14.355388 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d085a90-fd60-4e64-9005-a9774b18fabc None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:14.476489 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:14.487226 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:14.488138 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d8e82-0978-4ada-b05c-cf9b3ccf3a79 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:14.502410 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d085a90-fd60-4e64-9005-a9774b18fabc None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:14.532380 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a46c3-4f94-4a7b-a43b-f3763980757c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:14.533269 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a46c3-4f94-4a7b-a43b-f3763980757c None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:14.533545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a46c3-4f94-4a7b-a43b-f3763980757c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:14.533816 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a46c3-4f94-4a7b-a43b-f3763980757c None admin] PATH_INFO: `/v3/projects/b11b7e66a993492d8163097bce955c0b/users/87ba0ab9510d49c4ab4c634e82790efb/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:14.535778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a46c3-4f94-4a7b-a43b-f3763980757c None admin] RBAC: Authorizing `identity:create_grant(project_id=b11b7e66a993492d8163097bce955c0b, user_id=87ba0ab9510d49c4ab4c634e82790efb, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:14.537355 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a46c3-4f94-4a7b-a43b-f3763980757c None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:14.548909 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4a521-bb58-41d2-bedb-288daf650b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:14.549777 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4a521-bb58-41d2-bedb-288daf650b26 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:14.550068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4a521-bb58-41d2-bedb-288daf650b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:14.550345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4a521-bb58-41d2-bedb-288daf650b26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:14.558031 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4a521-bb58-41d2-bedb-288daf650b26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:14.559697 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4a521-bb58-41d2-bedb-288daf650b26 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:14.574756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-61b4a521-bb58-41d2-bedb-288daf650b26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:14.574756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:14.574756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:14.574756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:14.574756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:14.574756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:14.574756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:14.574756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:14.574756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:14.574756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:14.574756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:14.574756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:14.574756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:03:14.574756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:03:14.574756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:03:14.575708 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:03:14.575708 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:14.575708 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:14.575708 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:14.575708 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:14.575708 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:14.575708 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:14.575708 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:14.575708 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:14.575708 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:14.575708 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:14.575708 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:14.575708 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:14.575708 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:14.575708 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:14.575708 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:14.575708 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:14.576926 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:03:14.576926 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:03:14.576926 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:03:14.576926 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:03:14.576926 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:03:14.576926 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:03:14.576926 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:14.576926 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:14.576926 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 430/829] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:03:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:14.577623 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b5c17-5005-427d-819b-12d97fdf59e5 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:14.577916 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b5c17-5005-427d-819b-12d97fdf59e5 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:14.578222 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b5c17-5005-427d-819b-12d97fdf59e5 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:14.580043 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 431/830] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:14.581465 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b5c17-5005-427d-819b-12d97fdf59e5 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:14.612181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 400/831] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jun 2 19:03:14 2022] PUT /identity/v3/projects/b11b7e66a993492d8163097bce955c0b/users/87ba0ab9510d49c4ab4c634e82790efb/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:03:14.613951 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0bf59-6736-4ba1-8a65-ed9a6970f792 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:14.614248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0bf59-6736-4ba1-8a65-ed9a6970f792 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:14.614531 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0bf59-6736-4ba1-8a65-ed9a6970f792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:14.639968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-0af0bf59-6736-4ba1-8a65-ed9a6970f792 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:14.641929 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0af0bf59-6736-4ba1-8a65-ed9a6970f792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:14.729253 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b5c17-5005-427d-819b-12d97fdf59e5 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:14.747747 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 401/832] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:03:14.766756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0bf59-6736-4ba1-8a65-ed9a6970f792 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:14.772343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983c917-d644-49e7-b0a3-8f735711ac97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:14.773060 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983c917-d644-49e7-b0a3-8f735711ac97 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:14.773393 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983c917-d644-49e7-b0a3-8f735711ac97 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:14.773679 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983c917-d644-49e7-b0a3-8f735711ac97 None admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:14.774709 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983c917-d644-49e7-b0a3-8f735711ac97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:14.775030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983c917-d644-49e7-b0a3-8f735711ac97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:14.776569 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983c917-d644-49e7-b0a3-8f735711ac97 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:14.798490 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 432/833] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:03:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:14.808183 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983c917-d644-49e7-b0a3-8f735711ac97 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:14.819070 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:14.858301 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:14.897015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0bf59-6736-4ba1-8a65-ed9a6970f792 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:14.933521 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4204f06-2b5a-4fd8-be8c-8875a3bac2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:14.934342 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4204f06-2b5a-4fd8-be8c-8875a3bac2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:14.934630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4204f06-2b5a-4fd8-be8c-8875a3bac2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:14.934909 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4204f06-2b5a-4fd8-be8c-8875a3bac2b0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:14.935573 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4204f06-2b5a-4fd8-be8c-8875a3bac2b0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:14.936731 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983c917-d644-49e7-b0a3-8f735711ac97 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:14.937012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4204f06-2b5a-4fd8-be8c-8875a3bac2b0 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:14.950539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-c4204f06-2b5a-4fd8-be8c-8875a3bac2b0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 19:03:14.950539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:14.950539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 19:03:14.950539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 19:03:14.950539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 19:03:14.950539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 19:03:14.950539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 19:03:14.950539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:14.950539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 19:03:14.950539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:14.950539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:03:14.950539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:14.950539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:14.950539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:14.950539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:14.950539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:14.950539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:14.951657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:14.951657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:14.951657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:14.951657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:14.951657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:14.951657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:14.951657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 19:03:14.951657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 19:03:14.951657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 19:03:14.951657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 19:03:14.951657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:14.951657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:14.951657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:14.951657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:14.951657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:14.951657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:14.952604 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:14.952604 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:14.952604 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:14.952604 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:14.952604 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:14.952604 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:14.952604 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:14.952604 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:14.952604 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:14.952604 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:14.952604 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 19:03:14.952604 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:14.952604 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 19:03:14.952604 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:14.952604 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 402/834] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jun 2 19:03:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:14.959025 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4204f06-2b5a-4fd8-be8c-8875a3bac2b0 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:14.986069 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775990c-50f0-43ee-9c7e-0da3e539e6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:14.987847 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775990c-50f0-43ee-9c7e-0da3e539e6ae None admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:14.988411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775990c-50f0-43ee-9c7e-0da3e539e6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:14.989106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775990c-50f0-43ee-9c7e-0da3e539e6ae None admin] PATH_INFO: `/v3/projects/b11b7e66a993492d8163097bce955c0b/users/235042beafd246c5b227b3926098c8c8/roles/13ff8a5ffa5648c28ec00aa75b69d913` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:15.010022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c775990c-50f0-43ee-9c7e-0da3e539e6ae None admin] RBAC: Authorizing `identity:create_grant(project_id=b11b7e66a993492d8163097bce955c0b, user_id=235042beafd246c5b227b3926098c8c8, role_id=13ff8a5ffa5648c28ec00aa75b69d913)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:15.012546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c775990c-50f0-43ee-9c7e-0da3e539e6ae None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:15.082603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4204f06-2b5a-4fd8-be8c-8875a3bac2b0 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:15.088236 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 433/835] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jun 2 19:03:14 2022] PUT /identity/v3/projects/b11b7e66a993492d8163097bce955c0b/users/235042beafd246c5b227b3926098c8c8/roles/13ff8a5ffa5648c28ec00aa75b69d913 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:15.132886 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c313f1-69f4-4102-9aca-7e638d6dcace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:15.133993 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c313f1-69f4-4102-9aca-7e638d6dcace None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:15.134543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c313f1-69f4-4102-9aca-7e638d6dcace None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:15.135093 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c313f1-69f4-4102-9aca-7e638d6dcace None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:15.136151 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c313f1-69f4-4102-9aca-7e638d6dcace None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:15.136690 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c313f1-69f4-4102-9aca-7e638d6dcace None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:15.138314 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c313f1-69f4-4102-9aca-7e638d6dcace None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:15.139924 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:15.145503 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 403/836] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jun 2 19:03:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:15.151337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775990c-50f0-43ee-9c7e-0da3e539e6ae None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:15.232134 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:15.283356 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775990c-50f0-43ee-9c7e-0da3e539e6ae None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:15.330565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebc894-aaf5-40ec-92a5-27a3492f28e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:15.331246 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebc894-aaf5-40ec-92a5-27a3492f28e6 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:15.331526 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebc894-aaf5-40ec-92a5-27a3492f28e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:15.331797 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebc894-aaf5-40ec-92a5-27a3492f28e6 None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:15.332554 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebc894-aaf5-40ec-92a5-27a3492f28e6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:15.332857 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebc894-aaf5-40ec-92a5-27a3492f28e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:15.334241 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebc894-aaf5-40ec-92a5-27a3492f28e6 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:15.340555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 434/837] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jun 2 19:03:15 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:15.644880 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ac255-64f1-4491-842c-78948397f9f0 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:15.645221 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ac255-64f1-4491-842c-78948397f9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:15.645462 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ac255-64f1-4491-842c-78948397f9f0 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:15.646961 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 404/838] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:15.652648 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf45701-ded8-4b90-8dc1-a5f77e187436 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:15.653239 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf45701-ded8-4b90-8dc1-a5f77e187436 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:15.653719 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf45701-ded8-4b90-8dc1-a5f77e187436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:15.672730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-0cf45701-ded8-4b90-8dc1-a5f77e187436 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:15.674261 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-0cf45701-ded8-4b90-8dc1-a5f77e187436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:15.748105 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 435/839] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 19:03:15.772206 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ac255-64f1-4491-842c-78948397f9f0 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:15.887843 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ac255-64f1-4491-842c-78948397f9f0 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:15.923930 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b07eb-b22a-42ae-9c39-d1a28172e85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:15.924696 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b07eb-b22a-42ae-9c39-d1a28172e85a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:15.924973 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b07eb-b22a-42ae-9c39-d1a28172e85a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:15.925247 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b07eb-b22a-42ae-9c39-d1a28172e85a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:15.925899 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b07eb-b22a-42ae-9c39-d1a28172e85a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:15.927291 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b07eb-b22a-42ae-9c39-d1a28172e85a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:15.940807 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-335b07eb-b22a-42ae-9c39-d1a28172e85a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 19:03:15.940807 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:15.940807 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 19:03:15.940807 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 19:03:15.940807 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 19:03:15.940807 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 19:03:15.940807 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 19:03:15.940807 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:15.940807 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 19:03:15.940807 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:15.940807 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:03:15.940807 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:15.940807 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:15.940807 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:15.940807 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:15.940807 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:15.941782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:15.941782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:15.941782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:15.941782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:15.941782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:15.941782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:15.941782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:15.941782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 19:03:15.941782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 19:03:15.941782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 19:03:15.941782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 19:03:15.941782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:15.941782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:15.941782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:15.941782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:15.941782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:15.942802 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:15.942802 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:15.942802 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:15.942802 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:15.942802 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:15.942802 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:15.942802 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:15.942802 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:15.942802 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:15.942802 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:15.942802 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:15.942802 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 19:03:15.942802 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:15.942802 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 19:03:15.942802 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:15.942802 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 405/840] 10.222.0.45 () {56 vars in 1132 bytes} [Thu Jun 2 19:03:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:15.948306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf45701-ded8-4b90-8dc1-a5f77e187436 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:16.009375 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:16.065070 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf45701-ded8-4b90-8dc1-a5f77e187436 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:16.101938 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af853f5f-c490-417e-8971-fd9278c4325f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:16.102615 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af853f5f-c490-417e-8971-fd9278c4325f None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:16.102904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af853f5f-c490-417e-8971-fd9278c4325f None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:16.103183 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af853f5f-c490-417e-8971-fd9278c4325f None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:16.103901 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af853f5f-c490-417e-8971-fd9278c4325f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:16.104241 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af853f5f-c490-417e-8971-fd9278c4325f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:16.105624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af853f5f-c490-417e-8971-fd9278c4325f None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:16.111490 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 436/841] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Jun 2 19:03:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:16.117122 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b07eb-b22a-42ae-9c39-d1a28172e85a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:16.184139 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:16.226847 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b07eb-b22a-42ae-9c39-d1a28172e85a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:16.269900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9faa9ca-ddd5-4c27-a790-2d9daf2fcbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:16.270960 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9faa9ca-ddd5-4c27-a790-2d9daf2fcbf1 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:16.271520 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9faa9ca-ddd5-4c27-a790-2d9daf2fcbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:16.272032 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9faa9ca-ddd5-4c27-a790-2d9daf2fcbf1 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:16.272986 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9faa9ca-ddd5-4c27-a790-2d9daf2fcbf1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:16.273499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9faa9ca-ddd5-4c27-a790-2d9daf2fcbf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:16.275135 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9faa9ca-ddd5-4c27-a790-2d9daf2fcbf1 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:16.281312 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 406/842] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Jun 2 19:03:16 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:17.049077 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965a5cf-ae08-4329-a2c7-3169c9300745 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:17.049572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965a5cf-ae08-4329-a2c7-3169c9300745 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:17.049572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965a5cf-ae08-4329-a2c7-3169c9300745 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:17.051246 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 437/843] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:17.057145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd6d6a-0b0e-4ae0-9dcc-26888846ad7f None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:17.057645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd6d6a-0b0e-4ae0-9dcc-26888846ad7f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:17.057722 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd6d6a-0b0e-4ae0-9dcc-26888846ad7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:17.077643 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-c0bd6d6a-0b0e-4ae0-9dcc-26888846ad7f None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:17.079498 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c0bd6d6a-0b0e-4ae0-9dcc-26888846ad7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:17.169892 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 407/844] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:03:17.194261 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965a5cf-ae08-4329-a2c7-3169c9300745 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:17.307697 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965a5cf-ae08-4329-a2c7-3169c9300745 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:17.325788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:17.344391 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b210aad-dfed-4db4-b2cb-0d58bde85ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:17.350416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b210aad-dfed-4db4-b2cb-0d58bde85ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:17.350416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b210aad-dfed-4db4-b2cb-0d58bde85ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:17.350416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b210aad-dfed-4db4-b2cb-0d58bde85ac0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:17.357150 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b210aad-dfed-4db4-b2cb-0d58bde85ac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:03:17.365662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-7b210aad-dfed-4db4-b2cb-0d58bde85ac0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:03:17.365662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:17.365662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:17.365662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:17.365662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:17.365662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:17.365662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:17.365662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:17.365662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:17.365662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:17.365662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:17.365662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:17.365662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:03:17.365662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:03:17.365662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:03:17.365662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:03:17.366689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:03:17.366689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:03:17.366689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:03:17.366689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:03:17.366689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:17.366689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:17.366689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:17.366689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:17.366689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:17.366689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:17.366689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:17.366689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:17.366689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:17.366689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:17.366689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:17.366689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:17.367519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:17.367519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:17.367519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:17.367519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:17.367519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:03:17.367519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:03:17.367519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:03:17.367519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:03:17.367519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:03:17.367519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:03:17.367519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:03:17.367519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:17.367519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 438/845] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:03:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:17.375569 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd6d6a-0b0e-4ae0-9dcc-26888846ad7f None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:17.457069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:17.487439 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289b648-f604-4f38-a8d1-e7a2a5b51e81 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:17.487770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289b648-f604-4f38-a8d1-e7a2a5b51e81 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:17.488026 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289b648-f604-4f38-a8d1-e7a2a5b51e81 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:17.489621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 439/846] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:03:17.495505 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3c2c5-991b-4149-a27c-7fb78f080eae None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:17.495826 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3c2c5-991b-4149-a27c-7fb78f080eae None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:17.496097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3c2c5-991b-4149-a27c-7fb78f080eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:17.521374 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-03a3c2c5-991b-4149-a27c-7fb78f080eae None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:17.523296 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-03a3c2c5-991b-4149-a27c-7fb78f080eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:17.530751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd6d6a-0b0e-4ae0-9dcc-26888846ad7f None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:17.574784 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c07ad-0558-41e3-ab21-c0246eeaaf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:17.576048 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c07ad-0558-41e3-ab21-c0246eeaaf0b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:17.576587 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c07ad-0558-41e3-ab21-c0246eeaaf0b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:17.577086 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c07ad-0558-41e3-ab21-c0246eeaaf0b None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:17.578680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c07ad-0558-41e3-ab21-c0246eeaaf0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:17.579214 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c07ad-0558-41e3-ab21-c0246eeaaf0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:17.580875 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c07ad-0558-41e3-ab21-c0246eeaaf0b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:17.591644 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 408/847] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:03:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:17.599279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c07ad-0558-41e3-ab21-c0246eeaaf0b None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:17.618462 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 440/848] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:03:17.643292 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3c2c5-991b-4149-a27c-7fb78f080eae None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:17.752571 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c07ad-0558-41e3-ab21-c0246eeaaf0b None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:17.767631 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3c2c5-991b-4149-a27c-7fb78f080eae None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:17.770892 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:17.776264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:17.788849 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cc3ff-d25a-4b33-9350-37bc5800db62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:17.789955 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cc3ff-d25a-4b33-9350-37bc5800db62 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:17.790236 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cc3ff-d25a-4b33-9350-37bc5800db62 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:17.790511 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cc3ff-d25a-4b33-9350-37bc5800db62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:17.806908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cc3ff-d25a-4b33-9350-37bc5800db62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:17.807103 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c96dd9-e96e-4adf-a1d1-6beb5c28a73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:17.807820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c96dd9-e96e-4adf-a1d1-6beb5c28a73c None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:17.808253 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c96dd9-e96e-4adf-a1d1-6beb5c28a73c None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:17.808423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cc3ff-d25a-4b33-9350-37bc5800db62 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:17.808520 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c96dd9-e96e-4adf-a1d1-6beb5c28a73c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:17.819181 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c96dd9-e96e-4adf-a1d1-6beb5c28a73c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:03:17.827118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-58c96dd9-e96e-4adf-a1d1-6beb5c28a73c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:03:17.827118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:17.827118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:17.827118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:17.827118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:17.827118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:17.827118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:17.827118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:17.827118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:17.827118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:17.827118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:17.827118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:17.827118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:03:17.827118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:03:17.827118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:03:17.827118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:03:17.828424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:03:17.828424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:03:17.828424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:03:17.828424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:03:17.828424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:17.828424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:17.828424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:17.828424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:17.828424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:17.828424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:17.828424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:17.828424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:17.828424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:17.828424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:17.828424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:17.828424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:17.839166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:17.839166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:17.839166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:17.839166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:17.839166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:03:17.839166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:03:17.839166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:03:17.839166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:03:17.839166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:03:17.839166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:03:17.839166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:03:17.839166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:17.839166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 441/849] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jun 2 19:03:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:17.840745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-412cc3ff-d25a-4b33-9350-37bc5800db62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:17.840745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:17.840745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:17.840745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:17.840745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:17.840745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:17.840745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:17.840745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:17.840745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:17.840745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:17.840745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:17.840745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:17.840745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:17.840745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:17.840745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:17.841906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:17.841906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:17.841906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:17.841906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:17.841906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:17.841906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:17.841906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:17.841906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:17.841906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:17.841906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:17.841906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:17.841906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:17.841906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:17.841906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:17.841906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:17.841906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:17.841906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:17.842947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:17.842947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:17.842947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:17.842947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:17.843224 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddec185-a916-4bb3-9ae9-e50a1972442a None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:17.843224 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddec185-a916-4bb3-9ae9-e50a1972442a None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:17.843379 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 409/850] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:17.843460 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddec185-a916-4bb3-9ae9-e50a1972442a None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:17.843460 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 442/851] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:17.844376 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cc3ff-d25a-4b33-9350-37bc5800db62 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:17.844483 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abb5be-bc6e-45be-9846-0ec858656af9 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:17.844483 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abb5be-bc6e-45be-9846-0ec858656af9 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:17.844483 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abb5be-bc6e-45be-9846-0ec858656af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:17.861139 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-b3abb5be-bc6e-45be-9846-0ec858656af9 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:17.862328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-b3abb5be-bc6e-45be-9846-0ec858656af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:17.944048 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 443/852] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:03:17.944048 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abb5be-bc6e-45be-9846-0ec858656af9 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:17.957621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cc3ff-d25a-4b33-9350-37bc5800db62 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:17.996554 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34f07b-9217-4472-a59b-aa17f0db9345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:17.997231 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34f07b-9217-4472-a59b-aa17f0db9345 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:17.997517 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34f07b-9217-4472-a59b-aa17f0db9345 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:17.997802 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34f07b-9217-4472-a59b-aa17f0db9345 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:17.998558 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34f07b-9217-4472-a59b-aa17f0db9345 None admin] RBAC: Adding query filter params (name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:17.998865 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34f07b-9217-4472-a59b-aa17f0db9345 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:18.000839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34f07b-9217-4472-a59b-aa17f0db9345 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:18.009492 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 410/853] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jun 2 19:03:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:18.009492 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34f07b-9217-4472-a59b-aa17f0db9345 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:18.049100 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:18.060669 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:18.067325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abb5be-bc6e-45be-9846-0ec858656af9 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:18.103871 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a43a98-a412-449d-9e8f-6a5c4e3ee578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:18.104583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a43a98-a412-449d-9e8f-6a5c4e3ee578 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:18.104898 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a43a98-a412-449d-9e8f-6a5c4e3ee578 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:18.105180 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a43a98-a412-449d-9e8f-6a5c4e3ee578 None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:18.105904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a43a98-a412-449d-9e8f-6a5c4e3ee578 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:18.106211 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a43a98-a412-449d-9e8f-6a5c4e3ee578 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:18.107595 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a43a98-a412-449d-9e8f-6a5c4e3ee578 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:18.121384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 444/854] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:18.122581 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a43a98-a412-449d-9e8f-6a5c4e3ee578 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:18.134365 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34f07b-9217-4472-a59b-aa17f0db9345 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:18.172251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03466a-35d6-45e1-9052-09a4063dc6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:18.172958 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03466a-35d6-45e1-9052-09a4063dc6a4 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:18.173248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03466a-35d6-45e1-9052-09a4063dc6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:18.173530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03466a-35d6-45e1-9052-09a4063dc6a4 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:18.174276 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03466a-35d6-45e1-9052-09a4063dc6a4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:18.175744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03466a-35d6-45e1-9052-09a4063dc6a4 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:18.231740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a43a98-a412-449d-9e8f-6a5c4e3ee578 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:18.244626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 411/855] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jun 2 19:03:18 2022] POST /identity/v3/services => generated 251 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:18.245765 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03466a-35d6-45e1-9052-09a4063dc6a4 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:18.290929 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09e1ad-ab21-49ed-9801-7e1c22c126bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:18.292106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09e1ad-ab21-49ed-9801-7e1c22c126bd None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:18.292403 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09e1ad-ab21-49ed-9801-7e1c22c126bd None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:18.292686 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09e1ad-ab21-49ed-9801-7e1c22c126bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:18.308528 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09e1ad-ab21-49ed-9801-7e1c22c126bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:18.310791 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09e1ad-ab21-49ed-9801-7e1c22c126bd None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:18.338045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-ed09e1ad-ab21-49ed-9801-7e1c22c126bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:18.338045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:18.338045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:18.338045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:18.338045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:18.338045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:18.338045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:18.338045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:18.338045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:18.338045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:18.338045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:18.338045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:18.338045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:18.338045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:18.338045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:18.339020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:18.339020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:18.339020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:18.339020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:18.339020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:18.339020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:18.339020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:18.339020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:18.339020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:18.339020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:18.339020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:18.339020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:18.339020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:18.339020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:18.339020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:18.339020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:18.339020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:18.345651 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:18.345651 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:18.345651 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:18.345651 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:18.345651 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 445/856] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:18.345934 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09e1ad-ab21-49ed-9801-7e1c22c126bd None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:18.351889 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:18.378128 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:18.389605 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03466a-35d6-45e1-9052-09a4063dc6a4 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:18.429232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52f91a-f0e7-401a-ad0a-b3c8291e15ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:18.430108 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52f91a-f0e7-401a-ad0a-b3c8291e15ba None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:18.430398 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52f91a-f0e7-401a-ad0a-b3c8291e15ba None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:18.430676 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52f91a-f0e7-401a-ad0a-b3c8291e15ba None admin] PATH_INFO: `/v3/users/swift` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:18.440781 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52f91a-f0e7-401a-ad0a-b3c8291e15ba None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:18.442385 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52f91a-f0e7-401a-ad0a-b3c8291e15ba None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:18.460527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-dd52f91a-f0e7-401a-ad0a-b3c8291e15ba None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 19:03:18.460527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:18.460527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:18.460527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:18.460527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:18.460527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:18.460527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:18.460527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:18.460527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:18.460527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:18.460527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:18.460527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:18.460527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:03:18.460527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:03:18.460527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:03:18.460527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:03:18.461543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:18.461543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:18.461543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:03:18.461543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:18.461543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:03:18.461543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:18.461543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:18.461543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:18.461543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:18.461543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:18.461543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:18.461543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:18.461543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:18.461543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:18.461543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:18.461543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:18.461543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:18.461543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:18.462480 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:18.462480 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:18.462480 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:03:18.462480 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:03:18.462480 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:03:18.462480 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:03:18.462480 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:03:18.462480 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:03:18.462480 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 19:03:18.462480 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:18.467387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 412/857] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:03:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:18.468482 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52f91a-f0e7-401a-ad0a-b3c8291e15ba None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:18.511640 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09e1ad-ab21-49ed-9801-7e1c22c126bd None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:18.559217 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c759860-baeb-448e-9a31-9c09599fb742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:18.559928 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c759860-baeb-448e-9a31-9c09599fb742 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:18.560238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c759860-baeb-448e-9a31-9c09599fb742 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:18.560515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c759860-baeb-448e-9a31-9c09599fb742 None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:18.561250 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c759860-baeb-448e-9a31-9c09599fb742 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:18.561557 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c759860-baeb-448e-9a31-9c09599fb742 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:18.564705 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c759860-baeb-448e-9a31-9c09599fb742 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:18.581338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 446/858] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:18.586873 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c759860-baeb-448e-9a31-9c09599fb742 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:18.612741 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52f91a-f0e7-401a-ad0a-b3c8291e15ba None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:18.661867 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8c287-6110-4434-98db-b81f586440c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:18.662940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:18.664037 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8c287-6110-4434-98db-b81f586440c2 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:18.664467 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8c287-6110-4434-98db-b81f586440c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:18.664746 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8c287-6110-4434-98db-b81f586440c2 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:18.665610 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8c287-6110-4434-98db-b81f586440c2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:18.665921 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8c287-6110-4434-98db-b81f586440c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:18.667570 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8c287-6110-4434-98db-b81f586440c2 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:18.692844 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 413/859] 10.222.0.45 () {56 vars in 1135 bytes} [Thu Jun 2 19:03:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:18.698292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8c287-6110-4434-98db-b81f586440c2 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:18.707667 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c759860-baeb-448e-9a31-9c09599fb742 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:18.721069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:18.754954 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722aab60-2ac9-4944-b87c-2b6b7289d2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:18.755960 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aab60-2ac9-4944-b87c-2b6b7289d2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:18.756271 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aab60-2ac9-4944-b87c-2b6b7289d2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:18.756550 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aab60-2ac9-4944-b87c-2b6b7289d2f0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:18.766387 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722aab60-2ac9-4944-b87c-2b6b7289d2f0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:18.768417 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722aab60-2ac9-4944-b87c-2b6b7289d2f0 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:18.789741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-722aab60-2ac9-4944-b87c-2b6b7289d2f0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 19:03:18.789741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:18.789741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:18.789741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:18.789741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:18.789741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:18.789741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:18.789741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:18.789741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:18.789741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:18.789741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:18.789741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:18.789741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:03:18.789741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:03:18.789741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:03:18.789741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:03:18.790772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:18.790772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:18.790772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:03:18.790772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:18.790772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:03:18.790772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:18.790772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:18.790772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:18.790772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:18.790772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:18.790772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:18.790772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:18.790772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:18.790772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:18.790772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:18.790772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:18.790772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:18.790772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:18.791738 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:18.791738 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:18.791738 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:03:18.791738 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:03:18.791738 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:03:18.791738 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:03:18.791738 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:03:18.791738 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:03:18.791738 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 19:03:18.791738 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:18.796154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 447/860] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Jun 2 19:03:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:18.798500 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dac4ec-af75-4dd2-8fab-42e365310500 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:18.798788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dac4ec-af75-4dd2-8fab-42e365310500 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:18.799071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dac4ec-af75-4dd2-8fab-42e365310500 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:18.800940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 448/861] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:18.806109 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dac4ec-af75-4dd2-8fab-42e365310500 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:18.825514 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8c287-6110-4434-98db-b81f586440c2 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:18.864384 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ff016-3282-4c63-84bd-5d17c825e9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:18.865053 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ff016-3282-4c63-84bd-5d17c825e9aa None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:18.865331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ff016-3282-4c63-84bd-5d17c825e9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:18.865606 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ff016-3282-4c63-84bd-5d17c825e9aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:18.918766 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dac4ec-af75-4dd2-8fab-42e365310500 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:18.945114 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:18.947003 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ff016-3282-4c63-84bd-5d17c825e9aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:18.948528 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ff016-3282-4c63-84bd-5d17c825e9aa None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:18.958019 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c8e77-e6a7-4ad3-b90d-50472dc7eaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:18.958706 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c8e77-e6a7-4ad3-b90d-50472dc7eaf8 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:18.958986 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c8e77-e6a7-4ad3-b90d-50472dc7eaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:18.959262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c8e77-e6a7-4ad3-b90d-50472dc7eaf8 None admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:18.960144 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c8e77-e6a7-4ad3-b90d-50472dc7eaf8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:18.960456 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c8e77-e6a7-4ad3-b90d-50472dc7eaf8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:18.961926 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c8e77-e6a7-4ad3-b90d-50472dc7eaf8 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:18.963900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:18.980991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 449/862] 10.222.0.45 () {56 vars in 1149 bytes} [Thu Jun 2 19:03:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:18.982579 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b4636-6bc3-4dd5-8b75-236ee141b415 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:18.983136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b4636-6bc3-4dd5-8b75-236ee141b415 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:18.983412 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b4636-6bc3-4dd5-8b75-236ee141b415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:19.000437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-496b4636-6bc3-4dd5-8b75-236ee141b415 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:19.001651 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-496b4636-6bc3-4dd5-8b75-236ee141b415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:19.069656 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 414/863] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:03:18 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 19:03:19.069656 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ff016-3282-4c63-84bd-5d17c825e9aa None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:19.081617 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 450/864] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:18 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:03:19.082494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b4636-6bc3-4dd5-8b75-236ee141b415 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:19.187814 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ff016-3282-4c63-84bd-5d17c825e9aa None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:19.200094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:19.206622 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b4636-6bc3-4dd5-8b75-236ee141b415 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:19.221788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:19.227062 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7375622-4850-4902-bbb0-f24f020d1db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:19.227720 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7375622-4850-4902-bbb0-f24f020d1db6 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:19.228018 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7375622-4850-4902-bbb0-f24f020d1db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:19.228368 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7375622-4850-4902-bbb0-f24f020d1db6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:19.242758 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4addfdb5-08de-4da2-8566-84d8ebc307de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:19.243552 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addfdb5-08de-4da2-8566-84d8ebc307de None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:19.243834 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addfdb5-08de-4da2-8566-84d8ebc307de None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:19.244142 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addfdb5-08de-4da2-8566-84d8ebc307de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:19.255100 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4addfdb5-08de-4da2-8566-84d8ebc307de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:19.256696 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4addfdb5-08de-4da2-8566-84d8ebc307de None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:19.274752 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-4addfdb5-08de-4da2-8566-84d8ebc307de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:19.274752 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:19.274752 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:19.274752 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:19.274752 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:19.274752 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:19.274752 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:19.274752 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:19.274752 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:19.274752 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:19.274752 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:19.274752 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:19.274752 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:19.274752 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:19.274752 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:19.275740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:19.275740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:19.275740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:19.275740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:19.275740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:19.275740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:19.275740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:19.275740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:19.275740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:19.275740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:19.275740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:19.275740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:19.275740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:19.275740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:19.275740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:19.275740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:19.275740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:19.276867 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:19.276867 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:19.276867 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:19.276867 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:19.276867 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 451/865] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:19.277150 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4addfdb5-08de-4da2-8566-84d8ebc307de None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:19.304528 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7375622-4850-4902-bbb0-f24f020d1db6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:19.306048 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7375622-4850-4902-bbb0-f24f020d1db6 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:19.378565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4addfdb5-08de-4da2-8566-84d8ebc307de None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:19.415582 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 415/866] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:03:19 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 19:03:19.415582 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7375622-4850-4902-bbb0-f24f020d1db6 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:19.417894 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3ede4-fe97-476e-a8e7-880ff307fe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:19.418591 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3ede4-fe97-476e-a8e7-880ff307fe81 None admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:19.418874 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3ede4-fe97-476e-a8e7-880ff307fe81 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:19.419156 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3ede4-fe97-476e-a8e7-880ff307fe81 None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:19.420029 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3ede4-fe97-476e-a8e7-880ff307fe81 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:19.421468 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3ede4-fe97-476e-a8e7-880ff307fe81 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:19.427968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:19.519856 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7375622-4850-4902-bbb0-f24f020d1db6 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:19.531724 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 452/867] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jun 2 19:03:19 2022] POST /identity/v3/services => generated 269 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:19.532813 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3ede4-fe97-476e-a8e7-880ff307fe81 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:19.579005 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:19.582981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7a903-504c-4d18-825e-3d2461195183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:19.583782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7a903-504c-4d18-825e-3d2461195183 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:19.584102 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7a903-504c-4d18-825e-3d2461195183 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:19.584381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7a903-504c-4d18-825e-3d2461195183 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:19.585280 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7a903-504c-4d18-825e-3d2461195183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:19.585617 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7a903-504c-4d18-825e-3d2461195183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:19.587105 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7a903-504c-4d18-825e-3d2461195183 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:19.606948 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 416/868] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:19.607975 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7a903-504c-4d18-825e-3d2461195183 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:19.704193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:19.705793 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3ede4-fe97-476e-a8e7-880ff307fe81 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:19.757640 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7a903-504c-4d18-825e-3d2461195183 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:19.757884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a1f45-2ef7-455a-a51b-ab53f00d47ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:19.758580 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a1f45-2ef7-455a-a51b-ab53f00d47ac None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:19.758898 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a1f45-2ef7-455a-a51b-ab53f00d47ac None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:19.759306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a1f45-2ef7-455a-a51b-ab53f00d47ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:19.773680 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a1f45-2ef7-455a-a51b-ab53f00d47ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:19.775181 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a1f45-2ef7-455a-a51b-ab53f00d47ac None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:19.795438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-b14a1f45-2ef7-455a-a51b-ab53f00d47ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:19.795438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:19.795438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:19.795438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:19.795438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:19.795438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:19.795438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:19.795438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:19.795438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:19.795438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:19.795438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:19.795438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:19.795438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:19.795438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:19.795438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:19.796624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:19.796624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:19.796624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:19.796624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:19.796624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:19.796624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:19.796624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:19.796624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:19.796624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:19.796624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:19.796624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:19.796624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:19.796624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:19.796624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:19.796624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:19.796624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:19.796624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:19.798273 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:19.798273 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:19.798273 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:19.798273 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:19.798546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 453/869] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:19.804087 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a1f45-2ef7-455a-a51b-ab53f00d47ac None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:19.806603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c31f9-68ae-42b4-8c31-794e3a0ea81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:19.807458 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c31f9-68ae-42b4-8c31-794e3a0ea81d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:19.807708 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c31f9-68ae-42b4-8c31-794e3a0ea81d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:19.807966 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c31f9-68ae-42b4-8c31-794e3a0ea81d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:19.818583 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c31f9-68ae-42b4-8c31-794e3a0ea81d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:19.820244 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c31f9-68ae-42b4-8c31-794e3a0ea81d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:19.840621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-b90c31f9-68ae-42b4-8c31-794e3a0ea81d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:19.840621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:19.840621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:19.840621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:19.840621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:19.840621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:19.840621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:19.840621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:19.840621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:19.840621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:19.840621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:19.840621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:19.840621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:03:19.840621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:03:19.840621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:03:19.841858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:03:19.841858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:19.841858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:19.841858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:19.841858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:19.841858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:19.841858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:19.841858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:19.841858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:19.841858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:19.841858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:19.841858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:19.841858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:19.841858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:19.841858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:19.841858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:19.841858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:19.842755 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:03:19.842755 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:03:19.842755 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:03:19.842755 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:03:19.842755 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:03:19.842755 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:03:19.842755 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:19.842755 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:19.842755 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 417/870] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:03:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:19.849153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c31f9-68ae-42b4-8c31-794e3a0ea81d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:19.908435 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:19.931327 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a1f45-2ef7-455a-a51b-ab53f00d47ac None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:19.960058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c31f9-68ae-42b4-8c31-794e3a0ea81d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:19.967324 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a87680-d67d-4524-93c0-ebf4c59bf78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:19.968149 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a87680-d67d-4524-93c0-ebf4c59bf78f None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:19.969028 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a87680-d67d-4524-93c0-ebf4c59bf78f None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:19.969380 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a87680-d67d-4524-93c0-ebf4c59bf78f None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:19.970185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a87680-d67d-4524-93c0-ebf4c59bf78f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:19.970561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a87680-d67d-4524-93c0-ebf4c59bf78f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:19.972064 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a87680-d67d-4524-93c0-ebf4c59bf78f None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:19.985538 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 454/871] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:19.991149 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a87680-d67d-4524-93c0-ebf4c59bf78f None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:19.992850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:20.003016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb610436-3694-4874-82ec-28985caa38cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:20.003771 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb610436-3694-4874-82ec-28985caa38cd None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:20.004081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb610436-3694-4874-82ec-28985caa38cd None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:20.004422 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb610436-3694-4874-82ec-28985caa38cd None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:20.010921 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb610436-3694-4874-82ec-28985caa38cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:20.010921 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb610436-3694-4874-82ec-28985caa38cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:20.010921 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb610436-3694-4874-82ec-28985caa38cd None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:20.026031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 418/872] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:03:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:20.026927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb610436-3694-4874-82ec-28985caa38cd None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:20.097891 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a87680-d67d-4524-93c0-ebf4c59bf78f None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:20.136912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c6f6e-cd0f-4ec9-9739-81d6320ede99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:20.137841 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c6f6e-cd0f-4ec9-9739-81d6320ede99 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:20.138198 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c6f6e-cd0f-4ec9-9739-81d6320ede99 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:20.138547 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c6f6e-cd0f-4ec9-9739-81d6320ede99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:20.147316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c6f6e-cd0f-4ec9-9739-81d6320ede99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:20.148972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c6f6e-cd0f-4ec9-9739-81d6320ede99 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:20.149834 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:20.159739 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb610436-3694-4874-82ec-28985caa38cd None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:20.169475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-3d7c6f6e-cd0f-4ec9-9739-81d6320ede99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:20.169475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:20.169475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:20.169475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:20.169475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:20.169475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:20.169475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:20.169475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:20.169475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:20.169475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:20.169475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:20.169475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:20.169475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:03:20.169475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:03:20.169475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:03:20.170446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:03:20.170446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:20.170446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:20.170446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:20.170446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:20.170446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:20.170446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:20.170446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:20.170446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:20.170446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:20.170446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:20.170446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:20.170446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:20.170446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:20.170446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:20.170446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:20.170446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:20.171354 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:03:20.171354 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:03:20.171354 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:03:20.171354 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:03:20.171354 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:03:20.171354 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:03:20.171354 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:20.171354 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:20.175894 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 455/873] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:03:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:20.177025 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c6f6e-cd0f-4ec9-9739-81d6320ede99 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:20.200069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685493eb-9cd5-4271-8d52-99e93d8e8b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:20.200739 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685493eb-9cd5-4271-8d52-99e93d8e8b4d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:20.201021 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685493eb-9cd5-4271-8d52-99e93d8e8b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:20.201296 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685493eb-9cd5-4271-8d52-99e93d8e8b4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:20.202132 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685493eb-9cd5-4271-8d52-99e93d8e8b4d None admin] RBAC: Adding query filter params (role.id=4588ca63994f4e2d9ce482d475edbabd, scope.project.id=b11b7e66a993492d8163097bce955c0b, user.id=87ba0ab9510d49c4ab4c634e82790efb) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:20.202441 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685493eb-9cd5-4271-8d52-99e93d8e8b4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:20.205381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685493eb-9cd5-4271-8d52-99e93d8e8b4d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:20.220151 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 419/874] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:03:20 2022] GET /identity/v3/role_assignments?user.id=87ba0ab9510d49c4ab4c634e82790efb&scope.project.id=b11b7e66a993492d8163097bce955c0b&role.id=4588ca63994f4e2d9ce482d475edbabd => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:20.298756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c6f6e-cd0f-4ec9-9739-81d6320ede99 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:20.339619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1009457-92d8-4509-980c-97c2e6005bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:20.340406 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1009457-92d8-4509-980c-97c2e6005bfb None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:20.340703 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1009457-92d8-4509-980c-97c2e6005bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:20.341243 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1009457-92d8-4509-980c-97c2e6005bfb None admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:20.342145 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1009457-92d8-4509-980c-97c2e6005bfb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:20.342461 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1009457-92d8-4509-980c-97c2e6005bfb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:20.344089 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1009457-92d8-4509-980c-97c2e6005bfb None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:20.361457 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 456/875] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:03:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:20.367952 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685493eb-9cd5-4271-8d52-99e93d8e8b4d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:20.427381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:20.484565 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685493eb-9cd5-4271-8d52-99e93d8e8b4d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:20.522161 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2216407-4f8a-4ce7-931f-5b8042791dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:20.523186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2216407-4f8a-4ce7-931f-5b8042791dad None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:20.523675 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2216407-4f8a-4ce7-931f-5b8042791dad None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:20.524181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2216407-4f8a-4ce7-931f-5b8042791dad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:20.525260 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2216407-4f8a-4ce7-931f-5b8042791dad None admin] RBAC: Adding query filter params (role.id=13ff8a5ffa5648c28ec00aa75b69d913, scope.project.id=b11b7e66a993492d8163097bce955c0b, user.id=235042beafd246c5b227b3926098c8c8) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:20.525784 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2216407-4f8a-4ce7-931f-5b8042791dad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:20.527479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2216407-4f8a-4ce7-931f-5b8042791dad None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:20.535235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 420/876] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:03:20 2022] GET /identity/v3/role_assignments?user.id=235042beafd246c5b227b3926098c8c8&scope.project.id=b11b7e66a993492d8163097bce955c0b&role.id=13ff8a5ffa5648c28ec00aa75b69d913 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:20.709140 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e1328-8785-4074-9717-7081d102c460 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:20.709855 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e1328-8785-4074-9717-7081d102c460 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:20.710350 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e1328-8785-4074-9717-7081d102c460 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:20.712563 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 457/877] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:20.725096 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562a612-dd0f-4a83-aeaa-f76442e76de5 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:20.725754 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562a612-dd0f-4a83-aeaa-f76442e76de5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:20.726276 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562a612-dd0f-4a83-aeaa-f76442e76de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:20.745639 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-5562a612-dd0f-4a83-aeaa-f76442e76de5 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:20.747217 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5562a612-dd0f-4a83-aeaa-f76442e76de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:20.830676 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 421/878] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:03:20.858189 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e1328-8785-4074-9717-7081d102c460 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:20.926063 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:20.976922 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e1328-8785-4074-9717-7081d102c460 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:21.012211 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fef5c-4657-4c57-b88c-15716c288cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:21.013267 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fef5c-4657-4c57-b88c-15716c288cfc None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:21.013688 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fef5c-4657-4c57-b88c-15716c288cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:21.014128 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fef5c-4657-4c57-b88c-15716c288cfc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:21.014922 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551fef5c-4657-4c57-b88c-15716c288cfc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:21.017183 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551fef5c-4657-4c57-b88c-15716c288cfc None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:21.029853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-551fef5c-4657-4c57-b88c-15716c288cfc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 19:03:21.029853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:21.029853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 19:03:21.029853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 19:03:21.029853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 19:03:21.029853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 19:03:21.029853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 19:03:21.029853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:21.029853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 19:03:21.029853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:21.029853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:03:21.029853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:21.029853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:21.029853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:21.029853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:21.029853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:21.029853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:21.031756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:21.031756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:21.031756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:21.031756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:21.031756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:21.031756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:21.031756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 19:03:21.031756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 19:03:21.031756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 19:03:21.031756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 19:03:21.031756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:21.031756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:21.031756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:21.031756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:21.031756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:21.031756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:21.032826 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:21.032826 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:21.032826 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:21.032826 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:21.032826 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:21.032826 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:21.032826 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:21.032826 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:21.032826 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:21.032826 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:21.032826 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 19:03:21.032826 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:21.032826 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 19:03:21.032826 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:21.035400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 458/879] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jun 2 19:03:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:21.049348 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562a612-dd0f-4a83-aeaa-f76442e76de5 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:21.098611 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:21.156851 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562a612-dd0f-4a83-aeaa-f76442e76de5 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:21.200030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ea3d6-cec9-46ac-ae1c-91afa1b035e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:21.200737 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ea3d6-cec9-46ac-ae1c-91afa1b035e2 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:21.201294 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ea3d6-cec9-46ac-ae1c-91afa1b035e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:21.201376 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ea3d6-cec9-46ac-ae1c-91afa1b035e2 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:21.202060 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ea3d6-cec9-46ac-ae1c-91afa1b035e2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:21.202369 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ea3d6-cec9-46ac-ae1c-91afa1b035e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:21.203842 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ea3d6-cec9-46ac-ae1c-91afa1b035e2 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:21.209890 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 422/880] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jun 2 19:03:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:21.215877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fef5c-4657-4c57-b88c-15716c288cfc None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:21.342877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fef5c-4657-4c57-b88c-15716c288cfc None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:21.368700 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:21.386325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea02f88-bd48-43ff-a271-1003938f13df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:21.387014 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea02f88-bd48-43ff-a271-1003938f13df None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:21.387300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea02f88-bd48-43ff-a271-1003938f13df None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:21.387581 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea02f88-bd48-43ff-a271-1003938f13df None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:21.388345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea02f88-bd48-43ff-a271-1003938f13df None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:21.388652 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea02f88-bd48-43ff-a271-1003938f13df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:21.390059 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea02f88-bd48-43ff-a271-1003938f13df None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:21.396455 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 459/881] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jun 2 19:03:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:21.402432 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ea3d6-cec9-46ac-ae1c-91afa1b035e2 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:21.527689 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ea3d6-cec9-46ac-ae1c-91afa1b035e2 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:21.540553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:21.572740 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c4ac3-f1a8-4d26-9792-1e6e2032b060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:21.574743 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c4ac3-f1a8-4d26-9792-1e6e2032b060 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:21.575246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c4ac3-f1a8-4d26-9792-1e6e2032b060 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:21.575751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c4ac3-f1a8-4d26-9792-1e6e2032b060 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:21.576803 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c4ac3-f1a8-4d26-9792-1e6e2032b060 None admin] RBAC: Adding query filter params (interface=public, service_id=7246f9c3ae0b4ebc9ac82c082ebdd8c3, region_id=RegionOne) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:21.577325 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c4ac3-f1a8-4d26-9792-1e6e2032b060 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:21.579501 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c4ac3-f1a8-4d26-9792-1e6e2032b060 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:21.588547 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 423/882] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Jun 2 19:03:21 2022] GET /identity/v3/endpoints?service_id=7246f9c3ae0b4ebc9ac82c082ebdd8c3&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:21.594775 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea02f88-bd48-43ff-a271-1003938f13df None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:21.706222 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea02f88-bd48-43ff-a271-1003938f13df None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:21.745467 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6604ae-64cc-4bc6-866c-3767f594d2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:21.746538 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6604ae-64cc-4bc6-866c-3767f594d2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:21.747031 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6604ae-64cc-4bc6-866c-3767f594d2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:21.747542 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6604ae-64cc-4bc6-866c-3767f594d2c6 None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:21.748510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6604ae-64cc-4bc6-866c-3767f594d2c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:21.750260 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6604ae-64cc-4bc6-866c-3767f594d2c6 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:21.758757 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 460/883] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Jun 2 19:03:21 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:03:22.088959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f3d8a-08b6-427b-8588-34042eee72ec None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:22.089234 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f3d8a-08b6-427b-8588-34042eee72ec None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:22.089509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f3d8a-08b6-427b-8588-34042eee72ec None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:22.091434 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 424/884] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:22.097380 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128540b5-0d37-4889-929e-51156e4374c0 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:22.097672 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128540b5-0d37-4889-929e-51156e4374c0 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:22.097953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128540b5-0d37-4889-929e-51156e4374c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:22.115755 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-128540b5-0d37-4889-929e-51156e4374c0 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:22.117005 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-128540b5-0d37-4889-929e-51156e4374c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:22.163646 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:22.192110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 461/885] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:03:22.211378 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f3d8a-08b6-427b-8588-34042eee72ec None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:22.322978 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f3d8a-08b6-427b-8588-34042eee72ec None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:22.358627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89987b-29a5-4398-9ca5-dc7f55de1a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:22.359438 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89987b-29a5-4398-9ca5-dc7f55de1a16 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:22.359718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89987b-29a5-4398-9ca5-dc7f55de1a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:22.360002 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89987b-29a5-4398-9ca5-dc7f55de1a16 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:22.360744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89987b-29a5-4398-9ca5-dc7f55de1a16 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:22.362181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89987b-29a5-4398-9ca5-dc7f55de1a16 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:22.376474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-fa89987b-29a5-4398-9ca5-dc7f55de1a16 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 19:03:22.376474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:22.376474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 19:03:22.376474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 19:03:22.376474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 19:03:22.376474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 19:03:22.376474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 19:03:22.376474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:22.376474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 19:03:22.376474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:22.376474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:03:22.376474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:22.376474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:22.376474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:22.376474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:22.376474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:22.378030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:22.378030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:22.378030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:22.378030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:22.378030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:22.378030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:22.378030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:22.378030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 19:03:22.378030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 19:03:22.378030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 19:03:22.378030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 19:03:22.378030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:22.378030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:22.378030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:22.378030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:22.378030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:22.378871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:22.378871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:22.378871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:22.378871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:22.378871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:22.378871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:22.378871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:22.378871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:22.378871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:22.378871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:22.378871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:22.378871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 19:03:22.378871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:22.378871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 19:03:22.378871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:22.383119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 425/886] 10.222.0.45 () {56 vars in 1132 bytes} [Thu Jun 2 19:03:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:22.384691 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128540b5-0d37-4889-929e-51156e4374c0 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:22.496390 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128540b5-0d37-4889-929e-51156e4374c0 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:22.532644 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670edea-f2d1-4657-b05a-77f947f133a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:22.533787 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670edea-f2d1-4657-b05a-77f947f133a7 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:22.534197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670edea-f2d1-4657-b05a-77f947f133a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:22.534569 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670edea-f2d1-4657-b05a-77f947f133a7 None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:22.535400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670edea-f2d1-4657-b05a-77f947f133a7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:22.535851 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670edea-f2d1-4657-b05a-77f947f133a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:22.537424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670edea-f2d1-4657-b05a-77f947f133a7 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:22.548165 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 462/887] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Jun 2 19:03:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:22.549665 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89987b-29a5-4398-9ca5-dc7f55de1a16 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:22.588441 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:22.659836 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89987b-29a5-4398-9ca5-dc7f55de1a16 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:22.701411 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91431006-9298-4054-a8d3-eef768919753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:22.702094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91431006-9298-4054-a8d3-eef768919753 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:22.702376 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91431006-9298-4054-a8d3-eef768919753 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:22.702649 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91431006-9298-4054-a8d3-eef768919753 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:22.703411 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91431006-9298-4054-a8d3-eef768919753 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:22.703713 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91431006-9298-4054-a8d3-eef768919753 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:22.705174 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91431006-9298-4054-a8d3-eef768919753 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:22.715248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 426/888] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Jun 2 19:03:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:22.717657 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670edea-f2d1-4657-b05a-77f947f133a7 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:22.778863 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:22.829351 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e6331-aba4-4a15-accb-a2350fb3b39f None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:22.830128 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e6331-aba4-4a15-accb-a2350fb3b39f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:22.830421 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e6331-aba4-4a15-accb-a2350fb3b39f None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:22.832736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 427/889] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:03:22.839092 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc08d1-bf13-490a-9abe-b6b6797834cc None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:22.839457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc08d1-bf13-490a-9abe-b6b6797834cc None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:22.839632 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc08d1-bf13-490a-9abe-b6b6797834cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:22.844133 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670edea-f2d1-4657-b05a-77f947f133a7 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:22.858572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-d8cc08d1-bf13-490a-9abe-b6b6797834cc None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:22.860539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d8cc08d1-bf13-490a-9abe-b6b6797834cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:22.885840 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da6b2d-9dd0-4a6c-8dcf-c9d8eeac0082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:22.886864 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da6b2d-9dd0-4a6c-8dcf-c9d8eeac0082 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:22.887350 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da6b2d-9dd0-4a6c-8dcf-c9d8eeac0082 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:22.887846 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da6b2d-9dd0-4a6c-8dcf-c9d8eeac0082 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:22.888921 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da6b2d-9dd0-4a6c-8dcf-c9d8eeac0082 None admin] RBAC: Adding query filter params (interface=public, service_id=a9b0975054ae4793b2127e64c0588bad, region_id=RegionOne) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:22.889457 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da6b2d-9dd0-4a6c-8dcf-c9d8eeac0082 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:22.891662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da6b2d-9dd0-4a6c-8dcf-c9d8eeac0082 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:22.902222 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 463/890] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Jun 2 19:03:22 2022] GET /identity/v3/endpoints?service_id=a9b0975054ae4793b2127e64c0588bad&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:22.903870 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da6b2d-9dd0-4a6c-8dcf-c9d8eeac0082 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:22.940096 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 428/891] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 19:03:22.959602 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc08d1-bf13-490a-9abe-b6b6797834cc None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:22.995956 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:23.022123 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da6b2d-9dd0-4a6c-8dcf-c9d8eeac0082 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:23.030789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:23.058821 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0424321-bf00-44a5-a846-bd2cb6622d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:23.059498 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0424321-bf00-44a5-a846-bd2cb6622d59 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:23.059933 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0424321-bf00-44a5-a846-bd2cb6622d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:23.060160 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0424321-bf00-44a5-a846-bd2cb6622d59 None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:23.060864 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0424321-bf00-44a5-a846-bd2cb6622d59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:23.062792 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0424321-bf00-44a5-a846-bd2cb6622d59 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:23.068742 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 464/892] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Jun 2 19:03:22 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:03:23.070137 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8eb014-0c2c-44a1-9237-e194af215f32 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:23.070430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8eb014-0c2c-44a1-9237-e194af215f32 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:23.070709 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8eb014-0c2c-44a1-9237-e194af215f32 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:23.072286 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 465/893] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:23.078717 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf11be3-4201-4077-b0e4-92c9af843bfb None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:23.079063 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf11be3-4201-4077-b0e4-92c9af843bfb None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:23.079297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf11be3-4201-4077-b0e4-92c9af843bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:23.089369 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc08d1-bf13-490a-9abe-b6b6797834cc None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:23.098627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-abf11be3-4201-4077-b0e4-92c9af843bfb None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:23.099882 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-abf11be3-4201-4077-b0e4-92c9af843bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:23.138610 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f3101-59b2-4c39-89f3-1fccc038b555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:23.139459 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f3101-59b2-4c39-89f3-1fccc038b555 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:23.139736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f3101-59b2-4c39-89f3-1fccc038b555 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:23.140035 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f3101-59b2-4c39-89f3-1fccc038b555 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:23.141486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f3101-59b2-4c39-89f3-1fccc038b555 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:23.143316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f3101-59b2-4c39-89f3-1fccc038b555 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:23.159821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-d59f3101-59b2-4c39-89f3-1fccc038b555 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 19:03:23.159821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:23.159821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 19:03:23.159821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 19:03:23.159821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 19:03:23.159821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 19:03:23.159821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 19:03:23.159821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:23.159821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 19:03:23.159821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:23.159821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:03:23.159821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:23.159821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:23.159821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:23.159821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:23.159821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:23.159821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:23.161205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:23.161205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:23.161205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:23.161205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:23.161205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:23.161205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:23.161205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 19:03:23.161205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 19:03:23.161205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 19:03:23.161205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 19:03:23.161205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:23.161205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:23.161205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:23.161205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:23.161205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:23.161205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:23.162313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:23.162313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:23.162313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:23.162313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:23.162313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:23.162313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:23.162313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:23.162313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:23.162313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:23.162313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:23.162313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 19:03:23.162313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:23.162313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 19:03:23.162313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:23.164569 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 429/894] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Jun 2 19:03:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:23.171761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f3101-59b2-4c39-89f3-1fccc038b555 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:23.201159 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 466/895] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 19:03:23.222121 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf11be3-4201-4077-b0e4-92c9af843bfb None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:23.297378 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:23.307178 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f3101-59b2-4c39-89f3-1fccc038b555 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:23.360605 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:23.361446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c23f68-e49b-4a94-b5e7-0c4b931a574b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:23.361926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c23f68-e49b-4a94-b5e7-0c4b931a574b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:23.362156 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c23f68-e49b-4a94-b5e7-0c4b931a574b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:23.362455 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c23f68-e49b-4a94-b5e7-0c4b931a574b None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:23.363203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c23f68-e49b-4a94-b5e7-0c4b931a574b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:23.363505 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c23f68-e49b-4a94-b5e7-0c4b931a574b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:23.364957 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c23f68-e49b-4a94-b5e7-0c4b931a574b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:23.367916 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf11be3-4201-4077-b0e4-92c9af843bfb None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:23.376163 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 430/896] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Jun 2 19:03:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:23.376353 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c23f68-e49b-4a94-b5e7-0c4b931a574b None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:23.416616 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea6d62-78b1-4fea-b67e-a13a4e06c851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:23.420480 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea6d62-78b1-4fea-b67e-a13a4e06c851 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:23.420957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea6d62-78b1-4fea-b67e-a13a4e06c851 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:23.421272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea6d62-78b1-4fea-b67e-a13a4e06c851 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:23.434436 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea6d62-78b1-4fea-b67e-a13a4e06c851 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:03:23.443586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-a9ea6d62-78b1-4fea-b67e-a13a4e06c851 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 19:03:23.443586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:23.443586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:23.443586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:23.443586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:23.443586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:23.443586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:23.443586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:23.443586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:23.443586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:23.443586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:23.443586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:23.443586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:03:23.443586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:03:23.443586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:03:23.443586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:03:23.445022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:03:23.445022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:03:23.445022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:03:23.445022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:03:23.445022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:23.445022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:23.445022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:23.445022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:23.445022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:23.445022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:23.445022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:23.445022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:23.445022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:23.445022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:23.445022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:23.445022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:23.446125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:23.446125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:23.446125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:23.446125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:23.446125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:03:23.446125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:03:23.446125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:03:23.446125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:03:23.446125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:03:23.446125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:03:23.446125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 19:03:23.446125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:23.449880 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 467/897] 10.222.0.45 () {56 vars in 1120 bytes} [Thu Jun 2 19:03:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:23.451343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea6d62-78b1-4fea-b67e-a13a4e06c851 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:23.519768 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c23f68-e49b-4a94-b5e7-0c4b931a574b None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:23.568345 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfea4f5-5a59-42ba-bc6c-f0f355e87dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:23.569914 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfea4f5-5a59-42ba-bc6c-f0f355e87dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:23.570597 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfea4f5-5a59-42ba-bc6c-f0f355e87dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:23.571177 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfea4f5-5a59-42ba-bc6c-f0f355e87dd4 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:23.572187 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfea4f5-5a59-42ba-bc6c-f0f355e87dd4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:23.572983 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfea4f5-5a59-42ba-bc6c-f0f355e87dd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:23.575568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfea4f5-5a59-42ba-bc6c-f0f355e87dd4 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:23.583119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 431/898] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Jun 2 19:03:23 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:23.599452 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea6d62-78b1-4fea-b67e-a13a4e06c851 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:23.644566 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe10b8-4562-4b27-bc46-2e3e578617bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:23.645858 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe10b8-4562-4b27-bc46-2e3e578617bf None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:23.646334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe10b8-4562-4b27-bc46-2e3e578617bf None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:23.646802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe10b8-4562-4b27-bc46-2e3e578617bf None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:23.647867 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe10b8-4562-4b27-bc46-2e3e578617bf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:23.648608 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe10b8-4562-4b27-bc46-2e3e578617bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:23.650721 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe10b8-4562-4b27-bc46-2e3e578617bf None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:23.664322 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 468/899] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Jun 2 19:03:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:23.669987 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfea4f5-5a59-42ba-bc6c-f0f355e87dd4 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:23.702507 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:23.811353 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfea4f5-5a59-42ba-bc6c-f0f355e87dd4 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:23.857005 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68741e2c-76d3-4b19-951e-ae797e8693a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:23.857927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68741e2c-76d3-4b19-951e-ae797e8693a4 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:23.858214 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68741e2c-76d3-4b19-951e-ae797e8693a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:23.858495 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68741e2c-76d3-4b19-951e-ae797e8693a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:23.874051 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68741e2c-76d3-4b19-951e-ae797e8693a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:23.876217 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68741e2c-76d3-4b19-951e-ae797e8693a4 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:23.897331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-68741e2c-76d3-4b19-951e-ae797e8693a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:23.897331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:23.897331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:23.897331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:23.897331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:23.897331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:23.897331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:23.897331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:23.897331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:23.897331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:23.897331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:23.897331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:23.897331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:23.897331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:23.897331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:23.898370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:23.898370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:23.898370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:23.898370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:23.898370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:23.898370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:23.898370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:23.898370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:23.898370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:23.898370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:23.898370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:23.898370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:23.898370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:23.898370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:23.898370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:23.898370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:23.898370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:23.899249 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:23.899249 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:23.899249 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:23.899249 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:23.902138 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 432/900] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:23.905144 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe10b8-4562-4b27-bc46-2e3e578617bf None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:23.932652 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:24.017136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe10b8-4562-4b27-bc46-2e3e578617bf None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:24.052985 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e28f8-e99b-44b3-9d1c-3b2489c37e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:24.053661 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e28f8-e99b-44b3-9d1c-3b2489c37e1e None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:24.053948 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e28f8-e99b-44b3-9d1c-3b2489c37e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:24.054227 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e28f8-e99b-44b3-9d1c-3b2489c37e1e None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:24.054952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e28f8-e99b-44b3-9d1c-3b2489c37e1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:24.055259 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e28f8-e99b-44b3-9d1c-3b2489c37e1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:24.056660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e28f8-e99b-44b3-9d1c-3b2489c37e1e None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:24.070094 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 469/901] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:24.075486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68741e2c-76d3-4b19-951e-ae797e8693a4 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:24.163491 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:24.191064 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68741e2c-76d3-4b19-951e-ae797e8693a4 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:24.227509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9983c7-386a-487e-bd6d-b8faf5e49f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:24.228556 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9983c7-386a-487e-bd6d-b8faf5e49f50 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:24.228817 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9983c7-386a-487e-bd6d-b8faf5e49f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:24.229086 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9983c7-386a-487e-bd6d-b8faf5e49f50 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:24.235464 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89727ec5-11b0-4948-999b-4911efa7a7d4 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:24.236077 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89727ec5-11b0-4948-999b-4911efa7a7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:24.236571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89727ec5-11b0-4948-999b-4911efa7a7d4 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:24.238604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 470/902] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:24.242481 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9983c7-386a-487e-bd6d-b8faf5e49f50 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:24.242481 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9983c7-386a-487e-bd6d-b8faf5e49f50 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:24.244588 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab77062-f532-48ad-875c-129c19cd6d6e None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:24.245301 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab77062-f532-48ad-875c-129c19cd6d6e None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:24.245774 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab77062-f532-48ad-875c-129c19cd6d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:24.258022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-be9983c7-386a-487e-bd6d-b8faf5e49f50 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 19:03:24.258022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:24.258022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:24.258022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:24.258022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:24.258022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:24.258022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:24.258022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:24.258022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:24.258022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:24.258022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:24.258022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:24.258022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:03:24.258022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:03:24.258022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:03:24.258022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:03:24.259011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:24.259011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:24.259011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:03:24.259011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:24.259011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:03:24.259011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:24.259011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:24.259011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:24.259011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:24.259011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:24.259011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:24.259011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:24.259011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:24.259011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:24.259011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:24.259011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:24.259011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:24.259011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:24.259942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:24.259942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:24.259942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:03:24.259942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:03:24.259942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:03:24.259942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:03:24.259942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:03:24.259942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:03:24.259942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 19:03:24.259942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:24.264019 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 433/903] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Jun 2 19:03:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:24.265427 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9983c7-386a-487e-bd6d-b8faf5e49f50 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:24.268545 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-dab77062-f532-48ad-875c-129c19cd6d6e None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:24.270109 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-dab77062-f532-48ad-875c-129c19cd6d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:24.355709 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 471/904] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 19:03:24.375646 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab77062-f532-48ad-875c-129c19cd6d6e None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:24.383745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9983c7-386a-487e-bd6d-b8faf5e49f50 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:24.392376 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:24.422414 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0d808-2458-4cb6-b605-8d67a7ed09af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:24.423143 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0d808-2458-4cb6-b605-8d67a7ed09af None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:24.423485 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0d808-2458-4cb6-b605-8d67a7ed09af None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:24.423789 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0d808-2458-4cb6-b605-8d67a7ed09af None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:24.424736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0d808-2458-4cb6-b605-8d67a7ed09af None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:24.425116 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0d808-2458-4cb6-b605-8d67a7ed09af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:24.426666 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0d808-2458-4cb6-b605-8d67a7ed09af None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:24.428757 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:24.446365 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 434/905] 10.222.0.45 () {56 vars in 1149 bytes} [Thu Jun 2 19:03:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:24.455378 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0d808-2458-4cb6-b605-8d67a7ed09af None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:24.505210 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab77062-f532-48ad-875c-129c19cd6d6e None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:24.554081 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b7ac4-2572-475c-b9c5-6a253a735e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:24.554831 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b7ac4-2572-475c-b9c5-6a253a735e83 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:24.555115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b7ac4-2572-475c-b9c5-6a253a735e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:24.555391 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b7ac4-2572-475c-b9c5-6a253a735e83 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:24.556167 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b7ac4-2572-475c-b9c5-6a253a735e83 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:24.557582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b7ac4-2572-475c-b9c5-6a253a735e83 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:24.571837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-c84b7ac4-2572-475c-b9c5-6a253a735e83 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 19:03:24.571837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:24.571837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 19:03:24.571837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 19:03:24.571837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 19:03:24.571837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 19:03:24.571837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 19:03:24.571837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:24.571837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 19:03:24.571837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:24.571837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:03:24.571837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:24.571837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:24.571837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:24.571837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:24.571837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:24.571837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:24.572956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:24.572956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:24.572956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:24.572956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:24.572956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:24.572956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:24.572956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 19:03:24.572956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 19:03:24.572956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 19:03:24.572956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 19:03:24.572956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:24.572956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:24.572956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:24.572956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:24.572956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:24.572956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:24.573805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:24.573805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:24.573805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:24.573805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:24.573805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:24.573805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:24.573805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:24.573805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:24.573805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:24.573805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:24.573805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 19:03:24.573805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:24.573805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 19:03:24.573805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:24.576750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 472/906] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jun 2 19:03:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:24.584045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b7ac4-2572-475c-b9c5-6a253a735e83 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:24.589504 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0d808-2458-4cb6-b605-8d67a7ed09af None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:24.636251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1971ccc-f5c6-4fe4-93f0-8a1b96863f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:24.637303 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1971ccc-f5c6-4fe4-93f0-8a1b96863f44 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:24.637595 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1971ccc-f5c6-4fe4-93f0-8a1b96863f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:24.637879 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1971ccc-f5c6-4fe4-93f0-8a1b96863f44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:24.673469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:24.704420 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b7ac4-2572-475c-b9c5-6a253a735e83 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:24.708537 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:24.711622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1971ccc-f5c6-4fe4-93f0-8a1b96863f44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:24.714323 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1971ccc-f5c6-4fe4-93f0-8a1b96863f44 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:24.746959 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7221bbe-3a64-4fe2-99da-889fbae4e653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:24.748364 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7221bbe-3a64-4fe2-99da-889fbae4e653 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:24.748642 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7221bbe-3a64-4fe2-99da-889fbae4e653 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:24.748916 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7221bbe-3a64-4fe2-99da-889fbae4e653 None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:24.750238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7221bbe-3a64-4fe2-99da-889fbae4e653 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:24.750552 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7221bbe-3a64-4fe2-99da-889fbae4e653 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:24.752475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7221bbe-3a64-4fe2-99da-889fbae4e653 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:24.762779 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 473/907] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jun 2 19:03:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:24.764438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7221bbe-3a64-4fe2-99da-889fbae4e653 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:24.860007 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 435/908] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:03:24 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 19:03:24.861714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1971ccc-f5c6-4fe4-93f0-8a1b96863f44 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:24.889178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7221bbe-3a64-4fe2-99da-889fbae4e653 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:24.929571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5e87b-44cb-4f40-b9f9-7a884ccb3cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:24.930254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5e87b-44cb-4f40-b9f9-7a884ccb3cbb None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:24.930541 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5e87b-44cb-4f40-b9f9-7a884ccb3cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:24.930821 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5e87b-44cb-4f40-b9f9-7a884ccb3cbb None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:24.931646 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5e87b-44cb-4f40-b9f9-7a884ccb3cbb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:24.931958 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5e87b-44cb-4f40-b9f9-7a884ccb3cbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:24.933510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5e87b-44cb-4f40-b9f9-7a884ccb3cbb None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:24.939675 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 474/909] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jun 2 19:03:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:24.949283 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5e87b-44cb-4f40-b9f9-7a884ccb3cbb None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:24.955178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:24.990556 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:25.002421 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1971ccc-f5c6-4fe4-93f0-8a1b96863f44 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:25.055443 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae5b1a-3143-46df-9942-aa71c4b47cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:25.056661 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae5b1a-3143-46df-9942-aa71c4b47cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:25.057281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae5b1a-3143-46df-9942-aa71c4b47cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:25.057757 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae5b1a-3143-46df-9942-aa71c4b47cc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:25.074135 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae5b1a-3143-46df-9942-aa71c4b47cc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:25.076599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae5b1a-3143-46df-9942-aa71c4b47cc4 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:25.080435 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5e87b-44cb-4f40-b9f9-7a884ccb3cbb None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:25.101115 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-84ae5b1a-3143-46df-9942-aa71c4b47cc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:25.101115 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:25.101115 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:25.101115 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:25.101115 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:25.101115 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:25.101115 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:25.101115 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:25.101115 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:25.101115 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:25.101115 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:25.101115 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:25.101115 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:25.101115 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:25.101115 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:25.102073 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:25.102073 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:25.102073 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:25.102073 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:25.102073 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:25.102073 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:25.102073 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:25.102073 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:25.102073 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:25.102073 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:25.102073 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:25.102073 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:25.102073 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:25.102073 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:25.102073 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:25.102073 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:25.102073 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:25.103049 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:25.103049 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:25.103049 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:25.103049 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:25.106052 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 436/910] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:25.113718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae5b1a-3143-46df-9942-aa71c4b47cc4 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:25.128428 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffe2dc-9ffb-48f2-bafe-1b3af59ceeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:25.129202 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffe2dc-9ffb-48f2-bafe-1b3af59ceeb3 None admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:25.129494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffe2dc-9ffb-48f2-bafe-1b3af59ceeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:25.129823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffe2dc-9ffb-48f2-bafe-1b3af59ceeb3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:25.130605 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffe2dc-9ffb-48f2-bafe-1b3af59ceeb3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:25.132355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffe2dc-9ffb-48f2-bafe-1b3af59ceeb3 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:25.224093 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 475/911] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Jun 2 19:03:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:25.243587 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae5b1a-3143-46df-9942-aa71c4b47cc4 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:25.293056 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c42c9-b621-4049-bba5-45a2c1a70a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:25.294094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c42c9-b621-4049-bba5-45a2c1a70a22 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:25.294587 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c42c9-b621-4049-bba5-45a2c1a70a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:25.295143 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c42c9-b621-4049-bba5-45a2c1a70a22 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:25.296087 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c42c9-b621-4049-bba5-45a2c1a70a22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:25.297259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c42c9-b621-4049-bba5-45a2c1a70a22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:25.298988 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c42c9-b621-4049-bba5-45a2c1a70a22 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:25.309483 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:25.314746 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 437/912] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:25.321371 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffe2dc-9ffb-48f2-bafe-1b3af59ceeb3 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:25.401520 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:25.452387 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffe2dc-9ffb-48f2-bafe-1b3af59ceeb3 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:25.473870 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d279baf-c21f-4d47-8feb-7e72dfceca8c None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:25.474408 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d279baf-c21f-4d47-8feb-7e72dfceca8c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:25.474408 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d279baf-c21f-4d47-8feb-7e72dfceca8c None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:25.476086 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 438/913] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:03:25.482074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d61e01-d5b0-47c9-a0de-4b296c534de9 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:25.482074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d61e01-d5b0-47c9-a0de-4b296c534de9 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:25.482074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d61e01-d5b0-47c9-a0de-4b296c534de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:25.497152 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e1bd5-0a68-41ec-b1de-5c5e6bdb068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:25.497522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e1bd5-0a68-41ec-b1de-5c5e6bdb068b None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:25.497799 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e1bd5-0a68-41ec-b1de-5c5e6bdb068b None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:25.498070 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e1bd5-0a68-41ec-b1de-5c5e6bdb068b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:25.505311 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-09d61e01-d5b0-47c9-a0de-4b296c534de9 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:25.506418 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-09d61e01-d5b0-47c9-a0de-4b296c534de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:25.506534 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e1bd5-0a68-41ec-b1de-5c5e6bdb068b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:25.507901 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e1bd5-0a68-41ec-b1de-5c5e6bdb068b None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:25.525972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-728e1bd5-0a68-41ec-b1de-5c5e6bdb068b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:25.525972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:25.525972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:25.525972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:25.525972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:25.525972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:25.525972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:25.525972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:25.525972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:25.525972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:25.525972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:25.525972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:25.525972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:03:25.525972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:03:25.525972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:03:25.526957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:03:25.526957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:25.526957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:25.526957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:25.526957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:25.526957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:25.526957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:25.526957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:25.526957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:25.526957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:25.526957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:25.526957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:25.526957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:25.526957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:25.526957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:25.526957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:25.526957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:25.528084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:03:25.528084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:03:25.528084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:03:25.528084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:03:25.528084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:03:25.528084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:03:25.528084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:25.528084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:25.528084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 476/914] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:03:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:25.533204 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e1bd5-0a68-41ec-b1de-5c5e6bdb068b None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:25.600273 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 439/915] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 19:03:25.635446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d61e01-d5b0-47c9-a0de-4b296c534de9 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:25.681050 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e1bd5-0a68-41ec-b1de-5c5e6bdb068b None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:25.724015 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:25.771257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715a004-365e-4bc3-8da2-573c36f95c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:25.771941 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715a004-365e-4bc3-8da2-573c36f95c78 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:25.772262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715a004-365e-4bc3-8da2-573c36f95c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:25.772537 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715a004-365e-4bc3-8da2-573c36f95c78 None admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:25.773329 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715a004-365e-4bc3-8da2-573c36f95c78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:25.773690 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715a004-365e-4bc3-8da2-573c36f95c78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:25.775094 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715a004-365e-4bc3-8da2-573c36f95c78 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:25.778968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d61e01-d5b0-47c9-a0de-4b296c534de9 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:25.816104 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:25.818613 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 477/916] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:03:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:25.827614 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715a004-365e-4bc3-8da2-573c36f95c78 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:25.832976 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ac9cf-122f-4d1b-85aa-7b075d8780cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:25.834157 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ac9cf-122f-4d1b-85aa-7b075d8780cc None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:25.834643 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ac9cf-122f-4d1b-85aa-7b075d8780cc None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:25.836166 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ac9cf-122f-4d1b-85aa-7b075d8780cc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:25.837281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ac9cf-122f-4d1b-85aa-7b075d8780cc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:25.839019 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ac9cf-122f-4d1b-85aa-7b075d8780cc None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:25.856900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-254ac9cf-122f-4d1b-85aa-7b075d8780cc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 19:03:25.856900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:25.856900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 19:03:25.856900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 19:03:25.856900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 19:03:25.856900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 19:03:25.856900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 19:03:25.856900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:25.856900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 19:03:25.856900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:25.856900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:03:25.856900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:25.856900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:25.856900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:25.856900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:25.856900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:25.857918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:25.857918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:25.857918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:25.857918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:25.857918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:25.857918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:25.857918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:25.857918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 19:03:25.857918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 19:03:25.857918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 19:03:25.857918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 19:03:25.857918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:25.857918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:25.857918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:25.857918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:25.857918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:25.858778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:25.858778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:25.858778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:25.858778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:25.858778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:25.858778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:25.858778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:25.858778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:25.858778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:25.858778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:25.858778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:25.858778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 19:03:25.858778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:25.858778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 19:03:25.858778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:25.862801 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 440/917] 10.222.0.45 () {56 vars in 1132 bytes} [Thu Jun 2 19:03:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:25.871593 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ac9cf-122f-4d1b-85aa-7b075d8780cc None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:26.008999 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715a004-365e-4bc3-8da2-573c36f95c78 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:26.062672 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9eaea3-65ee-4c99-85da-7e81151be646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:26.063381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9eaea3-65ee-4c99-85da-7e81151be646 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:26.063666 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9eaea3-65ee-4c99-85da-7e81151be646 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:26.064349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9eaea3-65ee-4c99-85da-7e81151be646 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:26.064823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9eaea3-65ee-4c99-85da-7e81151be646 None admin] RBAC: Adding query filter params (role.id=788c05993fb0458a9a2f4d2bd3cf9a34, scope.project.id=b11b7e66a993492d8163097bce955c0b, user.id=235042beafd246c5b227b3926098c8c8) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:26.065279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9eaea3-65ee-4c99-85da-7e81151be646 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:26.066797 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9eaea3-65ee-4c99-85da-7e81151be646 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:26.076745 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 478/918] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:03:25 2022] GET /identity/v3/role_assignments?user.id=235042beafd246c5b227b3926098c8c8&scope.project.id=b11b7e66a993492d8163097bce955c0b&role.id=788c05993fb0458a9a2f4d2bd3cf9a34 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:26.078827 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f824f9-b0d7-4f24-bc15-eab4b859a1ec None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:26.079403 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f824f9-b0d7-4f24-bc15-eab4b859a1ec None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:26.079514 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f824f9-b0d7-4f24-bc15-eab4b859a1ec None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:26.081125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 479/919] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:26.086860 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ca9cd-58d4-4cb7-99ce-e80b6096d0e9 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:26.087166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ca9cd-58d4-4cb7-99ce-e80b6096d0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:26.087427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ca9cd-58d4-4cb7-99ce-e80b6096d0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:26.089679 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ac9cf-122f-4d1b-85aa-7b075d8780cc None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:26.105530 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-964ca9cd-58d4-4cb7-99ce-e80b6096d0e9 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:26.106924 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-964ca9cd-58d4-4cb7-99ce-e80b6096d0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:26.144628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6845243-25a5-4089-97b1-c9dc370ca354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:26.145456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6845243-25a5-4089-97b1-c9dc370ca354 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:26.145810 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6845243-25a5-4089-97b1-c9dc370ca354 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:26.146157 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6845243-25a5-4089-97b1-c9dc370ca354 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:26.146959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6845243-25a5-4089-97b1-c9dc370ca354 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:26.147339 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6845243-25a5-4089-97b1-c9dc370ca354 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:26.148907 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6845243-25a5-4089-97b1-c9dc370ca354 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:26.155329 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 441/920] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Jun 2 19:03:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:26.161532 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6845243-25a5-4089-97b1-c9dc370ca354 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:26.173197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:26.216278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 480/921] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 19:03:26.234622 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ca9cd-58d4-4cb7-99ce-e80b6096d0e9 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:26.260824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:26.322165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6845243-25a5-4089-97b1-c9dc370ca354 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:26.372602 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657710c-be66-494d-a185-d47b4d3c26f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:26.373393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657710c-be66-494d-a185-d47b4d3c26f4 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:26.373750 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657710c-be66-494d-a185-d47b4d3c26f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:26.374258 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657710c-be66-494d-a185-d47b4d3c26f4 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:26.375562 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657710c-be66-494d-a185-d47b4d3c26f4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:26.375870 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657710c-be66-494d-a185-d47b4d3c26f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:26.377319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657710c-be66-494d-a185-d47b4d3c26f4 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:26.387983 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 442/922] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Jun 2 19:03:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:26.389352 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657710c-be66-494d-a185-d47b4d3c26f4 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:26.400910 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ca9cd-58d4-4cb7-99ce-e80b6096d0e9 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:26.453554 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55564051-8024-4d47-9b4c-59cfc3b46602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:26.454353 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55564051-8024-4d47-9b4c-59cfc3b46602 None admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:26.454639 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55564051-8024-4d47-9b4c-59cfc3b46602 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:26.454919 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55564051-8024-4d47-9b4c-59cfc3b46602 None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:26.456516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55564051-8024-4d47-9b4c-59cfc3b46602 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:26.458355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55564051-8024-4d47-9b4c-59cfc3b46602 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:26.511843 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657710c-be66-494d-a185-d47b4d3c26f4 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:26.556016 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 481/923] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jun 2 19:03:26 2022] POST /identity/v3/services => generated 241 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:03:26.558345 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:26.579458 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da7b27-cf7c-4eba-92eb-1e94ea1db2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:26.580190 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da7b27-cf7c-4eba-92eb-1e94ea1db2ca None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:26.580470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da7b27-cf7c-4eba-92eb-1e94ea1db2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:26.580746 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da7b27-cf7c-4eba-92eb-1e94ea1db2ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:26.581527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da7b27-cf7c-4eba-92eb-1e94ea1db2ca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:26.582996 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da7b27-cf7c-4eba-92eb-1e94ea1db2ca None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:26.715202 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 443/924] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Jun 2 19:03:26 2022] POST /identity/v3/endpoints => generated 347 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:03:27.763203 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058a144-b575-4849-8900-bf9aa17d558f None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:27.763727 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058a144-b575-4849-8900-bf9aa17d558f None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:27.763805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058a144-b575-4849-8900-bf9aa17d558f None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:27.765428 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 482/925] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:27.770968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ec72a-095f-4df5-843e-b0798ebcf39b None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:27.771420 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ec72a-095f-4df5-843e-b0798ebcf39b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:27.771614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ec72a-095f-4df5-843e-b0798ebcf39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:27.793142 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-5a9ec72a-095f-4df5-843e-b0798ebcf39b None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:27.794803 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5a9ec72a-095f-4df5-843e-b0798ebcf39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:27.877800 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 444/926] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:03:27.902153 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058a144-b575-4849-8900-bf9aa17d558f None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:27.944705 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:28.020283 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058a144-b575-4849-8900-bf9aa17d558f None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:28.059234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af96e2-11b8-48c8-9eaf-4658edadc482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:28.059921 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af96e2-11b8-48c8-9eaf-4658edadc482 None admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:28.060241 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af96e2-11b8-48c8-9eaf-4658edadc482 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:28.060489 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af96e2-11b8-48c8-9eaf-4658edadc482 None admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:28.061208 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af96e2-11b8-48c8-9eaf-4658edadc482 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:28.063319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af96e2-11b8-48c8-9eaf-4658edadc482 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:28.064768 dv-cinder-797608-28-smb devstack@keystone.service[80608]: WARNING keystone.server.flask.common [None req-c4af96e2-11b8-48c8-9eaf-4658edadc482 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 02 19:03:28.129622 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.sql.core [None req-c4af96e2-11b8-48c8-9eaf-4658edadc482 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 19:03:28.129622 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 02 19:03:28.129622 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [parameters: {'id': '2fd24122d4114399aad5760aedd4dc3b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 02 19:03:28.129622 dv-cinder-797608-28-smb devstack@keystone.service[80608]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80608) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 19:03:28.137764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-c4af96e2-11b8-48c8-9eaf-4658edadc482 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2fd24122d4114399aad5760aedd4dc3b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2fd24122d4114399aad5760aedd4dc3b. Jun 02 19:03:28.137764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:28.137764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 19:03:28.137764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 19:03:28.137764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 19:03:28.137764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 19:03:28.137764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 19:03:28.137764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 19:03:28.137764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 19:03:28.137764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application conn.query(q) Jun 02 19:03:28.137764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 19:03:28.137764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 19:03:28.137764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 19:03:28.139310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application result.read() Jun 02 19:03:28.139310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 19:03:28.139310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 19:03:28.139310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 19:03:28.139310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 19:03:28.139310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 19:03:28.139310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 19:03:28.139310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 19:03:28.139310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 19:03:28.139310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 19:03:28.139310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:28.139310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 19:03:28.139310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:28.139310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:28.139310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 19:03:28.139310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 19:03:28.139310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 02 19:03:28.139310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 02 19:03:28.141713 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 19:03:28.141713 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application next(self.gen) Jun 02 19:03:28.141713 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 19:03:28.141713 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application yield resource Jun 02 19:03:28.141713 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 19:03:28.141713 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application next(self.gen) Jun 02 19:03:28.141713 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 19:03:28.141713 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 19:03:28.141713 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 19:03:28.141713 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 19:03:28.141713 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 19:03:28.141713 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise self.value Jun 02 19:03:28.141713 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 19:03:28.141713 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 19:03:28.141713 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 19:03:28.141713 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application session.commit() Jun 02 19:03:28.141713 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 19:03:28.143280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 19:03:28.143280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 19:03:28.143280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 19:03:28.143280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 19:03:28.143280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self.session.flush() Jun 02 19:03:28.143280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 19:03:28.143280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 19:03:28.143280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 19:03:28.143280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 19:03:28.143280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 19:03:28.143280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application compat.raise_( Jun 02 19:03:28.143280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 19:03:28.143280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception Jun 02 19:03:28.143280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 19:03:28.143280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 19:03:28.143280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 19:03:28.143280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 19:03:28.146583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 19:03:28.146583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 19:03:28.146583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 19:03:28.146583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 19:03:28.146583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 02 19:03:28.146583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 02 19:03:28.146583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 19:03:28.146583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 19:03:28.146583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 19:03:28.146583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 19:03:28.146583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 19:03:28.146583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 19:03:28.146583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 19:03:28.146583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 19:03:28.146583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 19:03:28.149481 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 19:03:28.149481 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 19:03:28.149481 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception Jun 02 19:03:28.149481 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 19:03:28.149481 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 19:03:28.149481 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 19:03:28.149481 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 19:03:28.149481 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 19:03:28.149481 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 19:03:28.149481 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 19:03:28.149481 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application conn.query(q) Jun 02 19:03:28.149481 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 19:03:28.149481 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 19:03:28.149481 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 19:03:28.149481 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application result.read() Jun 02 19:03:28.149481 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 19:03:28.149481 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 19:03:28.152561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 19:03:28.152561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 19:03:28.152561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 19:03:28.152561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 19:03:28.152561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 19:03:28.152561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 19:03:28.152561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 19:03:28.152561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 02 19:03:28.152561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [parameters: {'id': '2fd24122d4114399aad5760aedd4dc3b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 02 19:03:28.152561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 19:03:28.152561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:28.152561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:03:28.152561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:28.152561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:28.152561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 02 19:03:28.155349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 02 19:03:28.155349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 19:03:28.155349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 19:03:28.155349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 02 19:03:28.155349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:28.155349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:03:28.155349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:28.155349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:28.155349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:28.155349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:28.155349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:28.155349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:28.155349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:28.155349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:28.155349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:28.155349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:28.155349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:28.158463 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:28.158463 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 02 19:03:28.158463 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 02 19:03:28.158463 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:28.158463 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:28.158463 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 02 19:03:28.158463 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 02 19:03:28.158463 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2fd24122d4114399aad5760aedd4dc3b. Jun 02 19:03:28.158463 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:28.158463 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 483/927] 10.222.0.45 () {60 vars in 1140 bytes} [Thu Jun 2 19:03:27 2022] POST /identity/v3/projects => generated 262 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:28.160357 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ec72a-095f-4df5-843e-b0798ebcf39b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:28.322529 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:28.328475 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ec72a-095f-4df5-843e-b0798ebcf39b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:28.390724 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12deec9e-89f0-441c-9f10-82cca713937f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:28.393219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12deec9e-89f0-441c-9f10-82cca713937f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:28.394478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12deec9e-89f0-441c-9f10-82cca713937f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:28.395303 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12deec9e-89f0-441c-9f10-82cca713937f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:28.408995 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12deec9e-89f0-441c-9f10-82cca713937f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:28.412070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12deec9e-89f0-441c-9f10-82cca713937f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:28.440139 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-12deec9e-89f0-441c-9f10-82cca713937f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:28.440139 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:28.440139 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:28.440139 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:28.440139 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:28.440139 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:28.440139 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:28.440139 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:28.440139 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:28.440139 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:28.440139 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:28.440139 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:28.440139 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:03:28.440139 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:03:28.440139 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:03:28.441828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:03:28.441828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:28.441828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:28.441828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:28.441828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:28.441828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:28.441828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:28.441828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:28.441828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:28.441828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:28.441828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:28.441828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:28.441828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:28.441828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:28.441828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:28.441828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:28.441828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:28.443555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:03:28.443555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:03:28.443555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:03:28.443555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:03:28.443555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:03:28.443555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:03:28.443555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:28.443555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:28.447374 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 445/928] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:03:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:28.453661 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af96e2-11b8-48c8-9eaf-4658edadc482 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:28.521149 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049454a1-a6e8-4995-920e-bebbe9940695 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:28.522274 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049454a1-a6e8-4995-920e-bebbe9940695 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:28.523045 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049454a1-a6e8-4995-920e-bebbe9940695 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:28.526207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 446/929] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:28.531613 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de6a19-e759-475e-bcba-b062f81e38aa None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:28.531979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de6a19-e759-475e-bcba-b062f81e38aa None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:28.532246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de6a19-e759-475e-bcba-b062f81e38aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:28.557731 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-e3de6a19-e759-475e-bcba-b062f81e38aa None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:28.560160 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e3de6a19-e759-475e-bcba-b062f81e38aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:28.560990 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:28.572519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af96e2-11b8-48c8-9eaf-4658edadc482 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:28.614972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11684d21-8194-41fa-b21c-4fb1672b23f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:28.615670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11684d21-8194-41fa-b21c-4fb1672b23f8 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:28.615956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11684d21-8194-41fa-b21c-4fb1672b23f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:28.616272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11684d21-8194-41fa-b21c-4fb1672b23f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:28.617051 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11684d21-8194-41fa-b21c-4fb1672b23f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:28.617361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11684d21-8194-41fa-b21c-4fb1672b23f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:28.619201 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11684d21-8194-41fa-b21c-4fb1672b23f8 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:28.644341 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 484/930] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Jun 2 19:03:28 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:28.700145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 447/931] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 19:03:28.723058 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11684d21-8194-41fa-b21c-4fb1672b23f8 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:28.862363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11684d21-8194-41fa-b21c-4fb1672b23f8 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:28.906380 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da4835-c0cf-421c-96d0-6da9c54487c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:28.907162 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da4835-c0cf-421c-96d0-6da9c54487c3 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:28.907448 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da4835-c0cf-421c-96d0-6da9c54487c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:28.907725 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da4835-c0cf-421c-96d0-6da9c54487c3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:28.921681 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da4835-c0cf-421c-96d0-6da9c54487c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:03:28.930589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-d2da4835-c0cf-421c-96d0-6da9c54487c3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 19:03:28.930589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:28.930589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:28.930589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:28.930589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:28.930589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:28.930589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:28.930589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:28.930589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:28.930589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:28.930589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:28.930589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:28.930589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:03:28.930589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:03:28.930589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:03:28.930589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:03:28.931626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:03:28.931626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:03:28.931626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:03:28.931626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:03:28.931626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:28.931626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:28.931626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:28.931626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:28.931626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:28.931626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:28.931626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:28.931626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:28.931626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:28.931626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:28.931626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:28.931626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:28.932572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:28.932572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:28.932572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:28.932572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:28.932572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:03:28.932572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:03:28.932572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:03:28.932572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:03:28.932572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:03:28.932572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:03:28.932572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 19:03:28.932572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:28.932572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 485/932] 10.222.0.45 () {56 vars in 1120 bytes} [Thu Jun 2 19:03:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:28.938741 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de6a19-e759-475e-bcba-b062f81e38aa None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:28.949235 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f086fc1-32bc-47df-a5b9-babf21b486ce None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:28.949562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f086fc1-32bc-47df-a5b9-babf21b486ce None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:28.949838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f086fc1-32bc-47df-a5b9-babf21b486ce None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:28.951802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 486/933] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:28.958311 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb1238-264d-4fda-8800-098a2616e5ed None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:28.958607 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb1238-264d-4fda-8800-098a2616e5ed None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:28.959727 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb1238-264d-4fda-8800-098a2616e5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:28.980727 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-d6fb1238-264d-4fda-8800-098a2616e5ed None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:28.982606 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-d6fb1238-264d-4fda-8800-098a2616e5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:28.986952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:29.064230 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:29.077741 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de6a19-e759-475e-bcba-b062f81e38aa None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:29.096315 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 487/934] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 19:03:29.118191 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb1238-264d-4fda-8800-098a2616e5ed None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:29.120408 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967e194-b577-42ba-81a4-b90f17a40742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:29.121106 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967e194-b577-42ba-81a4-b90f17a40742 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:29.121407 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967e194-b577-42ba-81a4-b90f17a40742 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:29.121785 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967e194-b577-42ba-81a4-b90f17a40742 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:29.122423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967e194-b577-42ba-81a4-b90f17a40742 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:29.122731 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967e194-b577-42ba-81a4-b90f17a40742 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:29.124174 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967e194-b577-42ba-81a4-b90f17a40742 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:29.134373 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 448/935] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Jun 2 19:03:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:29.140226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967e194-b577-42ba-81a4-b90f17a40742 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:29.254233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb1238-264d-4fda-8800-098a2616e5ed None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:29.271176 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967e194-b577-42ba-81a4-b90f17a40742 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:29.302285 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bffed-7743-425b-9cf1-2652bee9cd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:29.303127 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bffed-7743-425b-9cf1-2652bee9cd9e None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:29.303421 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bffed-7743-425b-9cf1-2652bee9cd9e None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:29.303764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bffed-7743-425b-9cf1-2652bee9cd9e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:29.304492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bffed-7743-425b-9cf1-2652bee9cd9e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:29.305879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bffed-7743-425b-9cf1-2652bee9cd9e None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:29.314119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa0716-1168-4534-bb3b-422ab45ccbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:29.314918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa0716-1168-4534-bb3b-422ab45ccbe6 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:29.315197 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa0716-1168-4534-bb3b-422ab45ccbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:29.315470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa0716-1168-4534-bb3b-422ab45ccbe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:29.318741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-264bffed-7743-425b-9cf1-2652bee9cd9e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 19:03:29.318741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:29.318741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 19:03:29.318741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 19:03:29.318741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 19:03:29.318741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 19:03:29.318741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 19:03:29.318741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:29.318741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 19:03:29.318741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:29.318741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:03:29.318741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:29.318741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:29.318741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:29.318741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:29.318741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:29.318741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:29.319737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:29.319737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:29.319737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:29.319737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:29.319737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:29.319737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:29.319737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 19:03:29.319737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 19:03:29.319737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 19:03:29.319737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 19:03:29.319737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:29.319737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:29.319737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:29.319737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:29.319737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:29.319737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:29.325281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:29.325281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:29.325281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:29.325281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:29.325281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:29.325281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:29.325281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:29.325281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:29.325281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:29.325281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:29.325281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 19:03:29.325281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:29.325281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 19:03:29.325281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:29.325281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 488/936] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Jun 2 19:03:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:29.326131 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404cad5-7b6e-433a-8ebd-52badffa1f09 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:29.326131 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404cad5-7b6e-433a-8ebd-52badffa1f09 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:29.326131 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404cad5-7b6e-433a-8ebd-52badffa1f09 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:29.326131 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 489/937] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:29.327601 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404cad5-7b6e-433a-8ebd-52badffa1f09 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:29.332711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa0716-1168-4534-bb3b-422ab45ccbe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:29.333163 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:29.333579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa0716-1168-4534-bb3b-422ab45ccbe6 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:29.353478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-8faa0716-1168-4534-bb3b-422ab45ccbe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:29.353478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:29.353478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:29.353478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:29.353478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:29.353478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:29.353478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:29.353478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:29.353478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:29.353478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:29.353478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:29.353478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:29.353478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:29.353478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:29.353478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:29.354470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:29.354470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:29.354470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:29.354470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:29.354470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:29.354470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:29.354470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:29.354470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:29.354470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:29.354470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:29.354470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:29.354470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:29.354470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:29.354470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:29.354470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:29.354470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:29.354470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:29.355462 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:29.355462 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:29.355462 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:29.355462 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:29.355462 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 449/938] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:29.356053 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a40d5f-60be-4819-9c4f-0671c74463e4 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:29.356315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a40d5f-60be-4819-9c4f-0671c74463e4 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:29.356716 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a40d5f-60be-4819-9c4f-0671c74463e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:29.363943 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:29.374600 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-29a40d5f-60be-4819-9c4f-0671c74463e4 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:29.375817 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-29a40d5f-60be-4819-9c4f-0671c74463e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:29.451206 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 450/939] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:03:29.451436 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404cad5-7b6e-433a-8ebd-52badffa1f09 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:29.453516 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a40d5f-60be-4819-9c4f-0671c74463e4 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:29.501382 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919f310-6170-47e8-8998-2931189de43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:29.502060 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919f310-6170-47e8-8998-2931189de43c None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:29.502344 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919f310-6170-47e8-8998-2931189de43c None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:29.502625 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919f310-6170-47e8-8998-2931189de43c None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:29.503343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919f310-6170-47e8-8998-2931189de43c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:29.503651 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919f310-6170-47e8-8998-2931189de43c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:29.505151 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919f310-6170-47e8-8998-2931189de43c None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:29.510470 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 490/940] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Jun 2 19:03:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:29.511282 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919f310-6170-47e8-8998-2931189de43c None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:29.578113 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a40d5f-60be-4819-9c4f-0671c74463e4 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:29.586708 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:29.622276 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b27ed7-6623-4498-bbab-f9b5aeb012f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:29.623211 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b27ed7-6623-4498-bbab-f9b5aeb012f6 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:29.623672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b27ed7-6623-4498-bbab-f9b5aeb012f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:29.623817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919f310-6170-47e8-8998-2931189de43c None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:29.624281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b27ed7-6623-4498-bbab-f9b5aeb012f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:29.625190 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b27ed7-6623-4498-bbab-f9b5aeb012f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:29.625784 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b27ed7-6623-4498-bbab-f9b5aeb012f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:29.628197 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b27ed7-6623-4498-bbab-f9b5aeb012f6 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:29.629997 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:29.647610 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 451/941] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:29.647610 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b27ed7-6623-4498-bbab-f9b5aeb012f6 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:29.664239 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d96a4-91fa-4ead-a4ff-9409c656ad5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:29.665044 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d96a4-91fa-4ead-a4ff-9409c656ad5e None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:29.665335 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d96a4-91fa-4ead-a4ff-9409c656ad5e None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:29.665615 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d96a4-91fa-4ead-a4ff-9409c656ad5e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:29.666287 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d96a4-91fa-4ead-a4ff-9409c656ad5e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:29.667678 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d96a4-91fa-4ead-a4ff-9409c656ad5e None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:29.680408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-a00d96a4-91fa-4ead-a4ff-9409c656ad5e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 19:03:29.680408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:29.680408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 19:03:29.680408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 19:03:29.680408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 19:03:29.680408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 19:03:29.680408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 19:03:29.680408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:29.680408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 19:03:29.680408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:29.680408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:03:29.680408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:29.680408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:29.680408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:29.680408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:29.680408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:29.680408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:29.681430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:29.681430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:29.681430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:29.681430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:29.681430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:29.681430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:29.681430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 19:03:29.681430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 19:03:29.681430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 19:03:29.681430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 19:03:29.681430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:29.681430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:29.681430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:29.681430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:29.681430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:29.681430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:29.682313 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:29.682313 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:29.682313 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:29.682313 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:29.682313 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:29.682313 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:29.682313 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:29.682313 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:29.682313 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:29.682313 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:29.682313 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 19:03:29.682313 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:29.682313 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 19:03:29.682313 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:29.682313 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 491/942] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:03:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:29.683120 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d96a4-91fa-4ead-a4ff-9409c656ad5e None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:29.770908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b27ed7-6623-4498-bbab-f9b5aeb012f6 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:29.804747 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d96a4-91fa-4ead-a4ff-9409c656ad5e None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:29.813518 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d12f6a-fafe-4685-bb08-01bbd052e35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:29.814573 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d12f6a-fafe-4685-bb08-01bbd052e35d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:29.815002 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d12f6a-fafe-4685-bb08-01bbd052e35d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:29.815439 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d12f6a-fafe-4685-bb08-01bbd052e35d None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:29.816379 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d12f6a-fafe-4685-bb08-01bbd052e35d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:29.816846 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d12f6a-fafe-4685-bb08-01bbd052e35d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:29.818501 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d12f6a-fafe-4685-bb08-01bbd052e35d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:29.824215 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 452/943] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Jun 2 19:03:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:29.825332 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d12f6a-fafe-4685-bb08-01bbd052e35d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:29.840341 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:29.846303 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ad80a-be5f-483b-832c-2befbd671375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:29.847132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ad80a-be5f-483b-832c-2befbd671375 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:29.847406 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ad80a-be5f-483b-832c-2befbd671375 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:29.847680 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ad80a-be5f-483b-832c-2befbd671375 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:29.856096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ad80a-be5f-483b-832c-2befbd671375 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:29.857559 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ad80a-be5f-483b-832c-2befbd671375 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:29.873536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-554ad80a-be5f-483b-832c-2befbd671375 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 19:03:29.873536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:29.873536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:29.873536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:29.873536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:29.873536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:29.873536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:29.873536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:29.873536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:29.873536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:29.873536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:29.873536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:29.873536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:03:29.873536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:03:29.873536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:03:29.873536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:03:29.875633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:29.875633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:29.875633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:03:29.875633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:29.875633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:03:29.875633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:29.875633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:29.875633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:29.875633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:29.875633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:29.875633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:29.875633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:29.875633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:29.875633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:29.875633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:29.875633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:29.875633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:29.875633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:29.876917 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:29.876917 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:29.876917 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:03:29.876917 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:03:29.876917 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:03:29.876917 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:03:29.876917 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:03:29.876917 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:03:29.876917 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 19:03:29.876917 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:29.880157 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 492/944] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Jun 2 19:03:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:29.881539 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ad80a-be5f-483b-832c-2befbd671375 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:29.896502 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:29.946782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d12f6a-fafe-4685-bb08-01bbd052e35d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:29.984347 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c966f-6f7f-4fb0-944c-265f8a2815f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:29.985179 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c966f-6f7f-4fb0-944c-265f8a2815f7 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:29.985605 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c966f-6f7f-4fb0-944c-265f8a2815f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:29.985605 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c966f-6f7f-4fb0-944c-265f8a2815f7 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:29.986283 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c966f-6f7f-4fb0-944c-265f8a2815f7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:29.986594 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c966f-6f7f-4fb0-944c-265f8a2815f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:29.987965 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c966f-6f7f-4fb0-944c-265f8a2815f7 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:29.993319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 453/945] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Jun 2 19:03:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:29.994226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c966f-6f7f-4fb0-944c-265f8a2815f7 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:30.004178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ad80a-be5f-483b-832c-2befbd671375 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:30.049718 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eac4ba-c69d-454f-8cb2-f72f5e8a5b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:30.051062 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eac4ba-c69d-454f-8cb2-f72f5e8a5b12 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:30.051359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eac4ba-c69d-454f-8cb2-f72f5e8a5b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:30.051640 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eac4ba-c69d-454f-8cb2-f72f5e8a5b12 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:30.052494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eac4ba-c69d-454f-8cb2-f72f5e8a5b12 None admin] RBAC: Adding query filter params (interface=public, service_id=4218be50bcf94efc9d8308993ffd80a1, region_id=RegionOne) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:30.052812 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eac4ba-c69d-454f-8cb2-f72f5e8a5b12 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:30.054330 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eac4ba-c69d-454f-8cb2-f72f5e8a5b12 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:30.064645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 493/946] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Jun 2 19:03:29 2022] GET /identity/v3/endpoints?service_id=4218be50bcf94efc9d8308993ffd80a1&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:30.064645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eac4ba-c69d-454f-8cb2-f72f5e8a5b12 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:30.110816 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c966f-6f7f-4fb0-944c-265f8a2815f7 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:30.125526 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:30.135182 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:30.149252 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4eda23-f420-49f2-bb0a-abf3fa3e2b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:30.149952 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4eda23-f420-49f2-bb0a-abf3fa3e2b33 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:30.150237 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4eda23-f420-49f2-bb0a-abf3fa3e2b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:30.150516 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4eda23-f420-49f2-bb0a-abf3fa3e2b33 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:30.151382 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4eda23-f420-49f2-bb0a-abf3fa3e2b33 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:30.151695 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4eda23-f420-49f2-bb0a-abf3fa3e2b33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:30.153263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4eda23-f420-49f2-bb0a-abf3fa3e2b33 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:30.173088 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 454/947] 10.222.0.45 () {56 vars in 1149 bytes} [Thu Jun 2 19:03:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:30.174218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4eda23-f420-49f2-bb0a-abf3fa3e2b33 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:30.185045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eac4ba-c69d-454f-8cb2-f72f5e8a5b12 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:30.222541 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e2763-f035-4640-9805-0ddba089c3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:30.223551 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e2763-f035-4640-9805-0ddba089c3bb None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:30.224084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e2763-f035-4640-9805-0ddba089c3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:30.224420 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e2763-f035-4640-9805-0ddba089c3bb None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:30.225525 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e2763-f035-4640-9805-0ddba089c3bb None admin] RBAC: Adding query filter params (type=compute) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:30.225846 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e2763-f035-4640-9805-0ddba089c3bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:30.227570 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e2763-f035-4640-9805-0ddba089c3bb None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:30.232536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 494/948] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Jun 2 19:03:30 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:30.237758 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e2763-f035-4640-9805-0ddba089c3bb None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:30.297002 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4eda23-f420-49f2-bb0a-abf3fa3e2b33 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:30.342350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfc538-4f20-4767-b2d4-97f1499f6135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:30.343120 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfc538-4f20-4767-b2d4-97f1499f6135 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:30.344053 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfc538-4f20-4767-b2d4-97f1499f6135 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:30.344342 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfc538-4f20-4767-b2d4-97f1499f6135 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:30.345101 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfc538-4f20-4767-b2d4-97f1499f6135 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:30.346608 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfc538-4f20-4767-b2d4-97f1499f6135 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:30.360544 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 455/949] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Jun 2 19:03:30 2022] GET /identity/v3/services => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:03:30.402908 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e2763-f035-4640-9805-0ddba089c3bb None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:30.431844 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:30.452901 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d166a8-4163-4825-83e6-df8dcd368f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:30.454148 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d166a8-4163-4825-83e6-df8dcd368f5f None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:30.454653 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d166a8-4163-4825-83e6-df8dcd368f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:30.455156 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d166a8-4163-4825-83e6-df8dcd368f5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:30.469549 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d166a8-4163-4825-83e6-df8dcd368f5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:30.471156 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d166a8-4163-4825-83e6-df8dcd368f5f None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:30.493187 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-43d166a8-4163-4825-83e6-df8dcd368f5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:30.493187 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:30.493187 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:30.493187 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:30.493187 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:30.493187 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:30.493187 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:30.493187 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:30.493187 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:30.493187 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:30.493187 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:30.493187 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:30.493187 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:30.493187 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:30.493187 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:30.494212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:30.494212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:30.494212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:30.494212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:30.494212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:30.494212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:30.494212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:30.494212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:30.494212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:30.494212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:30.494212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:30.494212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:30.494212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:30.494212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:30.494212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:30.494212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:30.494212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:30.495231 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:30.495231 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:30.495231 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:30.495231 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:30.495231 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 495/950] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:30.500855 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfc538-4f20-4767-b2d4-97f1499f6135 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:30.561069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:30.627175 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfc538-4f20-4767-b2d4-97f1499f6135 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:30.665502 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b365289-c7f0-45dd-8452-214711c7fb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:30.666239 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b365289-c7f0-45dd-8452-214711c7fb19 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:30.666527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b365289-c7f0-45dd-8452-214711c7fb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:30.666809 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b365289-c7f0-45dd-8452-214711c7fb19 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:30.667550 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b365289-c7f0-45dd-8452-214711c7fb19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:30.667857 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b365289-c7f0-45dd-8452-214711c7fb19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:30.669288 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b365289-c7f0-45dd-8452-214711c7fb19 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:30.682537 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 456/951] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:30.688717 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d166a8-4163-4825-83e6-df8dcd368f5f None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:30.806112 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d166a8-4163-4825-83e6-df8dcd368f5f None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:30.844149 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05a43b-1605-41ef-bf02-4a2c3fd83f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:30.845008 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05a43b-1605-41ef-bf02-4a2c3fd83f86 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:30.845295 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05a43b-1605-41ef-bf02-4a2c3fd83f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:30.845574 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05a43b-1605-41ef-bf02-4a2c3fd83f86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:30.852970 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05a43b-1605-41ef-bf02-4a2c3fd83f86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:30.854468 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05a43b-1605-41ef-bf02-4a2c3fd83f86 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:30.871002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-9d05a43b-1605-41ef-bf02-4a2c3fd83f86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:30.871002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:30.871002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:30.871002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:30.871002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:30.871002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:30.871002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:30.871002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:30.871002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:30.871002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:30.871002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:30.871002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:30.871002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:03:30.871002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:03:30.871002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:03:30.872234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:03:30.872234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:30.872234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:30.872234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:30.872234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:30.872234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:30.872234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:30.872234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:30.872234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:30.872234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:30.872234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:30.872234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:30.872234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:30.872234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:30.872234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:30.872234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:30.872234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:30.873192 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:03:30.873192 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:03:30.873192 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:03:30.873192 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:03:30.873192 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:03:30.873192 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:03:30.873192 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:30.873192 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:30.873192 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 496/952] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:03:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:30.881614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b365289-c7f0-45dd-8452-214711c7fb19 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:31.001743 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b365289-c7f0-45dd-8452-214711c7fb19 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:31.004278 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:31.040075 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f66a8-6ad6-42ea-91eb-68ad038fc4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:31.040745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f66a8-6ad6-42ea-91eb-68ad038fc4cc None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:31.041026 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f66a8-6ad6-42ea-91eb-68ad038fc4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:31.041297 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f66a8-6ad6-42ea-91eb-68ad038fc4cc None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:31.042174 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f66a8-6ad6-42ea-91eb-68ad038fc4cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:31.042492 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f66a8-6ad6-42ea-91eb-68ad038fc4cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:31.043926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f66a8-6ad6-42ea-91eb-68ad038fc4cc None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:31.059526 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 457/953] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:03:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:31.069111 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05a43b-1605-41ef-bf02-4a2c3fd83f86 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:31.105587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:31.132367 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3fe1b-53df-451c-850f-c984044d6efe None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:31.132545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3fe1b-53df-451c-850f-c984044d6efe None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:31.132830 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3fe1b-53df-451c-850f-c984044d6efe None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:31.135083 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 458/954] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:03:31.145204 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915ae29-bfae-479e-8fff-f09be333c3ed None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:31.145685 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915ae29-bfae-479e-8fff-f09be333c3ed None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:31.146037 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915ae29-bfae-479e-8fff-f09be333c3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:31.170925 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-4915ae29-bfae-479e-8fff-f09be333c3ed None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:31.173035 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4915ae29-bfae-479e-8fff-f09be333c3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:31.198469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05a43b-1605-41ef-bf02-4a2c3fd83f86 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:31.241171 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5acbf-361a-4da3-8b1e-fc30c1e71e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:31.242155 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5acbf-361a-4da3-8b1e-fc30c1e71e88 None admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:31.242956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5acbf-361a-4da3-8b1e-fc30c1e71e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:31.243444 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5acbf-361a-4da3-8b1e-fc30c1e71e88 None admin] PATH_INFO: `/v3/projects/b11b7e66a993492d8163097bce955c0b/users/235042beafd246c5b227b3926098c8c8/roles/788c05993fb0458a9a2f4d2bd3cf9a34` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:31.247916 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5acbf-361a-4da3-8b1e-fc30c1e71e88 None admin] RBAC: Authorizing `identity:create_grant(project_id=b11b7e66a993492d8163097bce955c0b, user_id=235042beafd246c5b227b3926098c8c8, role_id=788c05993fb0458a9a2f4d2bd3cf9a34)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:31.251001 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5acbf-361a-4da3-8b1e-fc30c1e71e88 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:31.263629 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 459/955] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:03:31.289729 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915ae29-bfae-479e-8fff-f09be333c3ed None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:31.382935 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 497/956] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jun 2 19:03:31 2022] PUT /identity/v3/projects/b11b7e66a993492d8163097bce955c0b/users/235042beafd246c5b227b3926098c8c8/roles/788c05993fb0458a9a2f4d2bd3cf9a34 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:31.396331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:31.404283 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915ae29-bfae-479e-8fff-f09be333c3ed None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:31.445712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f48b2-13c9-46cd-bf4b-a8b7f0fa8a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:31.446413 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f48b2-13c9-46cd-bf4b-a8b7f0fa8a46 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:31.446701 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f48b2-13c9-46cd-bf4b-a8b7f0fa8a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:31.446984 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f48b2-13c9-46cd-bf4b-a8b7f0fa8a46 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:31.447773 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f48b2-13c9-46cd-bf4b-a8b7f0fa8a46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:31.450000 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f48b2-13c9-46cd-bf4b-a8b7f0fa8a46 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:31.451830 dv-cinder-797608-28-smb devstack@keystone.service[80609]: WARNING keystone.server.flask.common [None req-c17f48b2-13c9-46cd-bf4b-a8b7f0fa8a46 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 02 19:03:31.506956 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.sql.core [None req-c17f48b2-13c9-46cd-bf4b-a8b7f0fa8a46 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 19:03:31.506956 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 02 19:03:31.506956 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [parameters: {'user_id': '1626c69ea0954964952ee070d440374b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 02 19:03:31.506956 dv-cinder-797608-28-smb devstack@keystone.service[80609]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80609) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 19:03:31.525259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-c17f48b2-13c9-46cd-bf4b-a8b7f0fa8a46 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 02 19:03:31.525259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:31.525259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 19:03:31.525259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 19:03:31.525259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 19:03:31.525259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 19:03:31.525259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 19:03:31.525259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 19:03:31.525259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 19:03:31.525259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application conn.query(q) Jun 02 19:03:31.525259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 19:03:31.525259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 19:03:31.525259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 19:03:31.525259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application result.read() Jun 02 19:03:31.525259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 19:03:31.526232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 19:03:31.526232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 19:03:31.526232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 19:03:31.526232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 19:03:31.526232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 19:03:31.526232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 19:03:31.526232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 19:03:31.526232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 19:03:31.526232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:31.526232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 19:03:31.526232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:31.526232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:31.526232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 19:03:31.526232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 19:03:31.526232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 02 19:03:31.526232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 02 19:03:31.526232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 19:03:31.526232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application next(self.gen) Jun 02 19:03:31.527218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 19:03:31.527218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application yield resource Jun 02 19:03:31.527218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 19:03:31.527218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application next(self.gen) Jun 02 19:03:31.527218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 19:03:31.527218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 19:03:31.527218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 19:03:31.527218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 19:03:31.527218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 19:03:31.527218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise self.value Jun 02 19:03:31.527218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 19:03:31.527218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 19:03:31.527218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 19:03:31.527218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application session.commit() Jun 02 19:03:31.527218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 19:03:31.527218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 19:03:31.527218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 19:03:31.528180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 19:03:31.528180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 19:03:31.528180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self.session.flush() Jun 02 19:03:31.528180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 19:03:31.528180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 19:03:31.528180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 19:03:31.528180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 19:03:31.528180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 19:03:31.528180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application compat.raise_( Jun 02 19:03:31.528180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 19:03:31.528180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception Jun 02 19:03:31.528180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 19:03:31.528180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 19:03:31.528180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 19:03:31.528180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 19:03:31.528180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 19:03:31.528180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 19:03:31.529705 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 19:03:31.529705 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 19:03:31.529705 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 02 19:03:31.529705 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 02 19:03:31.529705 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 19:03:31.529705 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 19:03:31.529705 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 19:03:31.529705 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 19:03:31.529705 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 19:03:31.529705 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 19:03:31.529705 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 19:03:31.529705 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 19:03:31.529705 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 19:03:31.529705 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 19:03:31.529705 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 19:03:31.529705 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception Jun 02 19:03:31.532112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 19:03:31.532112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 19:03:31.532112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 19:03:31.532112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 19:03:31.532112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 19:03:31.532112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 19:03:31.532112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 19:03:31.532112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application conn.query(q) Jun 02 19:03:31.532112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 19:03:31.532112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 19:03:31.532112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 19:03:31.532112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application result.read() Jun 02 19:03:31.532112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 19:03:31.532112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 19:03:31.532112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 19:03:31.532112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 19:03:31.534201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 19:03:31.534201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 19:03:31.534201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 19:03:31.534201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 19:03:31.534201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 19:03:31.534201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 02 19:03:31.534201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [parameters: {'user_id': '1626c69ea0954964952ee070d440374b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 02 19:03:31.534201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 19:03:31.534201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:31.534201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:03:31.534201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:31.534201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:31.534201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:31.534201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:31.534201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:31.537744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:31.537744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:31.537744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:31.537744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:31.537744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:31.537744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:31.537744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:31.537744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 02 19:03:31.537744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 02 19:03:31.537744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:31.537744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:31.537744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:03:31.537744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:31.537744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:03:31.537744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:31.537744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 02 19:03:31.537744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 02 19:03:31.539897 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 02 19:03:31.539897 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 02 19:03:31.539897 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 19:03:31.539897 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 19:03:31.539897 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 02 19:03:31.539897 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:31.539897 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 460/957] 10.222.0.45 () {60 vars in 1131 bytes} [Thu Jun 2 19:03:31 2022] POST /identity/v3/users => generated 160 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:31.541396 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5acbf-361a-4da3-8b1e-fc30c1e71e88 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:31.667100 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:31.679448 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5acbf-361a-4da3-8b1e-fc30c1e71e88 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:31.716430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46c12b-474d-489e-a402-39983441b5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:31.719862 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46c12b-474d-489e-a402-39983441b5eb None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:31.719862 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46c12b-474d-489e-a402-39983441b5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:31.719862 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46c12b-474d-489e-a402-39983441b5eb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:31.731934 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46c12b-474d-489e-a402-39983441b5eb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:31.733527 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46c12b-474d-489e-a402-39983441b5eb None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:31.750820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-0b46c12b-474d-489e-a402-39983441b5eb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 19:03:31.750820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:31.750820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:31.750820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:31.750820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:31.750820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:31.750820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:31.750820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:31.750820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:31.750820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:31.750820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:31.750820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:31.750820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:03:31.750820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:03:31.750820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:03:31.750820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:03:31.751913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:31.751913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:31.751913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:03:31.751913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:31.751913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:03:31.751913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:31.751913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:31.751913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:31.751913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:31.751913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:31.751913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:31.751913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:31.751913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:31.751913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:31.751913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:31.751913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:31.751913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:31.751913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:31.753419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:31.753419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:31.753419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:03:31.753419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:03:31.753419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:03:31.753419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:03:31.753419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:03:31.753419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:03:31.753419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 19:03:31.753419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:31.753419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 498/958] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:03:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:31.758208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f48b2-13c9-46cd-bf4b-a8b7f0fa8a46 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:31.869981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f48b2-13c9-46cd-bf4b-a8b7f0fa8a46 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:31.911155 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638b158-d70c-4828-98c5-b66f6584e2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:31.911836 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638b158-d70c-4828-98c5-b66f6584e2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:31.912152 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638b158-d70c-4828-98c5-b66f6584e2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:31.912435 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638b158-d70c-4828-98c5-b66f6584e2f2 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:31.913253 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638b158-d70c-4828-98c5-b66f6584e2f2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:31.913564 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638b158-d70c-4828-98c5-b66f6584e2f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:31.915310 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638b158-d70c-4828-98c5-b66f6584e2f2 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:31.962474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 461/959] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jun 2 19:03:31 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:32.689007 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96779375-64c2-422e-a850-6973daf5f18e None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:32.689625 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96779375-64c2-422e-a850-6973daf5f18e None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:32.689625 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96779375-64c2-422e-a850-6973daf5f18e None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:32.691018 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 499/960] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:32.696881 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55e7aa-98e5-44d8-bc65-a52a4bf6c3ca None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:32.697397 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55e7aa-98e5-44d8-bc65-a52a4bf6c3ca None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:32.697491 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55e7aa-98e5-44d8-bc65-a52a4bf6c3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:32.715478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-bb55e7aa-98e5-44d8-bc65-a52a4bf6c3ca None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:32.717329 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-bb55e7aa-98e5-44d8-bc65-a52a4bf6c3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:32.728468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:32.799508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 462/961] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:03:32.822633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96779375-64c2-422e-a850-6973daf5f18e None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:32.844667 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99e430-9aba-4690-b620-d6345595a4d4 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:32.845008 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99e430-9aba-4690-b620-d6345595a4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:32.845238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99e430-9aba-4690-b620-d6345595a4d4 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:32.846651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 463/962] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:03:32.853039 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca728e2-8705-49d0-8daa-a84df63f11f9 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:32.853598 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca728e2-8705-49d0-8daa-a84df63f11f9 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:32.853881 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca728e2-8705-49d0-8daa-a84df63f11f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:32.872304 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-dca728e2-8705-49d0-8daa-a84df63f11f9 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:32.873503 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-dca728e2-8705-49d0-8daa-a84df63f11f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:32.946511 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96779375-64c2-422e-a850-6973daf5f18e None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:32.954860 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 464/963] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 19:03:32.977597 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca728e2-8705-49d0-8daa-a84df63f11f9 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:32.986967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cc18a-4caa-4675-baa4-2c1937c1caa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:32.987687 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cc18a-4caa-4675-baa4-2c1937c1caa8 None admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:32.988861 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cc18a-4caa-4675-baa4-2c1937c1caa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:32.989227 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cc18a-4caa-4675-baa4-2c1937c1caa8 None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:32.989971 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489cc18a-4caa-4675-baa4-2c1937c1caa8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:32.991406 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489cc18a-4caa-4675-baa4-2c1937c1caa8 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:33.058342 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:33.088031 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 500/964] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jun 2 19:03:32 2022] POST /identity/v3/services => generated 242 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:33.094110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca728e2-8705-49d0-8daa-a84df63f11f9 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:33.153225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b5793-7728-4a1a-a865-02806ff8d022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:33.154133 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b5793-7728-4a1a-a865-02806ff8d022 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:33.154420 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b5793-7728-4a1a-a865-02806ff8d022 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:33.154695 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b5793-7728-4a1a-a865-02806ff8d022 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:33.155386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b5793-7728-4a1a-a865-02806ff8d022 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:33.157496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b5793-7728-4a1a-a865-02806ff8d022 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:33.171050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-284b5793-7728-4a1a-a865-02806ff8d022 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 19:03:33.171050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:33.171050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 19:03:33.171050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 19:03:33.171050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 19:03:33.171050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 19:03:33.171050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 19:03:33.171050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:33.171050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 19:03:33.171050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:33.171050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:03:33.171050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:33.171050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:33.171050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:33.171050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:33.171050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:33.171050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:33.172275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:33.172275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:33.172275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:33.172275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:33.172275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:33.172275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:33.172275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 19:03:33.172275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 19:03:33.172275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 19:03:33.172275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 19:03:33.172275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:33.172275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:33.172275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:33.172275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:33.172275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:33.172275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:33.173148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:33.173148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:33.173148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:33.173148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:33.173148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:33.173148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:33.173148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:33.173148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:33.173148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:33.173148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:33.173148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 19:03:33.173148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:33.173148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 19:03:33.173148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:33.173148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 465/965] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Jun 2 19:03:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:33.178889 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cc18a-4caa-4675-baa4-2c1937c1caa8 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:33.197139 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:33.319338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cc18a-4caa-4675-baa4-2c1937c1caa8 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:33.360763 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b37f3-f897-4d18-b0e4-42cb235faf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:33.361441 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b37f3-f897-4d18-b0e4-42cb235faf6c None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:33.361719 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b37f3-f897-4d18-b0e4-42cb235faf6c None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:33.361997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b37f3-f897-4d18-b0e4-42cb235faf6c None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:33.362709 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b37f3-f897-4d18-b0e4-42cb235faf6c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:33.363786 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b37f3-f897-4d18-b0e4-42cb235faf6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:33.364781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b37f3-f897-4d18-b0e4-42cb235faf6c None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:33.371256 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 501/966] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Jun 2 19:03:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:33.378142 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b5793-7728-4a1a-a865-02806ff8d022 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:33.495427 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b5793-7728-4a1a-a865-02806ff8d022 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:33.541820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e43b7-3ba8-47f4-b5c0-d7edd471fbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:33.542492 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e43b7-3ba8-47f4-b5c0-d7edd471fbf6 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:33.542779 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e43b7-3ba8-47f4-b5c0-d7edd471fbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:33.543051 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e43b7-3ba8-47f4-b5c0-d7edd471fbf6 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:33.543765 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e43b7-3ba8-47f4-b5c0-d7edd471fbf6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:33.544093 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e43b7-3ba8-47f4-b5c0-d7edd471fbf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:33.545532 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e43b7-3ba8-47f4-b5c0-d7edd471fbf6 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:33.547561 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:33.557442 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 466/967] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Jun 2 19:03:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:33.559494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b37f3-f897-4d18-b0e4-42cb235faf6c None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:33.667359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:33.695725 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b37f3-f897-4d18-b0e4-42cb235faf6c None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:33.744859 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1bd506-2805-4995-9cf4-cd59c0caddd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:33.745548 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bd506-2805-4995-9cf4-cd59c0caddd5 None admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:33.745779 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bd506-2805-4995-9cf4-cd59c0caddd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:33.746058 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bd506-2805-4995-9cf4-cd59c0caddd5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:33.747099 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1bd506-2805-4995-9cf4-cd59c0caddd5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:33.748810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1bd506-2805-4995-9cf4-cd59c0caddd5 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:33.828209 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a024ce4-1c66-4294-89cc-64a0c589eaab None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:33.828769 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a024ce4-1c66-4294-89cc-64a0c589eaab None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:33.828769 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a024ce4-1c66-4294-89cc-64a0c589eaab None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:33.830153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 467/968] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:03:33.835545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea56961-3fff-43cf-8e8e-722fbb88205b None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:33.835836 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea56961-3fff-43cf-8e8e-722fbb88205b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:33.836205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea56961-3fff-43cf-8e8e-722fbb88205b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:33.854013 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-6ea56961-3fff-43cf-8e8e-722fbb88205b None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:33.855214 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6ea56961-3fff-43cf-8e8e-722fbb88205b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:33.882203 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 502/969] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Jun 2 19:03:33 2022] POST /identity/v3/endpoints => generated 349 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:33.950061 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 468/970] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 19:03:33.974133 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1bd506-2805-4995-9cf4-cd59c0caddd5 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:34.109425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1bd506-2805-4995-9cf4-cd59c0caddd5 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:34.151057 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:34.161407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda8146-603c-4efc-a3b2-417e04be51bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:34.162244 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda8146-603c-4efc-a3b2-417e04be51bb None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:34.168972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda8146-603c-4efc-a3b2-417e04be51bb None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:34.168972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda8146-603c-4efc-a3b2-417e04be51bb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:34.175636 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda8146-603c-4efc-a3b2-417e04be51bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:03:34.183915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-1eda8146-603c-4efc-a3b2-417e04be51bb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 19:03:34.183915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:34.183915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:34.183915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:34.183915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:34.183915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:34.183915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:34.183915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:34.183915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:34.183915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:34.183915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:34.183915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:34.183915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:03:34.183915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:03:34.183915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:03:34.183915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:03:34.184914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:03:34.184914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:03:34.184914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:03:34.184914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:03:34.184914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:34.184914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:34.184914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:34.184914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:34.184914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:34.184914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:34.184914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:34.184914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:34.184914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:34.184914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:34.184914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:34.184914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:34.186516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:34.186516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:34.186516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:34.186516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:34.186516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:03:34.186516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:03:34.186516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:03:34.186516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:03:34.186516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:03:34.186516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:03:34.186516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 19:03:34.186516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:34.186516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 503/971] 10.222.0.45 () {56 vars in 1120 bytes} [Thu Jun 2 19:03:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:34.192226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea56961-3fff-43cf-8e8e-722fbb88205b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:34.309339 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea56961-3fff-43cf-8e8e-722fbb88205b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:34.340130 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:34.356308 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5d81a-3f6c-4c7b-9944-28314c31e81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:34.357487 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5d81a-3f6c-4c7b-9944-28314c31e81d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:34.357487 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5d81a-3f6c-4c7b-9944-28314c31e81d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:34.357487 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5d81a-3f6c-4c7b-9944-28314c31e81d None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:34.357960 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5d81a-3f6c-4c7b-9944-28314c31e81d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:34.358833 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5d81a-3f6c-4c7b-9944-28314c31e81d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:34.361377 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5d81a-3f6c-4c7b-9944-28314c31e81d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:34.373377 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 469/972] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Jun 2 19:03:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:34.402502 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda8146-603c-4efc-a3b2-417e04be51bb None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:34.489985 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda8146-603c-4efc-a3b2-417e04be51bb None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:34.527186 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf023e88-d97c-402f-9735-fbe2556bf6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:34.528311 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf023e88-d97c-402f-9735-fbe2556bf6ff None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:34.528805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf023e88-d97c-402f-9735-fbe2556bf6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:34.529258 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf023e88-d97c-402f-9735-fbe2556bf6ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:34.541125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf023e88-d97c-402f-9735-fbe2556bf6ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:34.543886 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf023e88-d97c-402f-9735-fbe2556bf6ff None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:34.567598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-bf023e88-d97c-402f-9735-fbe2556bf6ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:34.567598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:34.567598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:34.567598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:34.567598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:34.567598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:34.567598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:34.567598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:34.567598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:34.567598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:34.567598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:34.567598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:34.567598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:34.567598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:34.567598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:34.568694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:34.568694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:34.568694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:34.568694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:34.568694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:34.568694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:34.568694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:34.568694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:34.568694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:34.568694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:34.568694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:34.568694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:34.568694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:34.568694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:34.568694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:34.568694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:34.568694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:34.569594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:34.569594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:34.569594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:34.569594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:34.574867 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 504/973] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:34.577034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5d81a-3f6c-4c7b-9944-28314c31e81d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:34.710740 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5d81a-3f6c-4c7b-9944-28314c31e81d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:34.751816 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf5694-1dcb-408f-a686-9d0cde983ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:34.752518 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf5694-1dcb-408f-a686-9d0cde983ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:34.752800 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf5694-1dcb-408f-a686-9d0cde983ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:34.753078 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf5694-1dcb-408f-a686-9d0cde983ae3 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:34.753800 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf5694-1dcb-408f-a686-9d0cde983ae3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:34.754099 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf5694-1dcb-408f-a686-9d0cde983ae3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:34.755571 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf5694-1dcb-408f-a686-9d0cde983ae3 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:34.773101 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 470/974] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:34.775604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf023e88-d97c-402f-9735-fbe2556bf6ff None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:34.831544 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:34.901169 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf023e88-d97c-402f-9735-fbe2556bf6ff None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:34.937629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefd8dd-15b5-4a5c-b729-741f387cd85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:34.938462 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefd8dd-15b5-4a5c-b729-741f387cd85b None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:34.938739 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefd8dd-15b5-4a5c-b729-741f387cd85b None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:34.939011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefd8dd-15b5-4a5c-b729-741f387cd85b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:34.947414 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefd8dd-15b5-4a5c-b729-741f387cd85b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:34.948970 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefd8dd-15b5-4a5c-b729-741f387cd85b None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:34.964325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-ddefd8dd-15b5-4a5c-b729-741f387cd85b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 19:03:34.964325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:34.964325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:34.964325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:34.964325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:34.964325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:34.964325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:34.964325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:34.964325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:34.964325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:34.964325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:34.964325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:34.964325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:03:34.964325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:03:34.964325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:03:34.964325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:03:34.965306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:34.965306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:34.965306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:03:34.965306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:34.965306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:03:34.965306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:34.965306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:34.965306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:34.965306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:34.965306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:34.965306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:34.965306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:34.965306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:34.965306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:34.965306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:34.965306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:34.965306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:34.965306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:34.966565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:34.966565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:34.966565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:03:34.966565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:03:34.966565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:03:34.966565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:03:34.966565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:03:34.966565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:03:34.966565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 19:03:34.966565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:34.968855 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 505/975] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Jun 2 19:03:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:34.972037 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf5694-1dcb-408f-a686-9d0cde983ae3 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:35.023369 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:35.090055 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf5694-1dcb-408f-a686-9d0cde983ae3 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:35.135434 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda381a-deff-40b9-9f21-5598bb843e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:35.136174 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda381a-deff-40b9-9f21-5598bb843e5f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:35.136462 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda381a-deff-40b9-9f21-5598bb843e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:35.136736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda381a-deff-40b9-9f21-5598bb843e5f None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:35.137633 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda381a-deff-40b9-9f21-5598bb843e5f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:35.137946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda381a-deff-40b9-9f21-5598bb843e5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:35.139549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda381a-deff-40b9-9f21-5598bb843e5f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:35.162465 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 471/976] 10.222.0.45 () {56 vars in 1149 bytes} [Thu Jun 2 19:03:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:35.168606 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefd8dd-15b5-4a5c-b729-741f387cd85b None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:35.287031 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefd8dd-15b5-4a5c-b729-741f387cd85b None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:35.289407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:35.327030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c061ade-f91d-4f7a-a1be-e7f39355ad8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:35.328533 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c061ade-f91d-4f7a-a1be-e7f39355ad8c None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:35.328831 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c061ade-f91d-4f7a-a1be-e7f39355ad8c None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:35.329145 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c061ade-f91d-4f7a-a1be-e7f39355ad8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:35.410990 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c061ade-f91d-4f7a-a1be-e7f39355ad8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:35.412520 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c061ade-f91d-4f7a-a1be-e7f39355ad8c None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:35.457168 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf97ede-bce3-44b4-b39a-9b2ed09fbfa4 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:35.457484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf97ede-bce3-44b4-b39a-9b2ed09fbfa4 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:35.457734 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf97ede-bce3-44b4-b39a-9b2ed09fbfa4 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:35.459300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 472/977] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:03:35.464679 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d118c-0cac-4a2f-8bef-1a88ca533f5e None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:35.465004 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d118c-0cac-4a2f-8bef-1a88ca533f5e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:35.465238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d118c-0cac-4a2f-8bef-1a88ca533f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:35.483343 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-e78d118c-0cac-4a2f-8bef-1a88ca533f5e None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:35.484611 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e78d118c-0cac-4a2f-8bef-1a88ca533f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:35.540551 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 506/978] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:03:35 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 19:03:35.548941 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c061ade-f91d-4f7a-a1be-e7f39355ad8c None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:35.553051 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:35.572609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 473/979] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 19:03:35.591319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d118c-0cac-4a2f-8bef-1a88ca533f5e None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:35.632420 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:35.657727 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c061ade-f91d-4f7a-a1be-e7f39355ad8c None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:35.696284 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00daa1cf-2310-4205-b000-76c48897a5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:35.697080 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daa1cf-2310-4205-b000-76c48897a5fb None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:35.697357 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daa1cf-2310-4205-b000-76c48897a5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:35.697639 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daa1cf-2310-4205-b000-76c48897a5fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:35.703905 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d118c-0cac-4a2f-8bef-1a88ca533f5e None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:35.708517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00daa1cf-2310-4205-b000-76c48897a5fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:35.710004 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00daa1cf-2310-4205-b000-76c48897a5fb None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:35.731964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-00daa1cf-2310-4205-b000-76c48897a5fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:35.731964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:35.731964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:35.731964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:35.731964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:35.731964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:35.731964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:35.731964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:35.731964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:35.731964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:35.731964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:35.731964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:35.731964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:35.731964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:35.731964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:35.733141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:35.733141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:35.733141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:35.733141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:35.733141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:35.733141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:35.733141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:35.733141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:35.733141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:35.733141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:35.733141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:35.733141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:35.733141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:35.733141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:35.733141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:35.733141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:35.733141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:35.734822 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:35.734822 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:35.734822 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:35.734822 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:35.734822 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 507/980] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:35.739877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00daa1cf-2310-4205-b000-76c48897a5fb None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:35.753657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed320cba-7e44-4e9e-b98b-54bc46eebdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:35.754462 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed320cba-7e44-4e9e-b98b-54bc46eebdbb None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:35.754751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed320cba-7e44-4e9e-b98b-54bc46eebdbb None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:35.755022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed320cba-7e44-4e9e-b98b-54bc46eebdbb None admin] PATH_INFO: `/v3/services/compute` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:35.755680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed320cba-7e44-4e9e-b98b-54bc46eebdbb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:35.757093 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed320cba-7e44-4e9e-b98b-54bc46eebdbb None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:35.768977 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-ed320cba-7e44-4e9e-b98b-54bc46eebdbb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 19:03:35.768977 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:35.768977 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 19:03:35.768977 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 19:03:35.768977 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 19:03:35.768977 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 19:03:35.768977 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 19:03:35.768977 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:35.768977 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 19:03:35.768977 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:35.768977 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:03:35.768977 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:35.768977 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:35.768977 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:35.768977 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:35.768977 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:35.768977 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:35.770011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:35.770011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:35.770011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:35.770011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:35.770011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:35.770011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:35.770011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 19:03:35.770011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 19:03:35.770011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 19:03:35.770011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 19:03:35.770011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:35.770011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:35.770011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:35.770011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:35.770011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:35.770011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:35.771069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:35.771069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:35.771069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:35.771069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:35.771069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:35.771069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:35.771069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:35.771069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:35.771069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:35.771069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:35.771069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 19:03:35.771069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:35.771069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 19:03:35.771069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:35.771069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 474/981] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:03:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:35.776443 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed320cba-7e44-4e9e-b98b-54bc46eebdbb None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:35.810458 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:35.863656 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00daa1cf-2310-4205-b000-76c48897a5fb None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:35.898173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:35.901555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed320cba-7e44-4e9e-b98b-54bc46eebdbb None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:35.907004 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ff290-b35e-47ba-b309-fcf38101b323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:35.907758 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ff290-b35e-47ba-b309-fcf38101b323 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:35.908063 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ff290-b35e-47ba-b309-fcf38101b323 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:35.908344 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ff290-b35e-47ba-b309-fcf38101b323 None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:35.909083 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ff290-b35e-47ba-b309-fcf38101b323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:35.909394 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ff290-b35e-47ba-b309-fcf38101b323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:35.910777 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ff290-b35e-47ba-b309-fcf38101b323 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:35.923458 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 508/982] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:35.929244 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ff290-b35e-47ba-b309-fcf38101b323 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:35.939767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebc6db-55cd-4f90-9a62-3234416ad98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:35.940918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebc6db-55cd-4f90-9a62-3234416ad98f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:35.941201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebc6db-55cd-4f90-9a62-3234416ad98f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:35.941472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebc6db-55cd-4f90-9a62-3234416ad98f None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:35.942183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebc6db-55cd-4f90-9a62-3234416ad98f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:35.942831 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebc6db-55cd-4f90-9a62-3234416ad98f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:35.944556 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebc6db-55cd-4f90-9a62-3234416ad98f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:35.949675 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 475/983] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Jun 2 19:03:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:35.955962 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebc6db-55cd-4f90-9a62-3234416ad98f None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:36.052500 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ff290-b35e-47ba-b309-fcf38101b323 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:36.071884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebc6db-55cd-4f90-9a62-3234416ad98f None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:36.074698 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:36.096020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07cc249-8d6b-494b-8f5e-efab5d1b5db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:36.096818 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cc249-8d6b-494b-8f5e-efab5d1b5db6 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:36.097096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cc249-8d6b-494b-8f5e-efab5d1b5db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:36.097364 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cc249-8d6b-494b-8f5e-efab5d1b5db6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:36.104462 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07cc249-8d6b-494b-8f5e-efab5d1b5db6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:36.105919 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07cc249-8d6b-494b-8f5e-efab5d1b5db6 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:36.110828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e617e2-cfe1-42cc-a30e-7eb1cde7a96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:36.111455 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e617e2-cfe1-42cc-a30e-7eb1cde7a96a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:36.111741 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e617e2-cfe1-42cc-a30e-7eb1cde7a96a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:36.112042 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e617e2-cfe1-42cc-a30e-7eb1cde7a96a None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:36.112756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e617e2-cfe1-42cc-a30e-7eb1cde7a96a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:36.113071 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e617e2-cfe1-42cc-a30e-7eb1cde7a96a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:36.114480 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e617e2-cfe1-42cc-a30e-7eb1cde7a96a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:36.120058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 476/984] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Jun 2 19:03:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:36.121400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-e07cc249-8d6b-494b-8f5e-efab5d1b5db6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:36.121400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:36.121400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:36.121400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:36.121400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:36.121400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:36.121400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:36.121400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:36.121400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:36.121400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:36.121400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:36.121400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:36.121400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:03:36.121400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:03:36.121400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:03:36.122368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:03:36.122368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:36.122368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:36.122368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:36.122368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:36.122368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:36.122368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:36.122368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:36.122368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:36.122368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:36.122368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:36.122368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:36.122368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:36.122368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:36.122368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:36.122368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:36.122368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:36.128802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:03:36.128802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:03:36.128802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:03:36.128802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:03:36.128802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:03:36.128802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:03:36.128802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:36.128802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:36.128802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 509/985] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:03:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:36.129313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e617e2-cfe1-42cc-a30e-7eb1cde7a96a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:36.129386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07cc249-8d6b-494b-8f5e-efab5d1b5db6 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:36.156885 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:36.237391 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e617e2-cfe1-42cc-a30e-7eb1cde7a96a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:36.240452 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07cc249-8d6b-494b-8f5e-efab5d1b5db6 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:36.272308 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54811e-dcc0-494c-9462-5675c4bc409b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:36.272977 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54811e-dcc0-494c-9462-5675c4bc409b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:36.273261 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54811e-dcc0-494c-9462-5675c4bc409b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:36.273536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54811e-dcc0-494c-9462-5675c4bc409b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:36.274327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54811e-dcc0-494c-9462-5675c4bc409b None admin] RBAC: Adding query filter params (interface=public, service_id=68f57ce051f44e219689b9c1eab55401, region_id=RegionOne) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:36.274641 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54811e-dcc0-494c-9462-5675c4bc409b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:36.276035 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54811e-dcc0-494c-9462-5675c4bc409b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:36.279775 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106a3a3-9480-484c-8c40-2a0bbe5d07c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:36.280500 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106a3a3-9480-484c-8c40-2a0bbe5d07c5 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:36.281334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106a3a3-9480-484c-8c40-2a0bbe5d07c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:36.281610 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106a3a3-9480-484c-8c40-2a0bbe5d07c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:36.282168 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 477/986] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Jun 2 19:03:36 2022] GET /identity/v3/endpoints?service_id=68f57ce051f44e219689b9c1eab55401&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:36.282503 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106a3a3-9480-484c-8c40-2a0bbe5d07c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:36.282810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106a3a3-9480-484c-8c40-2a0bbe5d07c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:36.283455 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6054b0-9b17-43b7-83ec-0abd10ff8c5d None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:36.283744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6054b0-9b17-43b7-83ec-0abd10ff8c5d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:36.284039 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6054b0-9b17-43b7-83ec-0abd10ff8c5d None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:36.284276 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106a3a3-9480-484c-8c40-2a0bbe5d07c5 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:36.285468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 478/987] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:36.287810 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6054b0-9b17-43b7-83ec-0abd10ff8c5d None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:36.298016 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 510/988] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:03:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:36.299519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac003d-8346-4b40-8c73-2be275192ef9 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:36.299912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac003d-8346-4b40-8c73-2be275192ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:36.300330 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac003d-8346-4b40-8c73-2be275192ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:36.318333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-faac003d-8346-4b40-8c73-2be275192ef9 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:36.319573 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-faac003d-8346-4b40-8c73-2be275192ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:36.350195 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:36.386405 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:36.390702 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 511/989] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:03:36.391431 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac003d-8346-4b40-8c73-2be275192ef9 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:36.398085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6054b0-9b17-43b7-83ec-0abd10ff8c5d None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:36.431156 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f595ce-fc8e-4984-88df-469bab8fd617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:36.431840 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f595ce-fc8e-4984-88df-469bab8fd617 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:36.432154 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f595ce-fc8e-4984-88df-469bab8fd617 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:36.432428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f595ce-fc8e-4984-88df-469bab8fd617 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:36.433108 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f595ce-fc8e-4984-88df-469bab8fd617 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:36.434482 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f595ce-fc8e-4984-88df-469bab8fd617 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:36.441281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 479/990] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Jun 2 19:03:36 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:03:36.442165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f595ce-fc8e-4984-88df-469bab8fd617 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:36.502458 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac003d-8346-4b40-8c73-2be275192ef9 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:36.543268 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71317cb0-d077-4016-8e75-d3afb7426032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:36.543939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71317cb0-d077-4016-8e75-d3afb7426032 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:36.544251 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71317cb0-d077-4016-8e75-d3afb7426032 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:36.544530 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71317cb0-d077-4016-8e75-d3afb7426032 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:36.545394 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71317cb0-d077-4016-8e75-d3afb7426032 None admin] RBAC: Adding query filter params (role.id=788c05993fb0458a9a2f4d2bd3cf9a34, scope.project.id=b11b7e66a993492d8163097bce955c0b, user.id=235042beafd246c5b227b3926098c8c8) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:36.545705 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71317cb0-d077-4016-8e75-d3afb7426032 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:36.547864 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71317cb0-d077-4016-8e75-d3afb7426032 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:36.556211 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 512/991] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:03:36 2022] GET /identity/v3/role_assignments?user.id=235042beafd246c5b227b3926098c8c8&scope.project.id=b11b7e66a993492d8163097bce955c0b&role.id=788c05993fb0458a9a2f4d2bd3cf9a34 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:36.578182 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f595ce-fc8e-4984-88df-469bab8fd617 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:36.621635 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2588b-7357-4f53-9edf-174df0904dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:36.622495 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2588b-7357-4f53-9edf-174df0904dcd None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:36.622786 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2588b-7357-4f53-9edf-174df0904dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:36.623065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2588b-7357-4f53-9edf-174df0904dcd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:36.623929 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2588b-7357-4f53-9edf-174df0904dcd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:36.625488 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2588b-7357-4f53-9edf-174df0904dcd None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:36.639034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-59f2588b-7357-4f53-9edf-174df0904dcd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 19:03:36.639034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:36.639034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 19:03:36.639034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 19:03:36.639034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 19:03:36.639034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 19:03:36.639034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 19:03:36.639034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:36.639034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 19:03:36.639034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:36.639034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:03:36.639034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:36.639034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:36.639034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:36.639034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:36.639034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:36.639034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:36.640349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:36.640349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:36.640349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:36.640349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:36.640349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:36.640349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:36.640349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 19:03:36.640349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 19:03:36.640349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 19:03:36.640349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 19:03:36.640349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:36.640349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:36.640349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:36.640349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:36.640349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:36.640349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:36.641389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:36.641389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:36.641389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:36.641389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:36.641389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:36.641389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:36.641389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:36.641389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:36.641389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:36.641389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:36.641389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 19:03:36.641389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:36.641389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 19:03:36.641389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:36.641389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 480/992] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Jun 2 19:03:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:36.646851 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71317cb0-d077-4016-8e75-d3afb7426032 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:36.687346 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:36.773416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71317cb0-d077-4016-8e75-d3afb7426032 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:36.814991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5a871-44d4-41cb-b30f-86b32c09dba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:36.816381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5a871-44d4-41cb-b30f-86b32c09dba1 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:36.816381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5a871-44d4-41cb-b30f-86b32c09dba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:36.816585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5a871-44d4-41cb-b30f-86b32c09dba1 None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:36.817386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5a871-44d4-41cb-b30f-86b32c09dba1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:36.817797 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5a871-44d4-41cb-b30f-86b32c09dba1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:36.819236 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5a871-44d4-41cb-b30f-86b32c09dba1 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:36.824668 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 513/993] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Jun 2 19:03:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:36.831405 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2588b-7357-4f53-9edf-174df0904dcd None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:36.852779 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:36.937607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2588b-7357-4f53-9edf-174df0904dcd None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:36.973163 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284b3e1-5bc8-4dd3-a5ad-3f88027ac3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:36.974076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284b3e1-5bc8-4dd3-a5ad-3f88027ac3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:36.976477 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284b3e1-5bc8-4dd3-a5ad-3f88027ac3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:36.976477 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284b3e1-5bc8-4dd3-a5ad-3f88027ac3d0 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:36.976477 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284b3e1-5bc8-4dd3-a5ad-3f88027ac3d0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:36.976477 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284b3e1-5bc8-4dd3-a5ad-3f88027ac3d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:36.979747 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284b3e1-5bc8-4dd3-a5ad-3f88027ac3d0 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:36.988440 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 481/994] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Jun 2 19:03:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:36.991010 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5a871-44d4-41cb-b30f-86b32c09dba1 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:37.094696 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:37.101824 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5a871-44d4-41cb-b30f-86b32c09dba1 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:37.138549 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0597c-65ac-4c22-a4b7-0f35e0981a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:37.139305 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0597c-65ac-4c22-a4b7-0f35e0981a45 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:37.139803 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0597c-65ac-4c22-a4b7-0f35e0981a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:37.140672 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0597c-65ac-4c22-a4b7-0f35e0981a45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:37.141536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0597c-65ac-4c22-a4b7-0f35e0981a45 None admin] RBAC: Adding query filter params (interface=admin, service_id=4218be50bcf94efc9d8308993ffd80a1, region_id=RegionOne) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:37.142023 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0597c-65ac-4c22-a4b7-0f35e0981a45 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:37.143529 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0597c-65ac-4c22-a4b7-0f35e0981a45 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:37.153795 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 514/995] 10.222.0.45 () {56 vars in 1249 bytes} [Thu Jun 2 19:03:36 2022] GET /identity/v3/endpoints?service_id=4218be50bcf94efc9d8308993ffd80a1&interface=admin®ion_id=RegionOne => generated 193 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:37.157154 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284b3e1-5bc8-4dd3-a5ad-3f88027ac3d0 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:37.251488 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:37.270596 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284b3e1-5bc8-4dd3-a5ad-3f88027ac3d0 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:37.305854 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ae712-ee92-458b-a92e-8a7da5a9d78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:37.306533 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ae712-ee92-458b-a92e-8a7da5a9d78b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:37.306816 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ae712-ee92-458b-a92e-8a7da5a9d78b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:37.307092 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ae712-ee92-458b-a92e-8a7da5a9d78b None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:37.307786 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ae712-ee92-458b-a92e-8a7da5a9d78b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:37.309202 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ae712-ee92-458b-a92e-8a7da5a9d78b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:37.324294 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 482/996] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Jun 2 19:03:37 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:03:38.758687 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12f68c-5b86-4e61-afaf-6151550efa1d None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:38.759247 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12f68c-5b86-4e61-afaf-6151550efa1d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:38.759247 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12f68c-5b86-4e61-afaf-6151550efa1d None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:38.760615 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 515/997] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:38.766134 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a84d6-bcec-46b7-8dba-4160e69b6bda None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:38.766576 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a84d6-bcec-46b7-8dba-4160e69b6bda None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:38.766760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a84d6-bcec-46b7-8dba-4160e69b6bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:38.784097 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-b74a84d6-bcec-46b7-8dba-4160e69b6bda None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:38.785290 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b74a84d6-bcec-46b7-8dba-4160e69b6bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:38.862510 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 483/998] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:03:38.886286 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12f68c-5b86-4e61-afaf-6151550efa1d None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:38.935371 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93b13d-b0cb-41fa-875c-2902531c7b4d None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:38.935731 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93b13d-b0cb-41fa-875c-2902531c7b4d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:38.936307 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93b13d-b0cb-41fa-875c-2902531c7b4d None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:38.939144 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 484/999] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:38.944487 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b22ef-d888-4695-b5bf-3fe44f34815f None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:38.944791 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b22ef-d888-4695-b5bf-3fe44f34815f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:38.945060 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b22ef-d888-4695-b5bf-3fe44f34815f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:38.962794 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-810b22ef-d888-4695-b5bf-3fe44f34815f None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:38.964014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-810b22ef-d888-4695-b5bf-3fe44f34815f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:39.013284 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12f68c-5b86-4e61-afaf-6151550efa1d None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:39.040417 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 485/1000] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 19:03:39.055849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402b83f-7c08-478a-8f46-e20de7f8d696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:39.056677 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402b83f-7c08-478a-8f46-e20de7f8d696 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:39.056958 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402b83f-7c08-478a-8f46-e20de7f8d696 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:39.057230 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402b83f-7c08-478a-8f46-e20de7f8d696 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:39.057880 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402b83f-7c08-478a-8f46-e20de7f8d696 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:39.059269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402b83f-7c08-478a-8f46-e20de7f8d696 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:39.063419 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b22ef-d888-4695-b5bf-3fe44f34815f None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:39.072328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-7402b83f-7c08-478a-8f46-e20de7f8d696 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 19:03:39.072328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:39.072328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 19:03:39.072328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 19:03:39.072328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 19:03:39.072328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 19:03:39.072328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 19:03:39.072328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:39.072328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 19:03:39.072328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:39.072328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:03:39.072328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:39.072328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:39.072328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:39.072328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:39.072328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:39.072328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:39.074676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:39.074676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:39.074676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:39.074676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:39.074676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:39.074676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:39.074676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 19:03:39.074676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 19:03:39.074676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 19:03:39.074676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 19:03:39.074676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:39.074676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:39.074676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:39.074676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:39.074676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:39.074676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:39.076647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:39.076647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:39.076647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:39.076647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:39.076647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:39.076647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:39.076647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:39.076647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:39.076647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:39.076647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:39.076647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 19:03:39.076647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:39.076647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 19:03:39.076647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:39.076647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 516/1001] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:03:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:39.078888 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:39.079298 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402b83f-7c08-478a-8f46-e20de7f8d696 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:39.107007 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:39.176484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b22ef-d888-4695-b5bf-3fe44f34815f None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:39.189087 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402b83f-7c08-478a-8f46-e20de7f8d696 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:39.212506 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5f2da-de26-4764-897b-c6585dcc1c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:39.213303 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5f2da-de26-4764-897b-c6585dcc1c69 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:39.213582 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5f2da-de26-4764-897b-c6585dcc1c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:39.213857 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5f2da-de26-4764-897b-c6585dcc1c69 None admin] PATH_INFO: `/v3/services/image` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:39.214516 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5f2da-de26-4764-897b-c6585dcc1c69 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:39.216167 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5f2da-de26-4764-897b-c6585dcc1c69 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:39.229530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-8aa5f2da-de26-4764-897b-c6585dcc1c69 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 19:03:39.229530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:39.229530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 19:03:39.229530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 19:03:39.229530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 19:03:39.229530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 19:03:39.229530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 19:03:39.229530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:39.229530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 19:03:39.229530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:39.229530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:03:39.229530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:39.229530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:39.229530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:39.229530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:39.229530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:39.229530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:39.230738 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:39.230738 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:39.230738 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:39.230738 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:39.230738 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:39.230738 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:39.230738 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 19:03:39.230738 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 19:03:39.230738 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 19:03:39.230738 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 19:03:39.230738 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:39.230738 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:39.230738 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:39.230738 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:39.230738 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:39.230738 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:39.231645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:39.231645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:39.231645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:39.231645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:39.231645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:39.231645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:39.231645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:39.231645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:39.231645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:39.231645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:39.231645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 19:03:39.231645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:39.231645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 19:03:39.231645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:39.231645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 486/1002] 10.222.0.45 () {56 vars in 1105 bytes} [Thu Jun 2 19:03:39 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:39.239236 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cf976-3f53-4067-bab4-440e8751f5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:39.239411 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5f2da-de26-4764-897b-c6585dcc1c69 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:39.239941 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cf976-3f53-4067-bab4-440e8751f5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:39.240250 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cf976-3f53-4067-bab4-440e8751f5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:39.240644 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cf976-3f53-4067-bab4-440e8751f5a1 None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:39.241374 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cf976-3f53-4067-bab4-440e8751f5a1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:39.241703 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cf976-3f53-4067-bab4-440e8751f5a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:39.243106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cf976-3f53-4067-bab4-440e8751f5a1 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:39.249150 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 517/1003] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Jun 2 19:03:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:39.255198 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cf976-3f53-4067-bab4-440e8751f5a1 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:39.335703 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:39.363033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:39.368512 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5f2da-de26-4764-897b-c6585dcc1c69 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:39.379407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cf976-3f53-4067-bab4-440e8751f5a1 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:39.406014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d40db-fe42-452a-a8ed-039f17e3a20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:39.406681 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d40db-fe42-452a-a8ed-039f17e3a20a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:39.406964 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d40db-fe42-452a-a8ed-039f17e3a20a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:39.407232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d40db-fe42-452a-a8ed-039f17e3a20a None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:39.408013 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d40db-fe42-452a-a8ed-039f17e3a20a None admin] RBAC: Adding query filter params (name=image) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:39.408388 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d40db-fe42-452a-a8ed-039f17e3a20a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:39.413613 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d40db-fe42-452a-a8ed-039f17e3a20a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:39.414901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 487/1004] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:39.422992 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237411e-0443-4809-a4f0-093891756b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:39.423491 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d40db-fe42-452a-a8ed-039f17e3a20a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:39.423686 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237411e-0443-4809-a4f0-093891756b22 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:39.423962 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237411e-0443-4809-a4f0-093891756b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:39.424295 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237411e-0443-4809-a4f0-093891756b22 None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:39.425020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237411e-0443-4809-a4f0-093891756b22 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:39.425331 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237411e-0443-4809-a4f0-093891756b22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:39.426721 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237411e-0443-4809-a4f0-093891756b22 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:39.431963 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 518/1005] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Jun 2 19:03:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:39.438615 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237411e-0443-4809-a4f0-093891756b22 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:39.539824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d40db-fe42-452a-a8ed-039f17e3a20a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:39.552261 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237411e-0443-4809-a4f0-093891756b22 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:39.575040 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df4a29-f2b6-45d5-a12e-ff256e433b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:39.575711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df4a29-f2b6-45d5-a12e-ff256e433b92 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:39.576019 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df4a29-f2b6-45d5-a12e-ff256e433b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:39.576296 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df4a29-f2b6-45d5-a12e-ff256e433b92 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:39.577008 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df4a29-f2b6-45d5-a12e-ff256e433b92 None admin] RBAC: Adding query filter params (type=image) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:39.577863 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df4a29-f2b6-45d5-a12e-ff256e433b92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:39.579322 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df4a29-f2b6-45d5-a12e-ff256e433b92 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:39.580735 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:39.593546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 488/1006] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:39 2022] GET /identity/v3/services?type=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:39.607255 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a2bea-c540-45b1-9ddc-972e868a85b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:39.608341 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a2bea-c540-45b1-9ddc-972e868a85b1 None admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:39.609316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a2bea-c540-45b1-9ddc-972e868a85b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:39.609512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a2bea-c540-45b1-9ddc-972e868a85b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:39.610303 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a2bea-c540-45b1-9ddc-972e868a85b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:39.611722 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a2bea-c540-45b1-9ddc-972e868a85b1 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:39.614784 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c258768-a004-4768-9911-40626e1f30d7 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:39.615075 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c258768-a004-4768-9911-40626e1f30d7 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:39.615354 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c258768-a004-4768-9911-40626e1f30d7 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:39.620585 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 489/1007] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:39.623292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1659e9-96cd-40c7-965d-42dfbaa965df None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:39.623584 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1659e9-96cd-40c7-965d-42dfbaa965df None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:39.624319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1659e9-96cd-40c7-965d-42dfbaa965df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:39.642602 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-2d1659e9-96cd-40c7-965d-42dfbaa965df None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:39.643818 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2d1659e9-96cd-40c7-965d-42dfbaa965df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:39.721131 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 490/1008] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 19:03:39.745104 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1659e9-96cd-40c7-965d-42dfbaa965df None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:39.838705 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 519/1009] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Jun 2 19:03:39 2022] POST /identity/v3/endpoints => generated 334 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:03:39.858209 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1659e9-96cd-40c7-965d-42dfbaa965df None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:39.890738 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:39.908172 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8495c-57f1-4eea-a1a6-10b172a02556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:39.909013 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8495c-57f1-4eea-a1a6-10b172a02556 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:39.909296 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8495c-57f1-4eea-a1a6-10b172a02556 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:39.910635 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8495c-57f1-4eea-a1a6-10b172a02556 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:39.910635 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8495c-57f1-4eea-a1a6-10b172a02556 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:39.911754 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8495c-57f1-4eea-a1a6-10b172a02556 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:39.925586 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-0dd8495c-57f1-4eea-a1a6-10b172a02556 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 19:03:39.925586 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:39.925586 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 19:03:39.925586 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 19:03:39.925586 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 19:03:39.925586 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 19:03:39.925586 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 19:03:39.925586 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:39.925586 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 19:03:39.925586 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:39.925586 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:03:39.925586 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:39.925586 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:39.925586 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:39.925586 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:39.925586 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:39.925586 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:39.932485 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:39.932485 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:39.932485 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:39.932485 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:39.932485 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:39.932485 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:39.932485 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 19:03:39.932485 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 19:03:39.932485 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 19:03:39.932485 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 19:03:39.932485 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:39.932485 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:39.932485 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:39.932485 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:39.932485 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:39.932485 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:39.933524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:39.933524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:39.933524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:39.933524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:39.933524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:39.933524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:39.933524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:39.933524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:39.933524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:39.933524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:39.933524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 19:03:39.933524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:39.933524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 19:03:39.933524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:39.933524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 491/1010] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Jun 2 19:03:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:39.934332 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a2bea-c540-45b1-9ddc-972e868a85b1 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:39.945516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:40.054185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a2bea-c540-45b1-9ddc-972e868a85b1 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:40.091233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9bbb8-5d3a-4237-ad14-3f85a518c698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:40.091905 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9bbb8-5d3a-4237-ad14-3f85a518c698 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:40.092221 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9bbb8-5d3a-4237-ad14-3f85a518c698 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:40.092648 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9bbb8-5d3a-4237-ad14-3f85a518c698 None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:40.093951 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9bbb8-5d3a-4237-ad14-3f85a518c698 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:40.094203 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9bbb8-5d3a-4237-ad14-3f85a518c698 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:40.095578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9bbb8-5d3a-4237-ad14-3f85a518c698 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:40.101004 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 520/1011] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Jun 2 19:03:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:40.106477 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8495c-57f1-4eea-a1a6-10b172a02556 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:40.222810 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8495c-57f1-4eea-a1a6-10b172a02556 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:40.259074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74e3cb-fc9e-4611-970d-01295406b4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:40.259881 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74e3cb-fc9e-4611-970d-01295406b4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:40.260284 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74e3cb-fc9e-4611-970d-01295406b4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:40.260672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74e3cb-fc9e-4611-970d-01295406b4f7 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:40.261476 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74e3cb-fc9e-4611-970d-01295406b4f7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:40.261875 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74e3cb-fc9e-4611-970d-01295406b4f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:40.263322 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74e3cb-fc9e-4611-970d-01295406b4f7 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:40.273732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 492/1012] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Jun 2 19:03:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:40.275375 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9bbb8-5d3a-4237-ad14-3f85a518c698 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:40.351654 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:40.385908 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9bbb8-5d3a-4237-ad14-3f85a518c698 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:40.424482 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d130d-48a6-416f-aa74-441788a60cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:40.425240 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d130d-48a6-416f-aa74-441788a60cae None admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:40.425594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d130d-48a6-416f-aa74-441788a60cae None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:40.425944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d130d-48a6-416f-aa74-441788a60cae None admin] PATH_INFO: `/v3/endpoints` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:40.426759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d130d-48a6-416f-aa74-441788a60cae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:40.428240 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d130d-48a6-416f-aa74-441788a60cae None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:40.553960 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 521/1013] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Jun 2 19:03:40 2022] POST /identity/v3/endpoints => generated 325 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:41.889701 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3ce52-4827-4f09-809b-7066b5d36b9e None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:41.890562 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3ce52-4827-4f09-809b-7066b5d36b9e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:41.890562 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3ce52-4827-4f09-809b-7066b5d36b9e None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:41.891736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 493/1014] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:41.898018 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3259f-a329-40be-a4a6-52a2483e99e7 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:41.898568 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3259f-a329-40be-a4a6-52a2483e99e7 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:41.898568 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3259f-a329-40be-a4a6-52a2483e99e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:41.917531 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-4bb3259f-a329-40be-a4a6-52a2483e99e7 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:41.918801 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-4bb3259f-a329-40be-a4a6-52a2483e99e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:42.010511 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 522/1015] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:41 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:03:42.034656 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3ce52-4827-4f09-809b-7066b5d36b9e None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:42.095697 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:42.170412 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3ce52-4827-4f09-809b-7066b5d36b9e None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:42.213804 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c603ae-75ed-441a-9ac5-c111413df203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:42.214726 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c603ae-75ed-441a-9ac5-c111413df203 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:42.215139 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c603ae-75ed-441a-9ac5-c111413df203 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:42.215810 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c603ae-75ed-441a-9ac5-c111413df203 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:42.216747 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c603ae-75ed-441a-9ac5-c111413df203 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:42.218438 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c603ae-75ed-441a-9ac5-c111413df203 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:42.279394 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce45d8-7118-4643-b28e-b299b89ca782 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:42.279704 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce45d8-7118-4643-b28e-b299b89ca782 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:42.280035 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce45d8-7118-4643-b28e-b299b89ca782 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:42.282002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 523/1016] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:42.287337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4062e-49a5-4305-a7a3-7577184b9b2b None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:42.290726 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4062e-49a5-4305-a7a3-7577184b9b2b None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:42.290726 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4062e-49a5-4305-a7a3-7577184b9b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:42.305724 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-17d4062e-49a5-4305-a7a3-7577184b9b2b None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:42.306964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-17d4062e-49a5-4305-a7a3-7577184b9b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:42.328023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 494/1017] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jun 2 19:03:42 2022] POST /identity/v3/services => generated 242 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:42.373866 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:42.403408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 524/1018] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 19:03:42.428565 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c603ae-75ed-441a-9ac5-c111413df203 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:42.562506 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c603ae-75ed-441a-9ac5-c111413df203 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:42.578661 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:42.603491 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fddad7b-baa2-4eea-944f-724f682fdd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:42.604398 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddad7b-baa2-4eea-944f-724f682fdd6c None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:42.604680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddad7b-baa2-4eea-944f-724f682fdd6c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:42.604958 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddad7b-baa2-4eea-944f-724f682fdd6c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:42.630106 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fddad7b-baa2-4eea-944f-724f682fdd6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:03:42.635629 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-9fddad7b-baa2-4eea-944f-724f682fdd6c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 19:03:42.635629 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:42.635629 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:42.635629 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:42.635629 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:42.635629 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:42.635629 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:42.635629 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:42.635629 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:42.635629 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:42.635629 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:42.635629 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:42.635629 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:03:42.635629 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:03:42.635629 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:03:42.635629 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:03:42.636839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:03:42.636839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:03:42.636839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:03:42.636839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:03:42.636839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:42.636839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:42.636839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:42.636839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:42.636839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:42.636839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:42.636839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:42.636839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:42.636839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:42.636839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:42.636839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:42.636839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:42.637896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:42.637896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:42.637896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:42.637896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:42.637896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:03:42.637896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:03:42.637896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:03:42.637896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:03:42.637896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:03:42.637896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:03:42.637896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 19:03:42.637896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:42.637896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 495/1019] 10.222.0.45 () {56 vars in 1120 bytes} [Thu Jun 2 19:03:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:42.643352 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4062e-49a5-4305-a7a3-7577184b9b2b None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:42.778329 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4062e-49a5-4305-a7a3-7577184b9b2b None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:42.823541 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c4282-8af2-466b-aadb-b242d226f85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:42.824264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c4282-8af2-466b-aadb-b242d226f85e None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:42.824645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c4282-8af2-466b-aadb-b242d226f85e None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:42.824883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c4282-8af2-466b-aadb-b242d226f85e None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:42.825589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c4282-8af2-466b-aadb-b242d226f85e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:42.825901 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c4282-8af2-466b-aadb-b242d226f85e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:42.827323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c4282-8af2-466b-aadb-b242d226f85e None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:42.844487 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 525/1020] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Jun 2 19:03:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:42.846254 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fddad7b-baa2-4eea-944f-724f682fdd6c None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:42.966003 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fddad7b-baa2-4eea-944f-724f682fdd6c None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:43.003599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92abdc-f2a9-46f3-92a4-1ba826eff14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:43.004426 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92abdc-f2a9-46f3-92a4-1ba826eff14a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:43.004712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92abdc-f2a9-46f3-92a4-1ba826eff14a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:43.004989 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92abdc-f2a9-46f3-92a4-1ba826eff14a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:43.016498 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92abdc-f2a9-46f3-92a4-1ba826eff14a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:43.017974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92abdc-f2a9-46f3-92a4-1ba826eff14a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:43.037291 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-de92abdc-f2a9-46f3-92a4-1ba826eff14a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:43.037291 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:43.037291 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:43.037291 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:43.037291 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:43.037291 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:43.037291 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:43.037291 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:43.037291 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:43.037291 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:43.037291 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:43.037291 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:43.037291 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:43.037291 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:43.037291 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:43.038272 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:43.038272 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:43.038272 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:43.038272 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:43.038272 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:43.038272 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:43.038272 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:43.038272 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:43.038272 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:43.038272 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:43.038272 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:43.038272 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:43.038272 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:43.038272 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:43.038272 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:43.038272 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:43.038272 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:43.039271 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:43.039271 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:43.039271 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:43.039271 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:43.039271 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 496/1021] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:43.045423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c4282-8af2-466b-aadb-b242d226f85e None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:43.088090 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11ca00-089f-4c5f-9743-791fdc08e5ec None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:43.088381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11ca00-089f-4c5f-9743-791fdc08e5ec None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:43.088665 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11ca00-089f-4c5f-9743-791fdc08e5ec None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:43.090049 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 497/1022] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:03:43.095831 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a003573-8f3f-4376-a851-61b38ecc24d5 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:43.096154 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a003573-8f3f-4376-a851-61b38ecc24d5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:43.096607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a003573-8f3f-4376-a851-61b38ecc24d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:43.099429 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:43.113370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-6a003573-8f3f-4376-a851-61b38ecc24d5 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:43.114580 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6a003573-8f3f-4376-a851-61b38ecc24d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:43.134609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:43.166716 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c4282-8af2-466b-aadb-b242d226f85e None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:43.190464 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 498/1023] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 19:03:43.209393 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19a883-0424-435b-a36a-ef4e75dbe0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:43.210058 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19a883-0424-435b-a36a-ef4e75dbe0fb None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:43.210343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19a883-0424-435b-a36a-ef4e75dbe0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:43.210621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19a883-0424-435b-a36a-ef4e75dbe0fb None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:43.211410 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19a883-0424-435b-a36a-ef4e75dbe0fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:43.211721 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19a883-0424-435b-a36a-ef4e75dbe0fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:43.213440 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19a883-0424-435b-a36a-ef4e75dbe0fb None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:43.214434 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a003573-8f3f-4376-a851-61b38ecc24d5 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:43.231042 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 526/1024] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:43.234654 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19a883-0424-435b-a36a-ef4e75dbe0fb None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:43.334659 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a003573-8f3f-4376-a851-61b38ecc24d5 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:43.350042 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19a883-0424-435b-a36a-ef4e75dbe0fb None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:43.352479 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:43.371069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f81cbd-e61e-4a88-a582-f8ecf0704372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:43.371863 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f81cbd-e61e-4a88-a582-f8ecf0704372 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:43.372177 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f81cbd-e61e-4a88-a582-f8ecf0704372 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:43.372448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f81cbd-e61e-4a88-a582-f8ecf0704372 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:43.373684 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f81cbd-e61e-4a88-a582-f8ecf0704372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:43.375679 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f81cbd-e61e-4a88-a582-f8ecf0704372 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:43.377327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 499/1025] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:43.382885 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f81cbd-e61e-4a88-a582-f8ecf0704372 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:43.389515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba061b-3e96-4ab1-a34d-b02567bf29c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:43.390929 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba061b-3e96-4ab1-a34d-b02567bf29c6 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:43.391218 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba061b-3e96-4ab1-a34d-b02567bf29c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:43.391501 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba061b-3e96-4ab1-a34d-b02567bf29c6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:43.399496 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba061b-3e96-4ab1-a34d-b02567bf29c6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:43.401045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba061b-3e96-4ab1-a34d-b02567bf29c6 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:43.415068 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:43.416207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-63ba061b-3e96-4ab1-a34d-b02567bf29c6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 19:03:43.416207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:43.416207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:43.416207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:43.416207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:43.416207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:43.416207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:43.416207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:43.416207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:43.416207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:43.416207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:43.416207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:43.416207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:03:43.416207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:03:43.416207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:03:43.416207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:03:43.417176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:43.417176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:43.417176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:03:43.417176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:43.417176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:03:43.417176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:43.417176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:43.417176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:43.417176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:43.417176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:43.417176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:43.417176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:43.417176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:43.417176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:43.417176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:43.417176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:43.417176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:43.417176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:43.418158 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:43.418158 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:43.418158 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:03:43.418158 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:03:43.418158 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:03:43.418158 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:03:43.418158 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:03:43.418158 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:03:43.418158 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 19:03:43.418158 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:43.418158 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 527/1026] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Jun 2 19:03:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:43.423183 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba061b-3e96-4ab1-a34d-b02567bf29c6 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:43.518667 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f81cbd-e61e-4a88-a582-f8ecf0704372 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:43.550838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba061b-3e96-4ab1-a34d-b02567bf29c6 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:43.558247 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1f038-7ace-4ea7-976f-3c676d23d788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:43.558918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1f038-7ace-4ea7-976f-3c676d23d788 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:43.559200 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1f038-7ace-4ea7-976f-3c676d23d788 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:43.559474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1f038-7ace-4ea7-976f-3c676d23d788 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:43.560221 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1f038-7ace-4ea7-976f-3c676d23d788 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:43.562255 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1f038-7ace-4ea7-976f-3c676d23d788 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:43.589992 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87766335-834b-42bc-a9e5-51e0c93bf3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:43.590935 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87766335-834b-42bc-a9e5-51e0c93bf3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:43.598898 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87766335-834b-42bc-a9e5-51e0c93bf3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:43.598898 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87766335-834b-42bc-a9e5-51e0c93bf3f1 None admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:43.598898 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87766335-834b-42bc-a9e5-51e0c93bf3f1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:43.598898 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87766335-834b-42bc-a9e5-51e0c93bf3f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:43.598898 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87766335-834b-42bc-a9e5-51e0c93bf3f1 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:43.612415 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 528/1027] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Jun 2 19:03:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:43.618318 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87766335-834b-42bc-a9e5-51e0c93bf3f1 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:43.643358 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:43.705273 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 500/1028] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jun 2 19:03:43 2022] POST /identity/v3/projects => generated 311 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:03:43.724629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87766335-834b-42bc-a9e5-51e0c93bf3f1 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:43.771419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ab12c-0b1a-47b9-9881-d2a837cd4964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:43.772136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ab12c-0b1a-47b9-9881-d2a837cd4964 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:43.772351 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ab12c-0b1a-47b9-9881-d2a837cd4964 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:43.772629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ab12c-0b1a-47b9-9881-d2a837cd4964 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:43.857093 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ab12c-0b1a-47b9-9881-d2a837cd4964 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:43.859189 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ab12c-0b1a-47b9-9881-d2a837cd4964 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:43.887658 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:43.979212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 529/1029] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:03:43 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 19:03:43.985387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1f038-7ace-4ea7-976f-3c676d23d788 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:44.068339 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:44.095828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1f038-7ace-4ea7-976f-3c676d23d788 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:44.131936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8bf64-9528-4fd3-a284-63df8eee6493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:44.132776 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8bf64-9528-4fd3-a284-63df8eee6493 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:44.133194 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8bf64-9528-4fd3-a284-63df8eee6493 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:44.133366 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8bf64-9528-4fd3-a284-63df8eee6493 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:44.145772 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8bf64-9528-4fd3-a284-63df8eee6493 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:44.147242 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8bf64-9528-4fd3-a284-63df8eee6493 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:44.165162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-8dd8bf64-9528-4fd3-a284-63df8eee6493 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:44.165162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:44.165162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:44.165162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:44.165162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:44.165162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:44.165162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:44.165162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:44.165162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:44.165162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:44.165162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:44.165162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:44.165162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:44.165162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:44.165162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:44.166121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:44.166121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:44.166121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:44.166121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:44.166121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:44.166121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:44.166121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:44.166121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:44.166121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:44.166121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:44.166121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:44.166121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:44.166121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:44.166121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:44.166121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:44.166121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:44.166121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:44.167560 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:44.167560 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:44.167560 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:44.167560 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:44.167560 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 501/1030] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:44.172160 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ab12c-0b1a-47b9-9881-d2a837cd4964 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:44.275568 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ab12c-0b1a-47b9-9881-d2a837cd4964 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:44.299735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:44.312409 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339405ab-63e3-4735-a37a-d6f6bf946ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:44.313085 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339405ab-63e3-4735-a37a-d6f6bf946ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:44.313369 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339405ab-63e3-4735-a37a-d6f6bf946ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:44.313644 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339405ab-63e3-4735-a37a-d6f6bf946ff8 None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:44.314369 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339405ab-63e3-4735-a37a-d6f6bf946ff8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:44.314681 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339405ab-63e3-4735-a37a-d6f6bf946ff8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:44.316082 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339405ab-63e3-4735-a37a-d6f6bf946ff8 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:44.332381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 530/1031] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:44.333873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8bf64-9528-4fd3-a284-63df8eee6493 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:44.454451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8bf64-9528-4fd3-a284-63df8eee6493 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:44.482911 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:44.493860 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ffca6-0454-4823-a53d-dbadb00eecfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:44.494685 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ffca6-0454-4823-a53d-dbadb00eecfa None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:44.494970 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ffca6-0454-4823-a53d-dbadb00eecfa None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:44.495244 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ffca6-0454-4823-a53d-dbadb00eecfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:44.504056 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ffca6-0454-4823-a53d-dbadb00eecfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:44.505822 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ffca6-0454-4823-a53d-dbadb00eecfa None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:44.522107 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-2c3ffca6-0454-4823-a53d-dbadb00eecfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:44.522107 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:44.522107 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:44.522107 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:44.522107 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:44.522107 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:44.522107 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:44.522107 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:44.522107 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:44.522107 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:44.522107 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:44.522107 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:44.522107 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:03:44.522107 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:03:44.522107 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:03:44.523207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:03:44.523207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:44.523207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:44.523207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:44.523207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:44.523207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:44.523207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:44.523207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:44.523207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:44.523207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:44.523207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:44.523207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:44.523207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:44.523207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:44.523207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:44.523207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:44.523207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:44.524740 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:03:44.524740 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:03:44.524740 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:03:44.524740 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:03:44.524740 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:03:44.524740 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:03:44.524740 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:44.524740 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:44.528338 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 502/1032] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:03:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:44.529614 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339405ab-63e3-4735-a37a-d6f6bf946ff8 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:44.638962 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339405ab-63e3-4735-a37a-d6f6bf946ff8 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:44.674651 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97985d7c-0691-4233-8e1c-8a94163622c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:44.675315 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97985d7c-0691-4233-8e1c-8a94163622c7 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:44.675654 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97985d7c-0691-4233-8e1c-8a94163622c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:44.675936 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97985d7c-0691-4233-8e1c-8a94163622c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:44.676807 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97985d7c-0691-4233-8e1c-8a94163622c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:44.677113 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97985d7c-0691-4233-8e1c-8a94163622c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:44.678543 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97985d7c-0691-4233-8e1c-8a94163622c7 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:44.686357 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98977a-5d24-4d38-bc2f-4e93d0bd0541 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:44.687188 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98977a-5d24-4d38-bc2f-4e93d0bd0541 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:44.687457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98977a-5d24-4d38-bc2f-4e93d0bd0541 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:44.689135 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 503/1033] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:44.696304 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 531/1034] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:03:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:44.696463 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53560011-3ac8-4c6d-bd91-dc1d109f43d1 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:44.696463 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53560011-3ac8-4c6d-bd91-dc1d109f43d1 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:44.696463 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53560011-3ac8-4c6d-bd91-dc1d109f43d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:44.699321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97985d7c-0691-4233-8e1c-8a94163622c7 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:44.712621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-53560011-3ac8-4c6d-bd91-dc1d109f43d1 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:44.713836 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-53560011-3ac8-4c6d-bd91-dc1d109f43d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:44.751776 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:44.789523 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 504/1035] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 19:03:44.812859 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53560011-3ac8-4c6d-bd91-dc1d109f43d1 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:44.818100 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97985d7c-0691-4233-8e1c-8a94163622c7 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:44.859375 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1ed6d-78e0-46ec-bb18-a9191b381c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:44.860377 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1ed6d-78e0-46ec-bb18-a9191b381c67 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:44.860943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1ed6d-78e0-46ec-bb18-a9191b381c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:44.861227 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1ed6d-78e0-46ec-bb18-a9191b381c67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:44.862130 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1ed6d-78e0-46ec-bb18-a9191b381c67 None admin] RBAC: Adding query filter params (role.id=788c05993fb0458a9a2f4d2bd3cf9a34, scope.project.id=b11b7e66a993492d8163097bce955c0b, user.id=575f61ef70314f86b5d9dad3ba1b3aab) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:44.862439 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1ed6d-78e0-46ec-bb18-a9191b381c67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:44.864529 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1ed6d-78e0-46ec-bb18-a9191b381c67 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:44.870373 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 532/1036] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:03:44 2022] GET /identity/v3/role_assignments?user.id=575f61ef70314f86b5d9dad3ba1b3aab&scope.project.id=b11b7e66a993492d8163097bce955c0b&role.id=788c05993fb0458a9a2f4d2bd3cf9a34 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:44.928062 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53560011-3ac8-4c6d-bd91-dc1d109f43d1 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:44.948200 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:44.969775 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1105f0d-03ca-4b47-97aa-4615104e3b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:44.970590 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1105f0d-03ca-4b47-97aa-4615104e3b92 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:44.970969 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1105f0d-03ca-4b47-97aa-4615104e3b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:44.971215 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1105f0d-03ca-4b47-97aa-4615104e3b92 None admin] PATH_INFO: `/v3/services/image` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:44.971877 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1105f0d-03ca-4b47-97aa-4615104e3b92 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:44.973317 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1105f0d-03ca-4b47-97aa-4615104e3b92 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:44.990680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-e1105f0d-03ca-4b47-97aa-4615104e3b92 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 19:03:44.990680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:44.990680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 19:03:44.990680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 19:03:44.990680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 19:03:44.990680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 19:03:44.990680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 19:03:44.990680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:44.990680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 19:03:44.990680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:44.990680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:03:44.990680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:44.990680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:44.990680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:44.990680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:44.990680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:44.990680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:44.997588 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:44.997588 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:44.997588 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:44.997588 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:44.997588 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:44.997588 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:44.997588 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 19:03:44.997588 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 19:03:44.997588 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 19:03:44.997588 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 19:03:44.997588 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:44.997588 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:44.997588 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:44.997588 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:44.997588 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:44.997588 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:44.998484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:44.998484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:44.998484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:44.998484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:44.998484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:44.998484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:44.998484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:44.998484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:44.998484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:44.998484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:44.998484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 19:03:44.998484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:44.998484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 19:03:44.998484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:44.998484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 505/1037] 10.222.0.45 () {56 vars in 1105 bytes} [Thu Jun 2 19:03:44 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:44.999901 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1ed6d-78e0-46ec-bb18-a9191b381c67 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:45.113921 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1ed6d-78e0-46ec-bb18-a9191b381c67 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:45.121232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:45.149373 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289f6ca-e841-4dfc-bf31-f52d0087ab06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:45.150062 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289f6ca-e841-4dfc-bf31-f52d0087ab06 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:45.150461 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289f6ca-e841-4dfc-bf31-f52d0087ab06 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:45.150742 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289f6ca-e841-4dfc-bf31-f52d0087ab06 None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:45.151472 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289f6ca-e841-4dfc-bf31-f52d0087ab06 None admin] RBAC: Adding query filter params (name=image) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:45.151778 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289f6ca-e841-4dfc-bf31-f52d0087ab06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:45.153237 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289f6ca-e841-4dfc-bf31-f52d0087ab06 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:45.164269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 533/1038] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:45.166186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1105f0d-03ca-4b47-97aa-4615104e3b92 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:45.275621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1105f0d-03ca-4b47-97aa-4615104e3b92 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:45.309956 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d1de3-2e61-4ce9-9875-21b09ead2339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:45.310621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d1de3-2e61-4ce9-9875-21b09ead2339 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:45.310900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d1de3-2e61-4ce9-9875-21b09ead2339 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:45.311171 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d1de3-2e61-4ce9-9875-21b09ead2339 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:45.312440 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d1de3-2e61-4ce9-9875-21b09ead2339 None admin] RBAC: Adding query filter params (type=image) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:45.312742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d1de3-2e61-4ce9-9875-21b09ead2339 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:45.314105 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d1de3-2e61-4ce9-9875-21b09ead2339 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:45.328078 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 506/1039] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:45.330192 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289f6ca-e841-4dfc-bf31-f52d0087ab06 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:45.436372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289f6ca-e841-4dfc-bf31-f52d0087ab06 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:45.472314 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44579d39-b8ae-48e2-8ff7-c6fc0b467f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:45.472969 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44579d39-b8ae-48e2-8ff7-c6fc0b467f75 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:45.473249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44579d39-b8ae-48e2-8ff7-c6fc0b467f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:45.473518 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44579d39-b8ae-48e2-8ff7-c6fc0b467f75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:45.474296 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44579d39-b8ae-48e2-8ff7-c6fc0b467f75 None admin] RBAC: Adding query filter params (interface=public, service_id=33e2ccee9d264fdba75191d616bbfe60, region_id=RegionOne) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:45.474600 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44579d39-b8ae-48e2-8ff7-c6fc0b467f75 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:45.475974 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44579d39-b8ae-48e2-8ff7-c6fc0b467f75 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:45.481798 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 534/1040] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Jun 2 19:03:45 2022] GET /identity/v3/endpoints?service_id=33e2ccee9d264fdba75191d616bbfe60&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:45.487732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d1de3-2e61-4ce9-9875-21b09ead2339 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:45.538148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:45.595630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d1de3-2e61-4ce9-9875-21b09ead2339 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:45.630500 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea9a87-d7be-4e00-9e4d-d271843be2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:45.631174 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea9a87-d7be-4e00-9e4d-d271843be2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:45.631458 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea9a87-d7be-4e00-9e4d-d271843be2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:45.631734 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea9a87-d7be-4e00-9e4d-d271843be2a8 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:45.632447 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea9a87-d7be-4e00-9e4d-d271843be2a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:45.633929 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea9a87-d7be-4e00-9e4d-d271843be2a8 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:45.652043 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 507/1041] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Jun 2 19:03:45 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:03:46.089952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9280a2-491f-4108-a306-91caf02c6385 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:46.090360 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9280a2-491f-4108-a306-91caf02c6385 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:46.090800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9280a2-491f-4108-a306-91caf02c6385 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:46.092356 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 535/1042] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:46.098361 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06cc77-17c6-4ba6-ad30-2a37530ee1fe None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:46.098883 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06cc77-17c6-4ba6-ad30-2a37530ee1fe None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:46.098982 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06cc77-17c6-4ba6-ad30-2a37530ee1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:46.116344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-8d06cc77-17c6-4ba6-ad30-2a37530ee1fe None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:46.117529 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8d06cc77-17c6-4ba6-ad30-2a37530ee1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:46.197470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 508/1043] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:03:46.222906 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9280a2-491f-4108-a306-91caf02c6385 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:46.263327 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:46.341822 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9280a2-491f-4108-a306-91caf02c6385 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:46.384484 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f5da3-2084-407d-9a55-12ece5b5cd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:46.385314 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f5da3-2084-407d-9a55-12ece5b5cd85 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:46.385600 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f5da3-2084-407d-9a55-12ece5b5cd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:46.385874 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f5da3-2084-407d-9a55-12ece5b5cd85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:46.387177 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f5da3-2084-407d-9a55-12ece5b5cd85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:46.388695 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f5da3-2084-407d-9a55-12ece5b5cd85 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:46.396305 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 536/1044] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:46.397450 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06cc77-17c6-4ba6-ad30-2a37530ee1fe None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:46.443505 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:46.519962 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06cc77-17c6-4ba6-ad30-2a37530ee1fe None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:46.558478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b20a26-9b00-4289-bd2c-95a1d4a9fd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:46.559267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b20a26-9b00-4289-bd2c-95a1d4a9fd8e None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:46.559622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b20a26-9b00-4289-bd2c-95a1d4a9fd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:46.559967 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b20a26-9b00-4289-bd2c-95a1d4a9fd8e None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:46.560803 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b20a26-9b00-4289-bd2c-95a1d4a9fd8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:46.562929 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b20a26-9b00-4289-bd2c-95a1d4a9fd8e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:46.690405 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 509/1045] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jun 2 19:03:46 2022] POST /identity/v3/users => generated 285 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:03:47.168833 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516b8c2-7cf4-4e90-8730-542fbbf6bbcd None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:47.169225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516b8c2-7cf4-4e90-8730-542fbbf6bbcd None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:47.169401 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516b8c2-7cf4-4e90-8730-542fbbf6bbcd None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:47.171427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 537/1046] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:47.176841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec9c1c-3df8-4201-8417-a3fa62e4bd1f None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:47.177331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec9c1c-3df8-4201-8417-a3fa62e4bd1f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:47.177420 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec9c1c-3df8-4201-8417-a3fa62e4bd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:47.194845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-e7ec9c1c-3df8-4201-8417-a3fa62e4bd1f None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:47.196038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e7ec9c1c-3df8-4201-8417-a3fa62e4bd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:47.268710 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 510/1047] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:03:47.292032 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516b8c2-7cf4-4e90-8730-542fbbf6bbcd None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:47.402233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516b8c2-7cf4-4e90-8730-542fbbf6bbcd None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:47.404086 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:47.438662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9956e46-792d-4d70-a076-4abcd6e4d752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:47.439517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9956e46-792d-4d70-a076-4abcd6e4d752 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:47.439820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9956e46-792d-4d70-a076-4abcd6e4d752 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:47.440135 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9956e46-792d-4d70-a076-4abcd6e4d752 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:47.451731 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9956e46-792d-4d70-a076-4abcd6e4d752 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:03:47.460707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-c9956e46-792d-4d70-a076-4abcd6e4d752 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 19:03:47.460707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:47.460707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:47.460707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:47.460707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:47.460707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:47.460707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:47.460707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:47.460707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:47.460707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:47.460707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:47.460707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:47.460707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:03:47.460707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:03:47.460707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:03:47.460707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:03:47.461724 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:03:47.461724 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:03:47.461724 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:03:47.461724 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:03:47.461724 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:47.461724 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:47.461724 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:47.461724 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:47.461724 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:47.461724 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:47.461724 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:47.461724 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:47.461724 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:47.461724 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:47.461724 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:47.461724 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:47.462561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:47.462561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:47.462561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:47.462561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:47.462561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:03:47.462561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:03:47.462561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:03:47.462561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:03:47.462561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:03:47.462561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:03:47.462561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 19:03:47.462561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:47.462561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 538/1048] 10.222.0.45 () {56 vars in 1120 bytes} [Thu Jun 2 19:03:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:47.470647 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec9c1c-3df8-4201-8417-a3fa62e4bd1f None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:47.497601 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:47.576691 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec9c1c-3df8-4201-8417-a3fa62e4bd1f None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:47.613404 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5990a47-d225-4ca9-b5f0-ecec6de23576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:47.614500 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5990a47-d225-4ca9-b5f0-ecec6de23576 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:47.615028 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5990a47-d225-4ca9-b5f0-ecec6de23576 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:47.615512 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5990a47-d225-4ca9-b5f0-ecec6de23576 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:47.616562 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5990a47-d225-4ca9-b5f0-ecec6de23576 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:47.617096 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5990a47-d225-4ca9-b5f0-ecec6de23576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:47.618742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5990a47-d225-4ca9-b5f0-ecec6de23576 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:47.630597 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 511/1049] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Jun 2 19:03:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:47.636931 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9956e46-792d-4d70-a076-4abcd6e4d752 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:47.742788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9956e46-792d-4d70-a076-4abcd6e4d752 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:47.779040 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6478a98-9919-42c0-a7b8-efda9c5e4d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:47.781002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6478a98-9919-42c0-a7b8-efda9c5e4d57 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:47.781504 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6478a98-9919-42c0-a7b8-efda9c5e4d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:47.781976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6478a98-9919-42c0-a7b8-efda9c5e4d57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:47.793273 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6478a98-9919-42c0-a7b8-efda9c5e4d57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:47.795055 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6478a98-9919-42c0-a7b8-efda9c5e4d57 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:47.814338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-f6478a98-9919-42c0-a7b8-efda9c5e4d57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:47.814338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:47.814338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:47.814338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:47.814338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:47.814338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:47.814338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:47.814338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:47.814338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:47.814338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:47.814338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:47.814338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:47.814338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:47.814338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:47.814338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:47.815288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:47.815288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:47.815288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:47.815288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:47.815288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:47.815288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:47.815288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:47.815288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:47.815288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:47.815288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:47.815288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:47.815288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:47.815288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:47.815288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:47.815288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:47.815288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:47.815288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:47.820879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:47.820879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:47.820879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:47.820879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:47.820879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 539/1050] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:47.822592 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5990a47-d225-4ca9-b5f0-ecec6de23576 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:47.917226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:47.932981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5990a47-d225-4ca9-b5f0-ecec6de23576 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:47.955104 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713dbdd-54d6-435d-b788-4239ec605289 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:47.955104 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713dbdd-54d6-435d-b788-4239ec605289 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:47.955104 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713dbdd-54d6-435d-b788-4239ec605289 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:47.955104 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 540/1051] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:47.960407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f5d17-4f11-47f5-9435-d53da55c1331 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:47.960702 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f5d17-4f11-47f5-9435-d53da55c1331 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:47.960982 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f5d17-4f11-47f5-9435-d53da55c1331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:47.971250 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a895fcc-f484-4973-b6a8-8bb094d5ac86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:47.971925 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a895fcc-f484-4973-b6a8-8bb094d5ac86 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:47.972235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a895fcc-f484-4973-b6a8-8bb094d5ac86 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:47.972510 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a895fcc-f484-4973-b6a8-8bb094d5ac86 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:47.973234 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a895fcc-f484-4973-b6a8-8bb094d5ac86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:47.973544 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a895fcc-f484-4973-b6a8-8bb094d5ac86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:47.974918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a895fcc-f484-4973-b6a8-8bb094d5ac86 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:47.979749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-f57f5d17-4f11-47f5-9435-d53da55c1331 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:47.980976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-f57f5d17-4f11-47f5-9435-d53da55c1331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:47.992517 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 512/1052] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:47.994985 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:47.995581 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a895fcc-f484-4973-b6a8-8bb094d5ac86 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:48.063926 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 541/1053] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:03:48.087789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f5d17-4f11-47f5-9435-d53da55c1331 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:48.113480 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a895fcc-f484-4973-b6a8-8bb094d5ac86 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:48.150343 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727368b-a940-4ecb-b8a6-f209f939113e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:48.151135 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727368b-a940-4ecb-b8a6-f209f939113e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:48.151424 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727368b-a940-4ecb-b8a6-f209f939113e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:48.151698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727368b-a940-4ecb-b8a6-f209f939113e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:48.159943 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c727368b-a940-4ecb-b8a6-f209f939113e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:48.161398 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c727368b-a940-4ecb-b8a6-f209f939113e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:48.176313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-c727368b-a940-4ecb-b8a6-f209f939113e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 19:03:48.176313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:48.176313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:48.176313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:48.176313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:48.176313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:48.176313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:48.176313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:48.176313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:48.176313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:48.176313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:48.176313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:48.176313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:03:48.176313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:03:48.176313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:03:48.176313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:03:48.177778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:48.177778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:48.177778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:03:48.177778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:48.177778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:03:48.177778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:48.177778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:48.177778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:48.177778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:48.177778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:48.177778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:48.177778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:48.177778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:48.177778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:48.177778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:48.177778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:48.177778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:48.177778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:48.178745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:48.178745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:48.178745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:03:48.178745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:03:48.178745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:03:48.178745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:03:48.178745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:03:48.178745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:03:48.178745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 19:03:48.178745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:48.178745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 513/1054] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Jun 2 19:03:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:48.183892 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727368b-a940-4ecb-b8a6-f209f939113e None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:48.192974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:48.201024 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f5d17-4f11-47f5-9435-d53da55c1331 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:48.241504 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fedece-fb99-40da-bbaf-d8f9dc7e1a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:48.242305 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fedece-fb99-40da-bbaf-d8f9dc7e1a68 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:48.242590 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fedece-fb99-40da-bbaf-d8f9dc7e1a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:48.242862 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fedece-fb99-40da-bbaf-d8f9dc7e1a68 None admin] PATH_INFO: `/v3/services/image` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:48.243511 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fedece-fb99-40da-bbaf-d8f9dc7e1a68 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:48.245313 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fedece-fb99-40da-bbaf-d8f9dc7e1a68 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:48.257536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-61fedece-fb99-40da-bbaf-d8f9dc7e1a68 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 19:03:48.257536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:48.257536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 19:03:48.257536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 19:03:48.257536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 19:03:48.257536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 19:03:48.257536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 19:03:48.257536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:48.257536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 19:03:48.257536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:48.257536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:03:48.257536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:48.257536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:48.257536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:48.257536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:48.257536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:48.257536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:48.258663 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:48.258663 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:48.258663 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:48.258663 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:48.258663 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:48.258663 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:48.258663 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 19:03:48.258663 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 19:03:48.258663 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 19:03:48.258663 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 19:03:48.258663 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:48.258663 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:48.258663 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:48.258663 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:48.258663 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:48.258663 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:48.260884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:48.260884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:48.260884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:48.260884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:48.260884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:48.260884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:48.260884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:48.260884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:48.260884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:48.260884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:48.260884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 19:03:48.260884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:03:48.260884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 19:03:48.260884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:48.260884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 542/1055] 10.222.0.45 () {56 vars in 1105 bytes} [Thu Jun 2 19:03:48 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:48.264740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fedece-fb99-40da-bbaf-d8f9dc7e1a68 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:48.278054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:48.290653 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727368b-a940-4ecb-b8a6-f209f939113e None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:48.328669 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731726d1-3ed6-4edc-af95-3a0e2a3bbe1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:48.329619 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731726d1-3ed6-4edc-af95-3a0e2a3bbe1a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:48.329907 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731726d1-3ed6-4edc-af95-3a0e2a3bbe1a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:48.330175 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731726d1-3ed6-4edc-af95-3a0e2a3bbe1a None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:48.331007 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731726d1-3ed6-4edc-af95-3a0e2a3bbe1a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:48.331312 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731726d1-3ed6-4edc-af95-3a0e2a3bbe1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:48.332740 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731726d1-3ed6-4edc-af95-3a0e2a3bbe1a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:48.359342 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 514/1056] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Jun 2 19:03:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:48.360677 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731726d1-3ed6-4edc-af95-3a0e2a3bbe1a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:48.383280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fedece-fb99-40da-bbaf-d8f9dc7e1a68 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:48.425937 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:48.427404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc1962-f218-47da-9cbb-73a97b4ca740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:48.429793 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc1962-f218-47da-9cbb-73a97b4ca740 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:48.429793 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc1962-f218-47da-9cbb-73a97b4ca740 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:48.429793 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc1962-f218-47da-9cbb-73a97b4ca740 None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:48.429793 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc1962-f218-47da-9cbb-73a97b4ca740 None admin] RBAC: Adding query filter params (name=image) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:48.429793 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc1962-f218-47da-9cbb-73a97b4ca740 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:48.431029 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc1962-f218-47da-9cbb-73a97b4ca740 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:48.440765 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 543/1057] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:48.441871 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc1962-f218-47da-9cbb-73a97b4ca740 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:48.467258 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731726d1-3ed6-4edc-af95-3a0e2a3bbe1a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:48.506201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af072d-17d1-4658-8613-6ee9f7ac44d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:48.506927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af072d-17d1-4658-8613-6ee9f7ac44d1 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:48.507210 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af072d-17d1-4658-8613-6ee9f7ac44d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:48.507485 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af072d-17d1-4658-8613-6ee9f7ac44d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:48.516619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:48.518480 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af072d-17d1-4658-8613-6ee9f7ac44d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:48.519920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af072d-17d1-4658-8613-6ee9f7ac44d1 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:48.541661 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-b7af072d-17d1-4658-8613-6ee9f7ac44d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:48.541661 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:48.541661 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:48.541661 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:48.541661 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:48.541661 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:48.541661 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:48.541661 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:48.541661 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:48.541661 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:48.541661 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:48.541661 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:48.541661 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:48.541661 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:48.541661 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:48.542634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:48.542634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:48.542634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:48.542634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:48.542634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:48.542634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:48.542634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:48.542634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:48.542634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:48.542634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:48.542634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:48.542634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:48.542634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:48.542634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:48.542634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:48.542634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:48.542634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:48.543542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:48.543542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:48.543542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:48.543542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:48.543542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 515/1058] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:48.549110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af072d-17d1-4658-8613-6ee9f7ac44d1 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:48.555329 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc1962-f218-47da-9cbb-73a97b4ca740 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:48.593671 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bab1d2-7805-4888-95b6-ec5118d6d30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:48.594373 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bab1d2-7805-4888-95b6-ec5118d6d30a None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:48.594656 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bab1d2-7805-4888-95b6-ec5118d6d30a None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:48.594929 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bab1d2-7805-4888-95b6-ec5118d6d30a None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:48.595666 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bab1d2-7805-4888-95b6-ec5118d6d30a None admin] RBAC: Adding query filter params (type=image) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:48.595976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bab1d2-7805-4888-95b6-ec5118d6d30a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:48.597427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bab1d2-7805-4888-95b6-ec5118d6d30a None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:48.607333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 544/1059] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:48.608484 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bab1d2-7805-4888-95b6-ec5118d6d30a None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:48.668320 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af072d-17d1-4658-8613-6ee9f7ac44d1 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:48.689259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:48.708560 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf7bc2-a8a3-4082-8bbb-ea8a1b5f5c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:48.709221 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf7bc2-a8a3-4082-8bbb-ea8a1b5f5c65 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:48.709508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf7bc2-a8a3-4082-8bbb-ea8a1b5f5c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:48.709794 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf7bc2-a8a3-4082-8bbb-ea8a1b5f5c65 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:48.710551 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf7bc2-a8a3-4082-8bbb-ea8a1b5f5c65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:48.710862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf7bc2-a8a3-4082-8bbb-ea8a1b5f5c65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:48.712313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf7bc2-a8a3-4082-8bbb-ea8a1b5f5c65 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:48.725767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 516/1060] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:48.731771 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf7bc2-a8a3-4082-8bbb-ea8a1b5f5c65 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:48.746805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bab1d2-7805-4888-95b6-ec5118d6d30a None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:48.782941 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c20f42-4c0e-45fc-8863-e2c08cd7cc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:48.783518 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c20f42-4c0e-45fc-8863-e2c08cd7cc86 None admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:48.783805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c20f42-4c0e-45fc-8863-e2c08cd7cc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:48.784109 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c20f42-4c0e-45fc-8863-e2c08cd7cc86 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:48.784844 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c20f42-4c0e-45fc-8863-e2c08cd7cc86 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:48.786258 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c20f42-4c0e-45fc-8863-e2c08cd7cc86 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:48.798250 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:48.838525 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf7bc2-a8a3-4082-8bbb-ea8a1b5f5c65 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:48.872193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe068fe-605a-4054-a7b2-a85c35574e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:48.872997 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe068fe-605a-4054-a7b2-a85c35574e10 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:48.873280 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe068fe-605a-4054-a7b2-a85c35574e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:48.873559 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe068fe-605a-4054-a7b2-a85c35574e10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:48.879746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 545/1061] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Jun 2 19:03:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:48.899386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe068fe-605a-4054-a7b2-a85c35574e10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:48.899386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe068fe-605a-4054-a7b2-a85c35574e10 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:48.899386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-dbe068fe-605a-4054-a7b2-a85c35574e10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:48.899386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:48.899386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:48.899386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:48.899386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:48.899386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:48.899386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:48.899386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:48.899386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:48.899386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:48.900389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:48.900389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:48.900389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:03:48.900389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:03:48.900389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:03:48.900389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:03:48.900389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:48.900389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:48.900389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:48.900389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:48.900389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:48.900389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:48.900389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:48.900389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:48.900389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:48.900389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:48.900389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:48.901332 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:48.901332 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:48.901332 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:48.901332 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:48.901332 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:48.901332 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:03:48.901332 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:03:48.901332 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:03:48.901332 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:03:48.901332 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:03:48.901332 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:03:48.901332 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:48.901332 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:48.904376 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 517/1062] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:03:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:48.907462 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c20f42-4c0e-45fc-8863-e2c08cd7cc86 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:49.046107 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c20f42-4c0e-45fc-8863-e2c08cd7cc86 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:49.057777 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8de72-e510-47ab-be6b-c0e75eaf458f None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:49.058115 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8de72-e510-47ab-be6b-c0e75eaf458f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:49.058332 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8de72-e510-47ab-be6b-c0e75eaf458f None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:49.059776 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 518/1063] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:03:49.066174 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c205de-7278-4849-a65a-953b87ffff27 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:49.066462 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c205de-7278-4849-a65a-953b87ffff27 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:49.066749 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c205de-7278-4849-a65a-953b87ffff27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:49.085543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-83c205de-7278-4849-a65a-953b87ffff27 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:49.086912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-83c205de-7278-4849-a65a-953b87ffff27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:49.099132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a129a-8c95-4d62-bedc-5e29d7ac6f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:49.099807 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a129a-8c95-4d62-bedc-5e29d7ac6f00 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:49.100121 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a129a-8c95-4d62-bedc-5e29d7ac6f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:49.100401 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a129a-8c95-4d62-bedc-5e29d7ac6f00 None admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:49.101203 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a129a-8c95-4d62-bedc-5e29d7ac6f00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:49.101512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a129a-8c95-4d62-bedc-5e29d7ac6f00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:49.102969 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a129a-8c95-4d62-bedc-5e29d7ac6f00 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:49.118648 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 546/1064] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:03:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:49.125627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a129a-8c95-4d62-bedc-5e29d7ac6f00 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:49.127085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:49.176514 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 519/1065] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 19:03:49.194654 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:49.200754 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c205de-7278-4849-a65a-953b87ffff27 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:49.267600 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a129a-8c95-4d62-bedc-5e29d7ac6f00 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:49.320107 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9997a-fd0a-4acd-bf7d-2f11c6149c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:49.321511 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9997a-fd0a-4acd-bf7d-2f11c6149c57 None admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:49.322316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9997a-fd0a-4acd-bf7d-2f11c6149c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:49.323049 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9997a-fd0a-4acd-bf7d-2f11c6149c57 None admin] PATH_INFO: `/v3/projects/b11b7e66a993492d8163097bce955c0b/users/575f61ef70314f86b5d9dad3ba1b3aab/roles/788c05993fb0458a9a2f4d2bd3cf9a34` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:49.324684 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c205de-7278-4849-a65a-953b87ffff27 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:49.325893 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9997a-fd0a-4acd-bf7d-2f11c6149c57 None admin] RBAC: Authorizing `identity:create_grant(project_id=b11b7e66a993492d8163097bce955c0b, user_id=575f61ef70314f86b5d9dad3ba1b3aab, role_id=788c05993fb0458a9a2f4d2bd3cf9a34)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:49.328674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9997a-fd0a-4acd-bf7d-2f11c6149c57 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:49.364825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db296c-c57c-4656-bb12-cd4e8b00ceb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:49.365615 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db296c-c57c-4656-bb12-cd4e8b00ceb2 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:49.365892 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db296c-c57c-4656-bb12-cd4e8b00ceb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:49.366160 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db296c-c57c-4656-bb12-cd4e8b00ceb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:49.378970 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db296c-c57c-4656-bb12-cd4e8b00ceb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:03:49.391290 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-d8db296c-c57c-4656-bb12-cd4e8b00ceb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:03:49.391290 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:49.391290 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:49.391290 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:49.391290 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:49.391290 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:49.391290 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:49.391290 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:49.391290 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:49.391290 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:49.391290 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:49.391290 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:49.391290 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:03:49.391290 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:03:49.391290 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:03:49.391290 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:03:49.392377 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:03:49.392377 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:03:49.392377 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:03:49.392377 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:03:49.392377 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:49.392377 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:49.392377 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:49.392377 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:49.392377 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:49.392377 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:49.392377 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:49.392377 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:49.392377 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:49.392377 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:49.392377 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:49.392377 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:49.393281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:49.393281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:49.393281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:49.393281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:49.393281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:03:49.393281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:03:49.393281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:03:49.393281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:03:49.393281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:03:49.393281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:03:49.393281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:03:49.393281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:49.393281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 520/1066] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:03:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:49.394915 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db296c-c57c-4656-bb12-cd4e8b00ceb2 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:49.437699 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 547/1067] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jun 2 19:03:49 2022] PUT /identity/v3/projects/b11b7e66a993492d8163097bce955c0b/users/575f61ef70314f86b5d9dad3ba1b3aab/roles/788c05993fb0458a9a2f4d2bd3cf9a34 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:03:49.441354 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:49.536024 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db296c-c57c-4656-bb12-cd4e8b00ceb2 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:49.581244 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61aa7e2-1483-4e2d-b39f-11ef178ec597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:49.581937 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61aa7e2-1483-4e2d-b39f-11ef178ec597 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:49.582219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61aa7e2-1483-4e2d-b39f-11ef178ec597 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:49.582494 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61aa7e2-1483-4e2d-b39f-11ef178ec597 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:49.583409 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61aa7e2-1483-4e2d-b39f-11ef178ec597 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:49.583729 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61aa7e2-1483-4e2d-b39f-11ef178ec597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:49.585197 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61aa7e2-1483-4e2d-b39f-11ef178ec597 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:49.595451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 521/1068] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:03:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:49.601290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9997a-fd0a-4acd-bf7d-2f11c6149c57 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:49.748249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9997a-fd0a-4acd-bf7d-2f11c6149c57 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:49.760851 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:49.796246 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cd652-495a-4f04-97a4-0b15218ae165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:49.797273 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cd652-495a-4f04-97a4-0b15218ae165 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:49.797995 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cd652-495a-4f04-97a4-0b15218ae165 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:49.800115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cd652-495a-4f04-97a4-0b15218ae165 None admin] PATH_INFO: `/v3/users/212ee5d3e4f446938fca3127ef8fb8c8` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:49.822266 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cd652-495a-4f04-97a4-0b15218ae165 None admin] RBAC: Authorizing `identity:get_user(user_id=212ee5d3e4f446938fca3127ef8fb8c8)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:49.823850 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cd652-495a-4f04-97a4-0b15218ae165 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:49.825888 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 548/1069] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:03:49 2022] GET /identity/v3/users/212ee5d3e4f446938fca3127ef8fb8c8 => generated 285 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:49.832256 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61aa7e2-1483-4e2d-b39f-11ef178ec597 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:49.948327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:49.967116 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61aa7e2-1483-4e2d-b39f-11ef178ec597 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:50.029274 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf117a2-a0c8-4384-8d11-62d108a90042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:50.030387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf117a2-a0c8-4384-8d11-62d108a90042 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:50.030865 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf117a2-a0c8-4384-8d11-62d108a90042 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:50.031357 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf117a2-a0c8-4384-8d11-62d108a90042 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:50.139517 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf117a2-a0c8-4384-8d11-62d108a90042 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:50.141447 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf117a2-a0c8-4384-8d11-62d108a90042 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:50.256353 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:50.283212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 522/1070] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:03:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 19:03:50.285280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cd652-495a-4f04-97a4-0b15218ae165 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:50.416898 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cd652-495a-4f04-97a4-0b15218ae165 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:50.468880 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed680b-16d2-4b4c-bde7-eac956e9bb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:50.470358 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed680b-16d2-4b4c-bde7-eac956e9bb49 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:50.470785 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed680b-16d2-4b4c-bde7-eac956e9bb49 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:50.471212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed680b-16d2-4b4c-bde7-eac956e9bb49 None admin] PATH_INFO: `/v3/projects/5bea7d5122844cee936bf3e30d87b6ee` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:50.473285 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed680b-16d2-4b4c-bde7-eac956e9bb49 None admin] RBAC: Authorizing `identity:get_project(project_id=5bea7d5122844cee936bf3e30d87b6ee)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:50.475687 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed680b-16d2-4b4c-bde7-eac956e9bb49 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:50.484303 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 549/1071] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:03:50 2022] GET /identity/v3/projects/5bea7d5122844cee936bf3e30d87b6ee => generated 311 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:50.488575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf117a2-a0c8-4384-8d11-62d108a90042 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:50.670779 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf117a2-a0c8-4384-8d11-62d108a90042 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:50.736723 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650b49c-f545-46a6-8ee0-8455dd2255b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:50.738336 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650b49c-f545-46a6-8ee0-8455dd2255b0 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:50.739120 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650b49c-f545-46a6-8ee0-8455dd2255b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:50.739896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650b49c-f545-46a6-8ee0-8455dd2255b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:50.741795 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650b49c-f545-46a6-8ee0-8455dd2255b0 None admin] RBAC: Adding query filter params (role.id=4588ca63994f4e2d9ce482d475edbabd, scope.project.id=5bea7d5122844cee936bf3e30d87b6ee, user.id=212ee5d3e4f446938fca3127ef8fb8c8) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:50.742574 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650b49c-f545-46a6-8ee0-8455dd2255b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:50.745416 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650b49c-f545-46a6-8ee0-8455dd2255b0 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:50.765294 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 523/1072] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:03:50 2022] GET /identity/v3/role_assignments?user.id=212ee5d3e4f446938fca3127ef8fb8c8&scope.project.id=5bea7d5122844cee936bf3e30d87b6ee&role.id=4588ca63994f4e2d9ce482d475edbabd => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:51.294832 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a1867-1b64-4a4d-b6b9-ad4556bcde06 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:51.295387 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a1867-1b64-4a4d-b6b9-ad4556bcde06 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:51.296371 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a1867-1b64-4a4d-b6b9-ad4556bcde06 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:51.298820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 550/1073] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:51.304922 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ecb65-ab5f-4bc7-a2e9-833d1c7f666c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:51.305625 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ecb65-ab5f-4bc7-a2e9-833d1c7f666c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:51.305625 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ecb65-ab5f-4bc7-a2e9-833d1c7f666c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:51.325336 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-e31ecb65-ab5f-4bc7-a2e9-833d1c7f666c None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:51.326728 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e31ecb65-ab5f-4bc7-a2e9-833d1c7f666c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:51.384572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:51.411072 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 524/1074] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 19:03:51.435691 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a1867-1b64-4a4d-b6b9-ad4556bcde06 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:51.498543 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:51.622135 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a1867-1b64-4a4d-b6b9-ad4556bcde06 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:51.687448 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bea5c-17f9-4e23-96b6-d0d2bfa0c67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:51.688581 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bea5c-17f9-4e23-96b6-d0d2bfa0c67e None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:51.689073 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bea5c-17f9-4e23-96b6-d0d2bfa0c67e None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:51.689560 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bea5c-17f9-4e23-96b6-d0d2bfa0c67e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:51.769505 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98d398-8a8a-4e7d-8e6d-8371cf303166 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:51.769781 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98d398-8a8a-4e7d-8e6d-8371cf303166 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:51.770072 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98d398-8a8a-4e7d-8e6d-8371cf303166 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:51.771778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 525/1075] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:03:51.777326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6144c2-8b05-47e8-9f0d-2a71c5d2334c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:51.777719 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6144c2-8b05-47e8-9f0d-2a71c5d2334c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:51.777977 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6144c2-8b05-47e8-9f0d-2a71c5d2334c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:51.791097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390bea5c-17f9-4e23-96b6-d0d2bfa0c67e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:51.792725 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390bea5c-17f9-4e23-96b6-d0d2bfa0c67e None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:51.803675 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-8c6144c2-8b05-47e8-9f0d-2a71c5d2334c None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:51.805042 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8c6144c2-8b05-47e8-9f0d-2a71c5d2334c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:51.847181 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:51.893441 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 526/1076] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 19:03:51.930725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6144c2-8b05-47e8-9f0d-2a71c5d2334c None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:51.947857 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 551/1077] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:03:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 19:03:51.958118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bea5c-17f9-4e23-96b6-d0d2bfa0c67e None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:52.091566 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6144c2-8b05-47e8-9f0d-2a71c5d2334c None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:52.110239 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:52.127509 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bea5c-17f9-4e23-96b6-d0d2bfa0c67e None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:52.143611 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6546ee-049f-442d-ab61-ed81c9a9222b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:52.144383 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6546ee-049f-442d-ab61-ed81c9a9222b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:52.144698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6546ee-049f-442d-ab61-ed81c9a9222b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:52.144973 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6546ee-049f-442d-ab61-ed81c9a9222b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:52.160386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6546ee-049f-442d-ab61-ed81c9a9222b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:03:52.174525 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0a83c-66ce-4a29-9c04-63dcfb9dd239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:52.175335 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0a83c-66ce-4a29-9c04-63dcfb9dd239 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:52.175670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0a83c-66ce-4a29-9c04-63dcfb9dd239 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:52.175885 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0a83c-66ce-4a29-9c04-63dcfb9dd239 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:52.176120 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-9b6546ee-049f-442d-ab61-ed81c9a9222b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 19:03:52.176120 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:52.176120 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:52.176120 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:52.176120 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:52.176120 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:52.176120 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:52.176120 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:52.176120 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:52.176120 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:52.176120 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:52.176120 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:52.176120 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:03:52.176120 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:03:52.176120 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:03:52.176120 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:03:52.177061 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:03:52.177061 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:03:52.177061 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:03:52.177061 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:03:52.177061 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:52.177061 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:52.177061 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:52.177061 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:52.177061 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:52.177061 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:52.177061 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:52.177061 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:52.177061 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:52.177061 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:52.177061 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:52.177061 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:52.179235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:52.179235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:52.179235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:52.179235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:52.179235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:03:52.179235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:03:52.179235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:03:52.179235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:03:52.179235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:03:52.179235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:03:52.179235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 19:03:52.179235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:52.179235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 527/1078] 10.222.0.45 () {56 vars in 1120 bytes} [Thu Jun 2 19:03:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:52.181204 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:52.184417 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6546ee-049f-442d-ab61-ed81c9a9222b None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:52.192482 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0a83c-66ce-4a29-9c04-63dcfb9dd239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:52.194613 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0a83c-66ce-4a29-9c04-63dcfb9dd239 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:52.216279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-63b0a83c-66ce-4a29-9c04-63dcfb9dd239 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:52.216279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:52.216279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:52.216279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:52.216279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:52.216279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:52.216279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:52.216279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:52.216279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:52.216279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:52.216279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:52.216279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:52.216279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:52.216279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:52.216279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:52.217347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:52.217347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:52.217347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:52.217347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:52.217347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:52.217347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:52.217347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:52.217347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:52.217347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:52.217347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:52.217347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:52.217347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:52.217347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:52.217347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:52.217347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:52.217347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:52.217347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:52.218384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:52.218384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:52.218384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:52.218384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:52.222979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 552/1079] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:52.224138 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0a83c-66ce-4a29-9c04-63dcfb9dd239 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:52.323378 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6546ee-049f-442d-ab61-ed81c9a9222b None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:52.343039 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0a83c-66ce-4a29-9c04-63dcfb9dd239 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:52.362454 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639c476-4a9b-4563-98ed-041a7ea32321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:52.363133 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639c476-4a9b-4563-98ed-041a7ea32321 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:52.363426 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639c476-4a9b-4563-98ed-041a7ea32321 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:52.363753 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639c476-4a9b-4563-98ed-041a7ea32321 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:52.364596 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639c476-4a9b-4563-98ed-041a7ea32321 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:52.364902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639c476-4a9b-4563-98ed-041a7ea32321 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:52.366289 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639c476-4a9b-4563-98ed-041a7ea32321 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:52.375650 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 528/1080] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Jun 2 19:03:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:52.383851 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639c476-4a9b-4563-98ed-041a7ea32321 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:52.390057 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e9ff4-20d3-4348-ab85-164b6fd60ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:52.390869 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e9ff4-20d3-4348-ab85-164b6fd60ded None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:52.391254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e9ff4-20d3-4348-ab85-164b6fd60ded None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:52.391735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e9ff4-20d3-4348-ab85-164b6fd60ded None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:52.393062 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e9ff4-20d3-4348-ab85-164b6fd60ded None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:52.393581 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e9ff4-20d3-4348-ab85-164b6fd60ded None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:52.396079 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e9ff4-20d3-4348-ab85-164b6fd60ded None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:52.428038 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 553/1081] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:52.434145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:52.575291 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639c476-4a9b-4563-98ed-041a7ea32321 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:52.644211 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a40cae-5342-4a30-874a-a0d6de105388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:52.645524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a40cae-5342-4a30-874a-a0d6de105388 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:52.646014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a40cae-5342-4a30-874a-a0d6de105388 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:52.646537 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a40cae-5342-4a30-874a-a0d6de105388 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:52.668376 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a40cae-5342-4a30-874a-a0d6de105388 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:52.671620 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a40cae-5342-4a30-874a-a0d6de105388 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:52.698862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-d1a40cae-5342-4a30-874a-a0d6de105388 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:52.698862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:52.698862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:52.698862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:52.698862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:52.698862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:52.698862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:52.698862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:52.698862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:52.698862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:52.698862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:52.698862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:52.698862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:52.698862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:52.698862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:52.699837 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:52.699837 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:52.699837 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:52.699837 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:52.699837 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:52.699837 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:52.699837 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:52.699837 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:52.699837 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:52.699837 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:52.699837 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:52.699837 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:52.699837 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:52.699837 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:52.699837 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:52.699837 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:52.699837 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:52.700808 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:52.700808 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:52.700808 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:52.700808 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:52.700808 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 529/1082] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:52.707749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e9ff4-20d3-4348-ab85-164b6fd60ded None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:52.789898 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:52.861005 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e9ff4-20d3-4348-ab85-164b6fd60ded None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:52.903306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca40863-ff9a-4831-9d5e-abd355efe06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:52.903869 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca40863-ff9a-4831-9d5e-abd355efe06f None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:52.904183 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca40863-ff9a-4831-9d5e-abd355efe06f None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:52.904455 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca40863-ff9a-4831-9d5e-abd355efe06f None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:52.905688 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca40863-ff9a-4831-9d5e-abd355efe06f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:52.905991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca40863-ff9a-4831-9d5e-abd355efe06f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:52.907372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca40863-ff9a-4831-9d5e-abd355efe06f None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:52.928057 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 554/1083] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:52.929669 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a40cae-5342-4a30-874a-a0d6de105388 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:53.021881 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:53.037575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a40cae-5342-4a30-874a-a0d6de105388 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:53.079700 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90773bd-32a1-4986-b320-a1fd4d56b45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:53.080572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90773bd-32a1-4986-b320-a1fd4d56b45b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:53.080853 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90773bd-32a1-4986-b320-a1fd4d56b45b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:53.081126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90773bd-32a1-4986-b320-a1fd4d56b45b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:53.094287 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90773bd-32a1-4986-b320-a1fd4d56b45b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:53.095838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90773bd-32a1-4986-b320-a1fd4d56b45b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:53.111835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-d90773bd-32a1-4986-b320-a1fd4d56b45b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 19:03:53.111835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:53.111835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:53.111835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:53.111835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:53.111835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:53.111835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:53.111835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:53.111835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:53.111835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:53.111835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:53.111835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:53.111835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:03:53.111835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:03:53.111835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:03:53.111835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:03:53.119682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:53.119682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:53.119682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:03:53.119682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:53.119682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:03:53.119682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:03:53.119682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:53.119682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:53.119682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:53.119682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:53.119682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:53.119682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:53.119682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:53.119682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:53.119682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:53.119682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:53.119682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:53.119682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:53.121979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:53.121979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:53.121979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:03:53.121979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:03:53.121979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:03:53.121979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:03:53.121979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:03:53.121979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:03:53.121979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 19:03:53.121979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:53.121979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 530/1084] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Jun 2 19:03:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:53.123312 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca40863-ff9a-4831-9d5e-abd355efe06f None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:53.233356 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca40863-ff9a-4831-9d5e-abd355efe06f None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:53.241407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:53.269316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221be37-9674-454c-afda-10d913513e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:53.270005 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221be37-9674-454c-afda-10d913513e05 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:53.270644 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221be37-9674-454c-afda-10d913513e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:53.270874 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221be37-9674-454c-afda-10d913513e05 None admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:53.271916 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221be37-9674-454c-afda-10d913513e05 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:53.272085 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221be37-9674-454c-afda-10d913513e05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:53.273614 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221be37-9674-454c-afda-10d913513e05 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:53.293573 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 555/1085] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Jun 2 19:03:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:53.299403 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90773bd-32a1-4986-b320-a1fd4d56b45b None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:53.424965 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90773bd-32a1-4986-b320-a1fd4d56b45b None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:53.467019 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bec68-f012-49b6-866f-45cb83e82a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:53.468473 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bec68-f012-49b6-866f-45cb83e82a74 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:53.468878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bec68-f012-49b6-866f-45cb83e82a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:53.469313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bec68-f012-49b6-866f-45cb83e82a74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:53.491442 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:53.562312 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bec68-f012-49b6-866f-45cb83e82a74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:53.563942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bec68-f012-49b6-866f-45cb83e82a74 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:53.686026 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 531/1086] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:03:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 19:03:53.694331 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221be37-9674-454c-afda-10d913513e05 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:53.809085 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221be37-9674-454c-afda-10d913513e05 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:53.852593 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f51190-9d90-404a-bab1-c4cea37679a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:53.853381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f51190-9d90-404a-bab1-c4cea37679a1 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:53.853661 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f51190-9d90-404a-bab1-c4cea37679a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:53.853930 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f51190-9d90-404a-bab1-c4cea37679a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:53.865483 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f51190-9d90-404a-bab1-c4cea37679a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:53.866959 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f51190-9d90-404a-bab1-c4cea37679a1 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:53.886146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-77f51190-9d90-404a-bab1-c4cea37679a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:53.886146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:53.886146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:53.886146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:53.886146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:53.886146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:53.886146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:53.886146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:53.886146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:53.886146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:53.886146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:53.886146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:53.886146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:03:53.886146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:03:53.886146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:03:53.887338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:03:53.887338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:53.887338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:53.887338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:53.887338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:53.887338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:53.887338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:53.887338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:53.887338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:53.887338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:53.887338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:53.887338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:53.887338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:53.887338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:53.887338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:53.887338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:53.887338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:53.888306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:03:53.888306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:03:53.888306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:03:53.888306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:53.888306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 556/1087] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:53.893951 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bec68-f012-49b6-866f-45cb83e82a74 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:53.924179 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f43361-f8ab-4a2c-a11c-b2285efa5861 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:53.924463 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f43361-f8ab-4a2c-a11c-b2285efa5861 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:53.924743 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f43361-f8ab-4a2c-a11c-b2285efa5861 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:53.926107 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 557/1088] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:03:53.931555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2171c-8834-4ae5-bc41-1ac8216aba41 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:53.931843 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2171c-8834-4ae5-bc41-1ac8216aba41 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:53.932158 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2171c-8834-4ae5-bc41-1ac8216aba41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:53.944086 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:53.950115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-fee2171c-8834-4ae5-bc41-1ac8216aba41 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:53.951357 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-fee2171c-8834-4ae5-bc41-1ac8216aba41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:53.964546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:54.005670 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bec68-f012-49b6-866f-45cb83e82a74 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:54.028385 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 558/1089] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 19:03:54.047814 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641e8b8-87d5-4497-b509-e6aa18059a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:54.048426 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641e8b8-87d5-4497-b509-e6aa18059a5c None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:54.048706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641e8b8-87d5-4497-b509-e6aa18059a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:54.048980 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641e8b8-87d5-4497-b509-e6aa18059a5c None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:54.049723 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641e8b8-87d5-4497-b509-e6aa18059a5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:54.050024 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641e8b8-87d5-4497-b509-e6aa18059a5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:54.051424 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641e8b8-87d5-4497-b509-e6aa18059a5c None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:54.052396 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2171c-8834-4ae5-bc41-1ac8216aba41 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:54.065282 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 532/1090] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:54.071173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641e8b8-87d5-4497-b509-e6aa18059a5c None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:54.162067 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2171c-8834-4ae5-bc41-1ac8216aba41 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:54.183484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641e8b8-87d5-4497-b509-e6aa18059a5c None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:54.190913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:54.201269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec16979-4a1b-433a-91d8-2270c047476c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:54.202611 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec16979-4a1b-433a-91d8-2270c047476c None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:54.202895 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec16979-4a1b-433a-91d8-2270c047476c None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:54.212405 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec16979-4a1b-433a-91d8-2270c047476c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:54.213825 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec16979-4a1b-433a-91d8-2270c047476c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:03:54.219465 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c47a04-72f7-4242-8bdd-52904daf1c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:54.220289 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c47a04-72f7-4242-8bdd-52904daf1c08 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:54.220574 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c47a04-72f7-4242-8bdd-52904daf1c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:54.220847 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c47a04-72f7-4242-8bdd-52904daf1c08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:54.222425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-fec16979-4a1b-433a-91d8-2270c047476c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:03:54.222425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:54.222425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:54.222425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:54.222425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:54.222425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:54.222425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:54.222425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:54.222425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:54.222425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:54.222425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:54.222425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:54.222425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:03:54.222425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:03:54.222425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:03:54.222425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:03:54.223334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:03:54.223334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:03:54.223334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:03:54.223334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:03:54.223334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:54.223334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:54.223334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:54.223334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:54.223334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:54.223334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:54.223334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:54.223334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:54.223334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:54.223334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:54.223334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:54.223334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:54.224325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:54.224325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:54.224325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:54.224325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:54.224325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:03:54.224325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:03:54.224325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:03:54.224325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:03:54.224325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:03:54.224325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:03:54.224325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:03:54.224325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:54.224325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 559/1091] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:03:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:54.228052 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c47a04-72f7-4242-8bdd-52904daf1c08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:54.229507 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c47a04-72f7-4242-8bdd-52904daf1c08 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:54.229640 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec16979-4a1b-433a-91d8-2270c047476c None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:54.239469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:54.244928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-f2c47a04-72f7-4242-8bdd-52904daf1c08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:54.244928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:54.244928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:54.244928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:54.244928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:54.244928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:54.244928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:54.244928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:54.244928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:54.244928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:54.244928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:54.244928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:54.244928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:03:54.244928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:03:54.244928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:03:54.245959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:03:54.245959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:54.245959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:54.245959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:54.245959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:54.245959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:54.245959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:54.245959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:54.245959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:54.245959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:54.245959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:54.245959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:54.245959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:54.245959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:54.245959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:54.245959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:54.245959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:54.246867 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:03:54.246867 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:03:54.246867 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:03:54.246867 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:03:54.246867 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:03:54.246867 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:03:54.246867 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:03:54.246867 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:03:54.246867 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 533/1092] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:03:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:03:54.253365 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c47a04-72f7-4242-8bdd-52904daf1c08 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:54.349951 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec16979-4a1b-433a-91d8-2270c047476c None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:54.375025 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c47a04-72f7-4242-8bdd-52904daf1c08 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:54.383397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb56ebe-c651-4b08-9cc2-916b59db6d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:54.384092 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb56ebe-c651-4b08-9cc2-916b59db6d57 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:54.384374 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb56ebe-c651-4b08-9cc2-916b59db6d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:54.384649 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb56ebe-c651-4b08-9cc2-916b59db6d57 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:54.385424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb56ebe-c651-4b08-9cc2-916b59db6d57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:54.385728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb56ebe-c651-4b08-9cc2-916b59db6d57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:54.387097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb56ebe-c651-4b08-9cc2-916b59db6d57 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:54.399657 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 560/1093] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:03:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:54.405562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb56ebe-c651-4b08-9cc2-916b59db6d57 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:54.413921 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acfc43d-226f-4fa2-a233-c1064e2604c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:54.414647 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfc43d-226f-4fa2-a233-c1064e2604c6 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:54.414964 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfc43d-226f-4fa2-a233-c1064e2604c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:54.415329 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfc43d-226f-4fa2-a233-c1064e2604c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:54.416196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acfc43d-226f-4fa2-a233-c1064e2604c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:54.416549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acfc43d-226f-4fa2-a233-c1064e2604c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:54.418006 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acfc43d-226f-4fa2-a233-c1064e2604c6 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:54.433182 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 534/1094] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:03:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:54.440050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acfc43d-226f-4fa2-a233-c1064e2604c6 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:54.469877 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:54.506233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:54.540742 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb56ebe-c651-4b08-9cc2-916b59db6d57 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:54.551413 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acfc43d-226f-4fa2-a233-c1064e2604c6 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:54.575894 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5810b-1d83-43df-9421-bd140b435be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:54.576796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5810b-1d83-43df-9421-bd140b435be7 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:54.577081 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5810b-1d83-43df-9421-bd140b435be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:54.577353 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5810b-1d83-43df-9421-bd140b435be7 None admin] PATH_INFO: `/v3/users/212ee5d3e4f446938fca3127ef8fb8c8` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:54.578574 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5810b-1d83-43df-9421-bd140b435be7 None admin] RBAC: Authorizing `identity:get_user(user_id=212ee5d3e4f446938fca3127ef8fb8c8)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:54.580039 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5810b-1d83-43df-9421-bd140b435be7 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:54.581689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 561/1095] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:03:54 2022] GET /identity/v3/users/212ee5d3e4f446938fca3127ef8fb8c8 => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:54.586320 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9d8d4-8992-48ba-a0ab-4da22732e85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:54.586985 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9d8d4-8992-48ba-a0ab-4da22732e85a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:54.587262 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9d8d4-8992-48ba-a0ab-4da22732e85a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:54.587462 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5810b-1d83-43df-9421-bd140b435be7 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:54.587567 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9d8d4-8992-48ba-a0ab-4da22732e85a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:54.588390 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9d8d4-8992-48ba-a0ab-4da22732e85a None admin] RBAC: Adding query filter params (role.id=788c05993fb0458a9a2f4d2bd3cf9a34, scope.project.id=b11b7e66a993492d8163097bce955c0b, user.id=575f61ef70314f86b5d9dad3ba1b3aab) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:54.588698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9d8d4-8992-48ba-a0ab-4da22732e85a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:54.590118 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9d8d4-8992-48ba-a0ab-4da22732e85a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:54.600967 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 535/1096] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:03:54 2022] GET /identity/v3/role_assignments?user.id=575f61ef70314f86b5d9dad3ba1b3aab&scope.project.id=b11b7e66a993492d8163097bce955c0b&role.id=788c05993fb0458a9a2f4d2bd3cf9a34 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:54.709061 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5810b-1d83-43df-9421-bd140b435be7 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:54.748591 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f28268-116c-4824-a828-309602260735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:54.750086 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f28268-116c-4824-a828-309602260735 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:54.750367 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f28268-116c-4824-a828-309602260735 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:54.750638 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f28268-116c-4824-a828-309602260735 None admin] PATH_INFO: `/v3/projects/5bea7d5122844cee936bf3e30d87b6ee` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:54.752045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f28268-116c-4824-a828-309602260735 None admin] RBAC: Authorizing `identity:get_project(project_id=5bea7d5122844cee936bf3e30d87b6ee)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:54.753472 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f28268-116c-4824-a828-309602260735 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:54.755418 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 562/1097] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:03:54 2022] GET /identity/v3/projects/5bea7d5122844cee936bf3e30d87b6ee => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:54.761553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9d8d4-8992-48ba-a0ab-4da22732e85a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:54.865687 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:54.875620 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9d8d4-8992-48ba-a0ab-4da22732e85a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:54.911163 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af965f3-9121-47b1-989b-0921722ffa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:54.912085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af965f3-9121-47b1-989b-0921722ffa0a None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:54.912362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af965f3-9121-47b1-989b-0921722ffa0a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:54.912633 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af965f3-9121-47b1-989b-0921722ffa0a None admin] PATH_INFO: `/v3/projects/5bea7d5122844cee936bf3e30d87b6ee/users/212ee5d3e4f446938fca3127ef8fb8c8/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:54.914583 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af965f3-9121-47b1-989b-0921722ffa0a None admin] RBAC: Authorizing `identity:create_grant(project_id=5bea7d5122844cee936bf3e30d87b6ee, user_id=212ee5d3e4f446938fca3127ef8fb8c8, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:54.916035 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af965f3-9121-47b1-989b-0921722ffa0a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:55.005337 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 536/1098] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jun 2 19:03:54 2022] PUT /identity/v3/projects/5bea7d5122844cee936bf3e30d87b6ee/users/212ee5d3e4f446938fca3127ef8fb8c8/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:57.283737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e92b8e-7273-4714-a42f-28025d17d3ac None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:57.284328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e92b8e-7273-4714-a42f-28025d17d3ac None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:57.284328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e92b8e-7273-4714-a42f-28025d17d3ac None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:57.285660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 563/1099] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:03:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:03:57.291002 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eed7f6-2173-46d8-99d0-dd85f4647bec None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:57.291419 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eed7f6-2173-46d8-99d0-dd85f4647bec None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:57.291569 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eed7f6-2173-46d8-99d0-dd85f4647bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:57.310980 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-46eed7f6-2173-46d8-99d0-dd85f4647bec None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:57.312803 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-46eed7f6-2173-46d8-99d0-dd85f4647bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:57.379561 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 537/1100] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:03:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:03:57.403395 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e92b8e-7273-4714-a42f-28025d17d3ac None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:57.407767 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:57.632549 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e92b8e-7273-4714-a42f-28025d17d3ac None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:57.666319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f6a82-a151-4fea-b527-165a8a3615be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:57.667110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f6a82-a151-4fea-b527-165a8a3615be None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:57.667390 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f6a82-a151-4fea-b527-165a8a3615be None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:57.667660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f6a82-a151-4fea-b527-165a8a3615be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:57.679595 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f6a82-a151-4fea-b527-165a8a3615be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:03:57.687225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-684f6a82-a151-4fea-b527-165a8a3615be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:03:57.687225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:03:57.687225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:03:57.687225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:03:57.687225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:03:57.687225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:03:57.687225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:03:57.687225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:03:57.687225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:03:57.687225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:03:57.687225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:03:57.687225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:03:57.687225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:03:57.687225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:03:57.687225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:03:57.687225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:03:57.688366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:03:57.688366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:03:57.688366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:03:57.688366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:03:57.688366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:03:57.688366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:03:57.688366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:03:57.688366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:03:57.688366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:03:57.688366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:03:57.688366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:03:57.688366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:03:57.688366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:03:57.688366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:03:57.688366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:03:57.688366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:03:57.689619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:03:57.689619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:03:57.689619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:03:57.689619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:03:57.689619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:03:57.689619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:03:57.689619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:03:57.689619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:03:57.689619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:03:57.689619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:03:57.689619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:03:57.689619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:03:57.689619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 564/1101] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:03:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:03:57.694571 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eed7f6-2173-46d8-99d0-dd85f4647bec None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:57.774345 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:57.796168 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eed7f6-2173-46d8-99d0-dd85f4647bec None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:57.830797 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59562747-2a13-46dd-bfd3-db7115b71bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:57.831458 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59562747-2a13-46dd-bfd3-db7115b71bad None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:57.831742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59562747-2a13-46dd-bfd3-db7115b71bad None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:57.832039 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59562747-2a13-46dd-bfd3-db7115b71bad None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:57.832784 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59562747-2a13-46dd-bfd3-db7115b71bad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:57.833088 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59562747-2a13-46dd-bfd3-db7115b71bad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:57.834457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59562747-2a13-46dd-bfd3-db7115b71bad None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:57.843619 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 538/1102] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:03:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:57.849028 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f6a82-a151-4fea-b527-165a8a3615be None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:57.910694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:57.948926 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f6a82-a151-4fea-b527-165a8a3615be None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:57.982740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734eed2d-6cfa-4e59-b20e-344663a5d06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:57.984155 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734eed2d-6cfa-4e59-b20e-344663a5d06a None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:57.984436 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734eed2d-6cfa-4e59-b20e-344663a5d06a None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:57.984704 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734eed2d-6cfa-4e59-b20e-344663a5d06a None admin] PATH_INFO: `/v3/users/212ee5d3e4f446938fca3127ef8fb8c8` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:57.985918 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734eed2d-6cfa-4e59-b20e-344663a5d06a None admin] RBAC: Authorizing `identity:get_user(user_id=212ee5d3e4f446938fca3127ef8fb8c8)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:57.987345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734eed2d-6cfa-4e59-b20e-344663a5d06a None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:57.988973 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 565/1103] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:03:57 2022] GET /identity/v3/users/212ee5d3e4f446938fca3127ef8fb8c8 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:57.994836 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59562747-2a13-46dd-bfd3-db7115b71bad None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:58.106691 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59562747-2a13-46dd-bfd3-db7115b71bad None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:58.143435 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858ec2f-5f56-4def-bb42-d34e3ec5e995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:58.144119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858ec2f-5f56-4def-bb42-d34e3ec5e995 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:58.144402 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858ec2f-5f56-4def-bb42-d34e3ec5e995 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:58.144678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858ec2f-5f56-4def-bb42-d34e3ec5e995 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:58.158211 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:58.214086 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858ec2f-5f56-4def-bb42-d34e3ec5e995 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:58.215733 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858ec2f-5f56-4def-bb42-d34e3ec5e995 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:58.312497 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 539/1104] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:03:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 19:03:58.318530 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734eed2d-6cfa-4e59-b20e-344663a5d06a None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:58.417876 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734eed2d-6cfa-4e59-b20e-344663a5d06a None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:58.446746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:58.451640 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e6731-d6fd-4dc6-99fe-ffb59e4b5bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:58.453032 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e6731-d6fd-4dc6-99fe-ffb59e4b5bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:58.453312 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e6731-d6fd-4dc6-99fe-ffb59e4b5bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:58.453586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e6731-d6fd-4dc6-99fe-ffb59e4b5bb1 None admin] PATH_INFO: `/v3/projects/5bea7d5122844cee936bf3e30d87b6ee` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:58.454779 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e6731-d6fd-4dc6-99fe-ffb59e4b5bb1 None admin] RBAC: Authorizing `identity:get_project(project_id=5bea7d5122844cee936bf3e30d87b6ee)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:58.456247 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e6731-d6fd-4dc6-99fe-ffb59e4b5bb1 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:58.457942 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 566/1105] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:03:58 2022] GET /identity/v3/projects/5bea7d5122844cee936bf3e30d87b6ee => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:58.464309 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858ec2f-5f56-4def-bb42-d34e3ec5e995 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:58.506455 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:58.563816 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858ec2f-5f56-4def-bb42-d34e3ec5e995 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:58.598080 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f55af2-9ef6-4902-bfe6-808f4656e193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:58.598733 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f55af2-9ef6-4902-bfe6-808f4656e193 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:58.599016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f55af2-9ef6-4902-bfe6-808f4656e193 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:58.599292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f55af2-9ef6-4902-bfe6-808f4656e193 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:58.600139 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f55af2-9ef6-4902-bfe6-808f4656e193 None admin] RBAC: Adding query filter params (role.id=4588ca63994f4e2d9ce482d475edbabd, scope.project.id=5bea7d5122844cee936bf3e30d87b6ee, user.id=212ee5d3e4f446938fca3127ef8fb8c8) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:58.600459 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f55af2-9ef6-4902-bfe6-808f4656e193 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:58.601887 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f55af2-9ef6-4902-bfe6-808f4656e193 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:58.607741 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 540/1106] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:03:58 2022] GET /identity/v3/role_assignments?user.id=212ee5d3e4f446938fca3127ef8fb8c8&scope.project.id=5bea7d5122844cee936bf3e30d87b6ee&role.id=4588ca63994f4e2d9ce482d475edbabd => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:00.891893 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a6fd3-297e-4b5f-bae6-8198bed3feea None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:00.892489 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a6fd3-297e-4b5f-bae6-8198bed3feea None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:00.892489 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a6fd3-297e-4b5f-bae6-8198bed3feea None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:00.893836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 567/1107] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:04:00.899268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227808f-be68-46a8-a100-9991a04b05c4 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:00.899678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227808f-be68-46a8-a100-9991a04b05c4 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:00.899816 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227808f-be68-46a8-a100-9991a04b05c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:00.916240 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-d227808f-be68-46a8-a100-9991a04b05c4 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:00.917437 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d227808f-be68-46a8-a100-9991a04b05c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:00.984447 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 541/1108] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:04:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:04:01.009718 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a6fd3-297e-4b5f-bae6-8198bed3feea None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:01.112695 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a6fd3-297e-4b5f-bae6-8198bed3feea None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:01.146307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786014a-a51a-49ba-b44d-5267beb87a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:01.147084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786014a-a51a-49ba-b44d-5267beb87a5a None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:01.147363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786014a-a51a-49ba-b44d-5267beb87a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:01.147631 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786014a-a51a-49ba-b44d-5267beb87a5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:01.148817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786014a-a51a-49ba-b44d-5267beb87a5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:01.150245 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786014a-a51a-49ba-b44d-5267beb87a5a None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:01.151831 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 568/1109] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:04:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:01.157857 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227808f-be68-46a8-a100-9991a04b05c4 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:01.192592 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:01.256132 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227808f-be68-46a8-a100-9991a04b05c4 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:01.288821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2bf55-a70d-4b01-89cf-c4b622ce5cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:01.289476 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2bf55-a70d-4b01-89cf-c4b622ce5cb0 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:01.289755 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2bf55-a70d-4b01-89cf-c4b622ce5cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:01.290029 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2bf55-a70d-4b01-89cf-c4b622ce5cb0 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:01.290727 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2bf55-a70d-4b01-89cf-c4b622ce5cb0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:01.292179 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2bf55-a70d-4b01-89cf-c4b622ce5cb0 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:01.403266 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 542/1110] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jun 2 19:04:01 2022] POST /identity/v3/users => generated 286 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:04:03.718895 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1fbd9-2106-4d58-9198-c3d101242f55 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:03.719498 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1fbd9-2106-4d58-9198-c3d101242f55 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:03.719498 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1fbd9-2106-4d58-9198-c3d101242f55 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:03.720824 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 569/1111] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:04:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:04:03.726338 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a033617-fc95-4050-8f5d-6e806ccfb6fd None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:03.726795 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a033617-fc95-4050-8f5d-6e806ccfb6fd None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:03.726897 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a033617-fc95-4050-8f5d-6e806ccfb6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:03.744194 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-4a033617-fc95-4050-8f5d-6e806ccfb6fd None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:03.745408 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4a033617-fc95-4050-8f5d-6e806ccfb6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:03.812437 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 543/1112] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:04:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:04:03.836459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1fbd9-2106-4d58-9198-c3d101242f55 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:03.905685 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:03.939739 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1fbd9-2106-4d58-9198-c3d101242f55 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:03.974413 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141268c-cc5d-4aaa-9387-82ea3aaa9499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:03.975187 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141268c-cc5d-4aaa-9387-82ea3aaa9499 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:03.975469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141268c-cc5d-4aaa-9387-82ea3aaa9499 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:03.975744 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141268c-cc5d-4aaa-9387-82ea3aaa9499 None admin] PATH_INFO: `/v3/roles/27769697518a42139af80d8b8410ca07` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:03.977326 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d141268c-cc5d-4aaa-9387-82ea3aaa9499 None admin] RBAC: Authorizing `identity:get_role(role_id=27769697518a42139af80d8b8410ca07)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:03.978690 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d141268c-cc5d-4aaa-9387-82ea3aaa9499 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:03.980168 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 570/1113] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:04:03 2022] GET /identity/v3/roles/27769697518a42139af80d8b8410ca07 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:04:03.986128 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a033617-fc95-4050-8f5d-6e806ccfb6fd None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:04.010108 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:04.084548 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a033617-fc95-4050-8f5d-6e806ccfb6fd None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:04.126831 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610479c1-c61d-4fb8-bddb-fae519f7bf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:04.127684 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610479c1-c61d-4fb8-bddb-fae519f7bf30 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:04.127962 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610479c1-c61d-4fb8-bddb-fae519f7bf30 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:04.128263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610479c1-c61d-4fb8-bddb-fae519f7bf30 None admin] PATH_INFO: `/v3/users/66cc278dfcf74113ab2f91b5ccafe25f` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:04.142239 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610479c1-c61d-4fb8-bddb-fae519f7bf30 None admin] RBAC: Authorizing `identity:get_user(user_id=66cc278dfcf74113ab2f91b5ccafe25f)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:04.143672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610479c1-c61d-4fb8-bddb-fae519f7bf30 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:04.145364 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 544/1114] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:04:03 2022] GET /identity/v3/users/66cc278dfcf74113ab2f91b5ccafe25f => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:04.151097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141268c-cc5d-4aaa-9387-82ea3aaa9499 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:04.248501 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141268c-cc5d-4aaa-9387-82ea3aaa9499 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:04.283365 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94642c4c-9271-445a-b729-333c6ed57fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:04.284023 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94642c4c-9271-445a-b729-333c6ed57fab None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:04.284310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94642c4c-9271-445a-b729-333c6ed57fab None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:04.284583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94642c4c-9271-445a-b729-333c6ed57fab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:04.287979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:04.350066 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94642c4c-9271-445a-b729-333c6ed57fab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:04.351526 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94642c4c-9271-445a-b729-333c6ed57fab None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:04.450565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 571/1115] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:04:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 19:04:04.457316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610479c1-c61d-4fb8-bddb-fae519f7bf30 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:04.540457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:04.562417 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610479c1-c61d-4fb8-bddb-fae519f7bf30 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:04.596479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f2acc-7e08-46f9-9474-57d06447cf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:04.597336 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f2acc-7e08-46f9-9474-57d06447cf08 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:04.597620 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f2acc-7e08-46f9-9474-57d06447cf08 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:04.597894 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f2acc-7e08-46f9-9474-57d06447cf08 None admin] PATH_INFO: `/v3/projects/5bea7d5122844cee936bf3e30d87b6ee` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:04.599071 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f2acc-7e08-46f9-9474-57d06447cf08 None admin] RBAC: Authorizing `identity:get_project(project_id=5bea7d5122844cee936bf3e30d87b6ee)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:04.600630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f2acc-7e08-46f9-9474-57d06447cf08 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:04.602338 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 545/1116] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:04:04 2022] GET /identity/v3/projects/5bea7d5122844cee936bf3e30d87b6ee => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:04.609213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94642c4c-9271-445a-b729-333c6ed57fab None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:04.643170 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:04.707788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94642c4c-9271-445a-b729-333c6ed57fab None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:04.742918 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c432e5e-7570-429c-be74-2b3ecca1ec2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:04.743598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c432e5e-7570-429c-be74-2b3ecca1ec2f None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:04.743832 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c432e5e-7570-429c-be74-2b3ecca1ec2f None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:04.744141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c432e5e-7570-429c-be74-2b3ecca1ec2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:04.744964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c432e5e-7570-429c-be74-2b3ecca1ec2f None admin] RBAC: Adding query filter params (role.id=27769697518a42139af80d8b8410ca07, scope.project.id=5bea7d5122844cee936bf3e30d87b6ee, user.id=66cc278dfcf74113ab2f91b5ccafe25f) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:04:04.745272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c432e5e-7570-429c-be74-2b3ecca1ec2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:04.746700 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c432e5e-7570-429c-be74-2b3ecca1ec2f None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:04.753319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 572/1117] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:04:04 2022] GET /identity/v3/role_assignments?user.id=66cc278dfcf74113ab2f91b5ccafe25f&scope.project.id=5bea7d5122844cee936bf3e30d87b6ee&role.id=27769697518a42139af80d8b8410ca07 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:06.978533 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd135afc-a0e3-46b1-84f4-007107259a47 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:06.979086 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd135afc-a0e3-46b1-84f4-007107259a47 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:06.979086 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd135afc-a0e3-46b1-84f4-007107259a47 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:06.980502 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 546/1118] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:04:06.985742 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38089adb-4216-44c5-a9bd-36360ff762e6 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:06.986168 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38089adb-4216-44c5-a9bd-36360ff762e6 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:06.986299 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38089adb-4216-44c5-a9bd-36360ff762e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:07.003418 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-38089adb-4216-44c5-a9bd-36360ff762e6 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:07.004636 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-38089adb-4216-44c5-a9bd-36360ff762e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:07.069610 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 573/1119] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:04:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 19:04:07.093766 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd135afc-a0e3-46b1-84f4-007107259a47 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:07.191759 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd135afc-a0e3-46b1-84f4-007107259a47 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:07.224019 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57b64c-5d5a-4358-9cb2-40ee000bb0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:07.224967 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57b64c-5d5a-4358-9cb2-40ee000bb0ef None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:07.225191 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57b64c-5d5a-4358-9cb2-40ee000bb0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:07.225458 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57b64c-5d5a-4358-9cb2-40ee000bb0ef None admin] PATH_INFO: `/v3/roles/27769697518a42139af80d8b8410ca07` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:07.226910 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57b64c-5d5a-4358-9cb2-40ee000bb0ef None admin] RBAC: Authorizing `identity:get_role(role_id=27769697518a42139af80d8b8410ca07)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:07.228286 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57b64c-5d5a-4358-9cb2-40ee000bb0ef None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:07.229636 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 547/1120] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:04:07 2022] GET /identity/v3/roles/27769697518a42139af80d8b8410ca07 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:07.235950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38089adb-4216-44c5-a9bd-36360ff762e6 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:07.265663 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:07.332852 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38089adb-4216-44c5-a9bd-36360ff762e6 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:07.366202 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d544e-2674-4acb-a1e6-bac51ebbf88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:07.367108 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d544e-2674-4acb-a1e6-bac51ebbf88c None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:07.367386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d544e-2674-4acb-a1e6-bac51ebbf88c None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:07.367649 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d544e-2674-4acb-a1e6-bac51ebbf88c None admin] PATH_INFO: `/v3/users/66cc278dfcf74113ab2f91b5ccafe25f` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:07.368857 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d544e-2674-4acb-a1e6-bac51ebbf88c None admin] RBAC: Authorizing `identity:get_user(user_id=66cc278dfcf74113ab2f91b5ccafe25f)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:07.370294 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d544e-2674-4acb-a1e6-bac51ebbf88c None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:07.371945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 574/1121] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:04:07 2022] GET /identity/v3/users/66cc278dfcf74113ab2f91b5ccafe25f => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:07.377700 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57b64c-5d5a-4358-9cb2-40ee000bb0ef None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:07.396314 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:07.478171 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57b64c-5d5a-4358-9cb2-40ee000bb0ef None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:07.512498 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33127d38-9673-4850-b474-b84e9304703c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:07.513411 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33127d38-9673-4850-b474-b84e9304703c None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:07.513689 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33127d38-9673-4850-b474-b84e9304703c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:07.514555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33127d38-9673-4850-b474-b84e9304703c None admin] PATH_INFO: `/v3/projects/5bea7d5122844cee936bf3e30d87b6ee` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:07.515854 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33127d38-9673-4850-b474-b84e9304703c None admin] RBAC: Authorizing `identity:get_project(project_id=5bea7d5122844cee936bf3e30d87b6ee)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:07.517298 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33127d38-9673-4850-b474-b84e9304703c None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:07.519056 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 548/1122] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:04:07 2022] GET /identity/v3/projects/5bea7d5122844cee936bf3e30d87b6ee => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:07.524985 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d544e-2674-4acb-a1e6-bac51ebbf88c None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:07.618001 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:07.621807 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d544e-2674-4acb-a1e6-bac51ebbf88c None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:07.655210 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84e509-af3b-4f62-b672-81cf70b0e86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:07.656188 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84e509-af3b-4f62-b672-81cf70b0e86a None admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:07.656470 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84e509-af3b-4f62-b672-81cf70b0e86a None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:07.656784 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84e509-af3b-4f62-b672-81cf70b0e86a None admin] PATH_INFO: `/v3/projects/5bea7d5122844cee936bf3e30d87b6ee/users/66cc278dfcf74113ab2f91b5ccafe25f/roles/27769697518a42139af80d8b8410ca07` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:07.659030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc84e509-af3b-4f62-b672-81cf70b0e86a None admin] RBAC: Authorizing `identity:create_grant(project_id=5bea7d5122844cee936bf3e30d87b6ee, user_id=66cc278dfcf74113ab2f91b5ccafe25f, role_id=27769697518a42139af80d8b8410ca07)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:07.660525 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc84e509-af3b-4f62-b672-81cf70b0e86a None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:07.751631 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 575/1123] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jun 2 19:04:07 2022] PUT /identity/v3/projects/5bea7d5122844cee936bf3e30d87b6ee/users/66cc278dfcf74113ab2f91b5ccafe25f/roles/27769697518a42139af80d8b8410ca07 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:04:09.965831 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4925c66-0002-4446-ac15-f2fb977d05d6 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:09.966353 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4925c66-0002-4446-ac15-f2fb977d05d6 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:09.966353 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4925c66-0002-4446-ac15-f2fb977d05d6 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:09.968413 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 549/1124] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:04:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:04:09.973606 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42887e-d236-4d28-8288-217509cad1d1 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:09.974032 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42887e-d236-4d28-8288-217509cad1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:09.974153 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42887e-d236-4d28-8288-217509cad1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:09.991182 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-0b42887e-d236-4d28-8288-217509cad1d1 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:09.992383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-0b42887e-d236-4d28-8288-217509cad1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:10.058276 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 576/1125] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:04:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:04:10.082643 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4925c66-0002-4446-ac15-f2fb977d05d6 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:10.173756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:10.190710 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4925c66-0002-4446-ac15-f2fb977d05d6 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:10.223360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbe32a-98c9-490d-81a2-4461ea5de039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:10.224280 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbe32a-98c9-490d-81a2-4461ea5de039 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:10.224546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbe32a-98c9-490d-81a2-4461ea5de039 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:10.224820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbe32a-98c9-490d-81a2-4461ea5de039 None admin] PATH_INFO: `/v3/roles/27769697518a42139af80d8b8410ca07` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:10.226263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fbe32a-98c9-490d-81a2-4461ea5de039 None admin] RBAC: Authorizing `identity:get_role(role_id=27769697518a42139af80d8b8410ca07)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:10.227619 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fbe32a-98c9-490d-81a2-4461ea5de039 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:10.229237 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 550/1126] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:04:10 2022] GET /identity/v3/roles/27769697518a42139af80d8b8410ca07 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:10.235400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42887e-d236-4d28-8288-217509cad1d1 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:10.318801 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:10.331021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42887e-d236-4d28-8288-217509cad1d1 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:10.365116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380900b-f0f9-4a78-904c-c2fd60441b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:10.365982 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380900b-f0f9-4a78-904c-c2fd60441b9e None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:10.366268 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380900b-f0f9-4a78-904c-c2fd60441b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:10.366535 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380900b-f0f9-4a78-904c-c2fd60441b9e None admin] PATH_INFO: `/v3/users/66cc278dfcf74113ab2f91b5ccafe25f` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:10.367829 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380900b-f0f9-4a78-904c-c2fd60441b9e None admin] RBAC: Authorizing `identity:get_user(user_id=66cc278dfcf74113ab2f91b5ccafe25f)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:10.369229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380900b-f0f9-4a78-904c-c2fd60441b9e None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:10.370839 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 577/1127] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:04:10 2022] GET /identity/v3/users/66cc278dfcf74113ab2f91b5ccafe25f => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:10.376680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbe32a-98c9-490d-81a2-4461ea5de039 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:10.475128 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbe32a-98c9-490d-81a2-4461ea5de039 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:10.508126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3253a-40da-4b8a-a810-88f9009c1353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:10.508763 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3253a-40da-4b8a-a810-88f9009c1353 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:10.509044 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3253a-40da-4b8a-a810-88f9009c1353 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:10.509316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3253a-40da-4b8a-a810-88f9009c1353 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:10.530761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:10.575243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3253a-40da-4b8a-a810-88f9009c1353 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:10.576640 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3253a-40da-4b8a-a810-88f9009c1353 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:10.671219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 551/1128] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:04:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 19:04:10.677639 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380900b-f0f9-4a78-904c-c2fd60441b9e None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:10.775911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380900b-f0f9-4a78-904c-c2fd60441b9e None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:10.808453 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471b4fd-cbb6-41bb-bfb2-9c28388471c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:10.809311 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471b4fd-cbb6-41bb-bfb2-9c28388471c6 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:10.809590 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471b4fd-cbb6-41bb-bfb2-9c28388471c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:10.809865 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471b4fd-cbb6-41bb-bfb2-9c28388471c6 None admin] PATH_INFO: `/v3/projects/5bea7d5122844cee936bf3e30d87b6ee` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:10.811025 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471b4fd-cbb6-41bb-bfb2-9c28388471c6 None admin] RBAC: Authorizing `identity:get_project(project_id=5bea7d5122844cee936bf3e30d87b6ee)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:10.813030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471b4fd-cbb6-41bb-bfb2-9c28388471c6 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:10.814689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 578/1129] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:04:10 2022] GET /identity/v3/projects/5bea7d5122844cee936bf3e30d87b6ee => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:10.820864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3253a-40da-4b8a-a810-88f9009c1353 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:10.871464 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:10.917100 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3253a-40da-4b8a-a810-88f9009c1353 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:10.955919 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea314d6-dd44-447d-8852-a703bffbd79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:10.956628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea314d6-dd44-447d-8852-a703bffbd79d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:10.956909 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea314d6-dd44-447d-8852-a703bffbd79d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:10.957178 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea314d6-dd44-447d-8852-a703bffbd79d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:10.958021 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea314d6-dd44-447d-8852-a703bffbd79d None admin] RBAC: Adding query filter params (role.id=27769697518a42139af80d8b8410ca07, scope.project.id=5bea7d5122844cee936bf3e30d87b6ee, user.id=66cc278dfcf74113ab2f91b5ccafe25f) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:04:10.958335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea314d6-dd44-447d-8852-a703bffbd79d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:10.959790 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea314d6-dd44-447d-8852-a703bffbd79d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:10.966845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 552/1130] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:04:10 2022] GET /identity/v3/role_assignments?user.id=66cc278dfcf74113ab2f91b5ccafe25f&scope.project.id=5bea7d5122844cee936bf3e30d87b6ee&role.id=27769697518a42139af80d8b8410ca07 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:13.247257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3d14e-76ff-4a5c-9597-6d29ab6008d6 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:13.247793 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3d14e-76ff-4a5c-9597-6d29ab6008d6 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:13.247793 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3d14e-76ff-4a5c-9597-6d29ab6008d6 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:13.249217 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 579/1131] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:04:13.254536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c8023-c83c-45d5-af82-8e59d398e682 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:13.254979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c8023-c83c-45d5-af82-8e59d398e682 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:13.255072 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c8023-c83c-45d5-af82-8e59d398e682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:13.272240 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-7f5c8023-c83c-45d5-af82-8e59d398e682 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:13.273437 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7f5c8023-c83c-45d5-af82-8e59d398e682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:13.342748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 553/1132] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:04:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:04:13.366784 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3d14e-76ff-4a5c-9597-6d29ab6008d6 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:13.392250 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:13.469901 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3d14e-76ff-4a5c-9597-6d29ab6008d6 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:13.504694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d7d93-7eca-48ba-b2f8-1a1d3586df37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:13.505394 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d7d93-7eca-48ba-b2f8-1a1d3586df37 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:13.505673 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d7d93-7eca-48ba-b2f8-1a1d3586df37 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:13.505947 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d7d93-7eca-48ba-b2f8-1a1d3586df37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:13.507132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d7d93-7eca-48ba-b2f8-1a1d3586df37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:13.508671 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d7d93-7eca-48ba-b2f8-1a1d3586df37 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:13.510283 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 580/1133] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:04:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:13.517039 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c8023-c83c-45d5-af82-8e59d398e682 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:13.561570 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:13.614556 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c8023-c83c-45d5-af82-8e59d398e682 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:13.649646 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8be577-5338-472f-8753-e3bc640f76ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:13.650315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8be577-5338-472f-8753-e3bc640f76ce None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:13.650591 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8be577-5338-472f-8753-e3bc640f76ce None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:13.650887 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8be577-5338-472f-8753-e3bc640f76ce None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:13.651579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8be577-5338-472f-8753-e3bc640f76ce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:13.653055 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8be577-5338-472f-8753-e3bc640f76ce None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:13.787245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 554/1134] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jun 2 19:04:13 2022] POST /identity/v3/projects => generated 311 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:04:16.091419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9418a2-9616-4556-a91e-e7d9b79cd710 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:16.091967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9418a2-9616-4556-a91e-e7d9b79cd710 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:16.091967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9418a2-9616-4556-a91e-e7d9b79cd710 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:16.094067 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 581/1135] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:04:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:04:16.099661 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6a6a6-d641-4ea1-916d-a81a414aa736 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:16.100058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6a6a6-d641-4ea1-916d-a81a414aa736 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:16.100256 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6a6a6-d641-4ea1-916d-a81a414aa736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:16.117528 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-bea6a6a6-d641-4ea1-916d-a81a414aa736 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:16.118725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-bea6a6a6-d641-4ea1-916d-a81a414aa736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:16.185362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 555/1136] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:04:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:04:16.210780 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9418a2-9616-4556-a91e-e7d9b79cd710 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:16.304007 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:16.314131 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9418a2-9616-4556-a91e-e7d9b79cd710 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:16.348746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285c36b-cf03-46b9-acb8-0d2fe715b649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:16.349437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285c36b-cf03-46b9-acb8-0d2fe715b649 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:16.349724 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285c36b-cf03-46b9-acb8-0d2fe715b649 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:16.349994 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285c36b-cf03-46b9-acb8-0d2fe715b649 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:16.351175 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285c36b-cf03-46b9-acb8-0d2fe715b649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:16.352645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285c36b-cf03-46b9-acb8-0d2fe715b649 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:16.354239 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 582/1137] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:04:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:16.360571 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6a6a6-d641-4ea1-916d-a81a414aa736 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:16.388878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:16.462598 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6a6a6-d641-4ea1-916d-a81a414aa736 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:16.501462 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e66c7-5837-4750-8d06-614a29996461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:16.502180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e66c7-5837-4750-8d06-614a29996461 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:16.502563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e66c7-5837-4750-8d06-614a29996461 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:16.502845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e66c7-5837-4750-8d06-614a29996461 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:16.503778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e66c7-5837-4750-8d06-614a29996461 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:16.505643 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e66c7-5837-4750-8d06-614a29996461 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:16.631972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 556/1138] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jun 2 19:04:16 2022] POST /identity/v3/users => generated 286 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:04:18.938138 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7c580-c44e-45cf-92ee-b1aee79b67dc None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:18.938670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7c580-c44e-45cf-92ee-b1aee79b67dc None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:18.938670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7c580-c44e-45cf-92ee-b1aee79b67dc None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:18.940063 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 583/1139] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:04:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:04:18.945636 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780c2ec-02f5-4b8c-8e8d-683d89c4bc7c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:18.946063 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780c2ec-02f5-4b8c-8e8d-683d89c4bc7c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:18.946186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780c2ec-02f5-4b8c-8e8d-683d89c4bc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:18.963141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-b780c2ec-02f5-4b8c-8e8d-683d89c4bc7c None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:18.964350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b780c2ec-02f5-4b8c-8e8d-683d89c4bc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:19.031911 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 557/1140] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:04:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:04:19.055597 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7c580-c44e-45cf-92ee-b1aee79b67dc None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:19.157260 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7c580-c44e-45cf-92ee-b1aee79b67dc None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:19.190911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716119db-3d31-4e8a-81bd-972f6d6e21a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:19.191694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716119db-3d31-4e8a-81bd-972f6d6e21a3 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:19.191975 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716119db-3d31-4e8a-81bd-972f6d6e21a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:19.192276 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716119db-3d31-4e8a-81bd-972f6d6e21a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:19.202353 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716119db-3d31-4e8a-81bd-972f6d6e21a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:04:19.210096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-716119db-3d31-4e8a-81bd-972f6d6e21a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:04:19.210096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:04:19.210096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:04:19.210096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:04:19.210096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:04:19.210096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:04:19.210096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:04:19.210096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:04:19.210096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:04:19.210096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:04:19.210096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:04:19.210096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:04:19.210096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:04:19.210096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:04:19.210096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:04:19.210096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:04:19.211361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:04:19.211361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:04:19.211361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:04:19.211361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:04:19.211361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:04:19.211361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:04:19.211361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:04:19.211361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:04:19.211361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:04:19.211361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:04:19.211361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:04:19.211361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:04:19.211361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:04:19.211361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:04:19.211361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:04:19.211361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:04:19.212485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:04:19.212485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:04:19.212485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:04:19.212485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:04:19.212485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:04:19.212485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:04:19.212485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:04:19.212485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:04:19.212485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:04:19.212485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:04:19.212485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:04:19.212485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:04:19.212485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 584/1141] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:04:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:04:19.217928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780c2ec-02f5-4b8c-8e8d-683d89c4bc7c None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:19.232857 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:19.318738 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780c2ec-02f5-4b8c-8e8d-683d89c4bc7c None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:19.351236 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356f142-5542-4eab-8628-f15bbdb93e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:19.352015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356f142-5542-4eab-8628-f15bbdb93e2e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:19.352304 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356f142-5542-4eab-8628-f15bbdb93e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:19.352571 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356f142-5542-4eab-8628-f15bbdb93e2e None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:19.353311 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356f142-5542-4eab-8628-f15bbdb93e2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:04:19.353611 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356f142-5542-4eab-8628-f15bbdb93e2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:19.354986 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356f142-5542-4eab-8628-f15bbdb93e2e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:19.363524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 558/1142] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:04:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:19.369435 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716119db-3d31-4e8a-81bd-972f6d6e21a3 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:19.392528 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:19.580319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716119db-3d31-4e8a-81bd-972f6d6e21a3 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:19.614657 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74ec7c-5688-4fb9-9499-8f30e146eb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:19.615526 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74ec7c-5688-4fb9-9499-8f30e146eb49 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:19.615803 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74ec7c-5688-4fb9-9499-8f30e146eb49 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:19.616104 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74ec7c-5688-4fb9-9499-8f30e146eb49 None admin] PATH_INFO: `/v3/users/5c1fb3b7549d454895a31eb7a5832aaf` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:19.629766 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74ec7c-5688-4fb9-9499-8f30e146eb49 None admin] RBAC: Authorizing `identity:get_user(user_id=5c1fb3b7549d454895a31eb7a5832aaf)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:19.631205 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74ec7c-5688-4fb9-9499-8f30e146eb49 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:19.632878 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 585/1143] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:04:19 2022] GET /identity/v3/users/5c1fb3b7549d454895a31eb7a5832aaf => generated 286 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:19.638948 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356f142-5542-4eab-8628-f15bbdb93e2e None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:19.716646 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:19.740455 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356f142-5542-4eab-8628-f15bbdb93e2e None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:19.774777 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ee5ce-b356-4f46-820d-f2ddae9f21cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:19.775421 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ee5ce-b356-4f46-820d-f2ddae9f21cc None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:19.775706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ee5ce-b356-4f46-820d-f2ddae9f21cc None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:19.775980 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ee5ce-b356-4f46-820d-f2ddae9f21cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:19.842758 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ee5ce-b356-4f46-820d-f2ddae9f21cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:19.844193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ee5ce-b356-4f46-820d-f2ddae9f21cc None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:19.916869 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:19.940268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 559/1144] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:04:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 19:04:19.946177 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74ec7c-5688-4fb9-9499-8f30e146eb49 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:20.023432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:20.044978 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74ec7c-5688-4fb9-9499-8f30e146eb49 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:20.079101 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d75d7-d504-4cfd-9ce4-f9450bf83756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:20.079965 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d75d7-d504-4cfd-9ce4-f9450bf83756 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:20.080278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d75d7-d504-4cfd-9ce4-f9450bf83756 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:20.080554 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d75d7-d504-4cfd-9ce4-f9450bf83756 None admin] PATH_INFO: `/v3/projects/8439023d6136488499dbe5104601f700` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:20.081749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d75d7-d504-4cfd-9ce4-f9450bf83756 None admin] RBAC: Authorizing `identity:get_project(project_id=8439023d6136488499dbe5104601f700)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:20.083190 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d75d7-d504-4cfd-9ce4-f9450bf83756 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:20.084906 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 586/1145] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:04:19 2022] GET /identity/v3/projects/8439023d6136488499dbe5104601f700 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:20.091518 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ee5ce-b356-4f46-820d-f2ddae9f21cc None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:20.190365 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ee5ce-b356-4f46-820d-f2ddae9f21cc None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:20.224462 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7036d22-9428-4c24-b15d-1bad19d82451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:20.225110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7036d22-9428-4c24-b15d-1bad19d82451 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:20.225388 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7036d22-9428-4c24-b15d-1bad19d82451 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:20.225657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7036d22-9428-4c24-b15d-1bad19d82451 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:20.226479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7036d22-9428-4c24-b15d-1bad19d82451 None admin] RBAC: Adding query filter params (role.id=4588ca63994f4e2d9ce482d475edbabd, scope.project.id=8439023d6136488499dbe5104601f700, user.id=5c1fb3b7549d454895a31eb7a5832aaf) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:04:20.226782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7036d22-9428-4c24-b15d-1bad19d82451 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:20.228217 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7036d22-9428-4c24-b15d-1bad19d82451 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:20.234369 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 560/1146] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:04:20 2022] GET /identity/v3/role_assignments?user.id=5c1fb3b7549d454895a31eb7a5832aaf&scope.project.id=8439023d6136488499dbe5104601f700&role.id=4588ca63994f4e2d9ce482d475edbabd => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:22.487919 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc001c-7c98-4ac3-90e3-665dc8111407 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:22.488526 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc001c-7c98-4ac3-90e3-665dc8111407 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:22.488526 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc001c-7c98-4ac3-90e3-665dc8111407 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:22.489867 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 587/1147] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:04:22.495292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b98e88-f468-46e4-bc61-4ac1534fbe89 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:22.495690 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b98e88-f468-46e4-bc61-4ac1534fbe89 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:22.495851 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b98e88-f468-46e4-bc61-4ac1534fbe89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:22.513902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-60b98e88-f468-46e4-bc61-4ac1534fbe89 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:22.515731 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-60b98e88-f468-46e4-bc61-4ac1534fbe89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:22.550296 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:22.584081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 561/1148] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:04:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:04:22.607393 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc001c-7c98-4ac3-90e3-665dc8111407 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:22.714916 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc001c-7c98-4ac3-90e3-665dc8111407 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:22.751866 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255d872-3af6-4112-a791-5813a09cdd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:22.752645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255d872-3af6-4112-a791-5813a09cdd7d None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:22.752928 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255d872-3af6-4112-a791-5813a09cdd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:22.753202 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255d872-3af6-4112-a791-5813a09cdd7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:22.764919 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255d872-3af6-4112-a791-5813a09cdd7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:04:22.773291 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-c255d872-3af6-4112-a791-5813a09cdd7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:04:22.773291 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:04:22.773291 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:04:22.773291 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:04:22.773291 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:04:22.773291 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:04:22.773291 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:04:22.773291 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:04:22.773291 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:04:22.773291 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:04:22.773291 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:04:22.773291 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:04:22.773291 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:04:22.773291 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:04:22.773291 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:04:22.773291 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:04:22.774433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:04:22.774433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:04:22.774433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:04:22.774433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:04:22.774433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:04:22.774433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:04:22.774433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:04:22.774433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:04:22.774433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:04:22.774433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:04:22.774433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:04:22.774433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:04:22.774433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:04:22.774433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:04:22.774433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:04:22.774433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:04:22.775561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:04:22.775561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:04:22.775561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:04:22.775561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:04:22.775561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:04:22.775561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:04:22.775561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:04:22.775561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:04:22.775561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:04:22.775561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:04:22.775561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:04:22.775561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:04:22.775561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 588/1149] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:04:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:04:22.781360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b98e88-f468-46e4-bc61-4ac1534fbe89 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:22.884916 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b98e88-f468-46e4-bc61-4ac1534fbe89 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:22.918238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4a23e-6969-4bb6-85ad-f3afedff0008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:22.918904 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4a23e-6969-4bb6-85ad-f3afedff0008 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:22.919185 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4a23e-6969-4bb6-85ad-f3afedff0008 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:22.919459 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4a23e-6969-4bb6-85ad-f3afedff0008 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:22.920230 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4a23e-6969-4bb6-85ad-f3afedff0008 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:04:22.920535 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4a23e-6969-4bb6-85ad-f3afedff0008 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:22.922426 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4a23e-6969-4bb6-85ad-f3afedff0008 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:22.930373 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 562/1150] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:04:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:22.936396 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255d872-3af6-4112-a791-5813a09cdd7d None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:22.946386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:23.037301 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255d872-3af6-4112-a791-5813a09cdd7d None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:23.073750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa5da2-4ee9-4e74-8f17-6e7df070fa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:23.074616 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa5da2-4ee9-4e74-8f17-6e7df070fa0d None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:23.074973 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa5da2-4ee9-4e74-8f17-6e7df070fa0d None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:23.075194 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa5da2-4ee9-4e74-8f17-6e7df070fa0d None admin] PATH_INFO: `/v3/users/5c1fb3b7549d454895a31eb7a5832aaf` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:23.076423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa5da2-4ee9-4e74-8f17-6e7df070fa0d None admin] RBAC: Authorizing `identity:get_user(user_id=5c1fb3b7549d454895a31eb7a5832aaf)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:23.078436 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa5da2-4ee9-4e74-8f17-6e7df070fa0d None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:23.080054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 589/1151] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:04:22 2022] GET /identity/v3/users/5c1fb3b7549d454895a31eb7a5832aaf => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:23.086028 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4a23e-6969-4bb6-85ad-f3afedff0008 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:23.118215 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:23.188257 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4a23e-6969-4bb6-85ad-f3afedff0008 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:23.222694 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f371d-c8d2-439d-9a93-165f50d85b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:23.223559 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f371d-c8d2-439d-9a93-165f50d85b67 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:23.223843 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f371d-c8d2-439d-9a93-165f50d85b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:23.224152 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f371d-c8d2-439d-9a93-165f50d85b67 None admin] PATH_INFO: `/v3/projects/8439023d6136488499dbe5104601f700` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:23.225344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f371d-c8d2-439d-9a93-165f50d85b67 None admin] RBAC: Authorizing `identity:get_project(project_id=8439023d6136488499dbe5104601f700)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:23.226776 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f371d-c8d2-439d-9a93-165f50d85b67 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:23.228579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 563/1152] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:04:23 2022] GET /identity/v3/projects/8439023d6136488499dbe5104601f700 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:23.234634 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa5da2-4ee9-4e74-8f17-6e7df070fa0d None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:23.310361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:23.335710 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa5da2-4ee9-4e74-8f17-6e7df070fa0d None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:23.370522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c2ba6-d935-4c7d-bf3a-b7b87ea98abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:23.371409 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c2ba6-d935-4c7d-bf3a-b7b87ea98abc None admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:23.371693 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c2ba6-d935-4c7d-bf3a-b7b87ea98abc None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:23.371967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c2ba6-d935-4c7d-bf3a-b7b87ea98abc None admin] PATH_INFO: `/v3/projects/8439023d6136488499dbe5104601f700/users/5c1fb3b7549d454895a31eb7a5832aaf/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:23.373973 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c2ba6-d935-4c7d-bf3a-b7b87ea98abc None admin] RBAC: Authorizing `identity:create_grant(project_id=8439023d6136488499dbe5104601f700, user_id=5c1fb3b7549d454895a31eb7a5832aaf, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:23.375435 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c2ba6-d935-4c7d-bf3a-b7b87ea98abc None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:23.493908 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 590/1153] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jun 2 19:04:23 2022] PUT /identity/v3/projects/8439023d6136488499dbe5104601f700/users/5c1fb3b7549d454895a31eb7a5832aaf/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:04:25.750409 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578f19c-7372-4c71-8771-4ae628578da5 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:25.750951 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578f19c-7372-4c71-8771-4ae628578da5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:25.750951 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578f19c-7372-4c71-8771-4ae628578da5 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:25.752372 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 564/1154] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:04:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:04:25.757736 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ba5a8-4c8f-4917-92b8-a6719bce64a1 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:25.758137 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ba5a8-4c8f-4917-92b8-a6719bce64a1 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:25.758288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ba5a8-4c8f-4917-92b8-a6719bce64a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:25.775913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-f03ba5a8-4c8f-4917-92b8-a6719bce64a1 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:25.777133 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-f03ba5a8-4c8f-4917-92b8-a6719bce64a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:25.847852 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 591/1155] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:04:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:04:25.871914 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578f19c-7372-4c71-8771-4ae628578da5 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:25.970997 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:25.974803 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578f19c-7372-4c71-8771-4ae628578da5 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:26.010140 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301b8dc-323e-4a39-a356-f833ca365375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:26.010849 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301b8dc-323e-4a39-a356-f833ca365375 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:26.011135 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301b8dc-323e-4a39-a356-f833ca365375 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:26.011413 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301b8dc-323e-4a39-a356-f833ca365375 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:26.022082 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301b8dc-323e-4a39-a356-f833ca365375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:04:26.029845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-d301b8dc-323e-4a39-a356-f833ca365375 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:04:26.029845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:04:26.029845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:04:26.029845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:04:26.029845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:04:26.029845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:04:26.029845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:04:26.029845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:04:26.029845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:04:26.029845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:04:26.029845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:04:26.029845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:04:26.029845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:04:26.029845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:04:26.029845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:04:26.029845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:04:26.030954 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:04:26.030954 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:04:26.030954 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:04:26.030954 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:04:26.030954 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:04:26.030954 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:04:26.030954 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:04:26.030954 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:04:26.030954 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:04:26.030954 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:04:26.030954 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:04:26.030954 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:04:26.030954 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:04:26.030954 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:04:26.030954 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:04:26.030954 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:04:26.031825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:04:26.031825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:04:26.031825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:04:26.031825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:04:26.031825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:04:26.031825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:04:26.031825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:04:26.031825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:04:26.031825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:04:26.031825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:04:26.031825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:04:26.031825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:04:26.031825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 565/1156] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:04:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:04:26.040562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ba5a8-4c8f-4917-92b8-a6719bce64a1 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:26.112658 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:26.150157 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ba5a8-4c8f-4917-92b8-a6719bce64a1 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:26.187539 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49589f-500f-4423-ab92-ca330a5e3ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:26.188262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49589f-500f-4423-ab92-ca330a5e3ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:26.188544 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49589f-500f-4423-ab92-ca330a5e3ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:26.188816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49589f-500f-4423-ab92-ca330a5e3ce4 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:26.189568 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49589f-500f-4423-ab92-ca330a5e3ce4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:04:26.189878 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49589f-500f-4423-ab92-ca330a5e3ce4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:26.191259 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49589f-500f-4423-ab92-ca330a5e3ce4 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:26.200380 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 592/1157] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:04:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:26.206234 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301b8dc-323e-4a39-a356-f833ca365375 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:26.332867 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301b8dc-323e-4a39-a356-f833ca365375 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:26.368541 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b05d5-e3c5-46b8-9038-87df6313ae1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:26.369446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b05d5-e3c5-46b8-9038-87df6313ae1e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:26.369735 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b05d5-e3c5-46b8-9038-87df6313ae1e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:26.370009 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b05d5-e3c5-46b8-9038-87df6313ae1e None admin] PATH_INFO: `/v3/users/5c1fb3b7549d454895a31eb7a5832aaf` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:26.371575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b05d5-e3c5-46b8-9038-87df6313ae1e None admin] RBAC: Authorizing `identity:get_user(user_id=5c1fb3b7549d454895a31eb7a5832aaf)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:26.373039 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b05d5-e3c5-46b8-9038-87df6313ae1e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:26.375427 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 566/1158] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:04:26 2022] GET /identity/v3/users/5c1fb3b7549d454895a31eb7a5832aaf => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:26.381308 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49589f-500f-4423-ab92-ca330a5e3ce4 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:26.482700 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49589f-500f-4423-ab92-ca330a5e3ce4 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:26.509744 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:26.518394 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c5360-4fd1-4d2c-892b-2c2a6b20c073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:26.519054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c5360-4fd1-4d2c-892b-2c2a6b20c073 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:26.521647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c5360-4fd1-4d2c-892b-2c2a6b20c073 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:26.521647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c5360-4fd1-4d2c-892b-2c2a6b20c073 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:26.588099 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c5360-4fd1-4d2c-892b-2c2a6b20c073 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:26.589742 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c5360-4fd1-4d2c-892b-2c2a6b20c073 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:26.687562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 593/1159] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:04:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 19:04:26.693696 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b05d5-e3c5-46b8-9038-87df6313ae1e None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:26.722274 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:26.799521 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b05d5-e3c5-46b8-9038-87df6313ae1e None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:26.834110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648ca91-0d5d-4a58-a2d7-1e562f97bd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:26.834972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648ca91-0d5d-4a58-a2d7-1e562f97bd16 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:26.835249 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648ca91-0d5d-4a58-a2d7-1e562f97bd16 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:26.835519 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648ca91-0d5d-4a58-a2d7-1e562f97bd16 None admin] PATH_INFO: `/v3/projects/8439023d6136488499dbe5104601f700` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:26.836685 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648ca91-0d5d-4a58-a2d7-1e562f97bd16 None admin] RBAC: Authorizing `identity:get_project(project_id=8439023d6136488499dbe5104601f700)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:26.838176 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648ca91-0d5d-4a58-a2d7-1e562f97bd16 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:26.840097 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 567/1160] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:04:26 2022] GET /identity/v3/projects/8439023d6136488499dbe5104601f700 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:26.846571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c5360-4fd1-4d2c-892b-2c2a6b20c073 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:26.873248 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:26.945374 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c5360-4fd1-4d2c-892b-2c2a6b20c073 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:26.979313 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43531a8-8582-4a2f-ab96-c13eb53221ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:26.979987 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43531a8-8582-4a2f-ab96-c13eb53221ca None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:26.980298 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43531a8-8582-4a2f-ab96-c13eb53221ca None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:26.980574 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43531a8-8582-4a2f-ab96-c13eb53221ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:26.981395 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43531a8-8582-4a2f-ab96-c13eb53221ca None admin] RBAC: Adding query filter params (role.id=4588ca63994f4e2d9ce482d475edbabd, scope.project.id=8439023d6136488499dbe5104601f700, user.id=5c1fb3b7549d454895a31eb7a5832aaf) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:04:26.981704 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43531a8-8582-4a2f-ab96-c13eb53221ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:26.983177 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43531a8-8582-4a2f-ab96-c13eb53221ca None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:26.989710 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 594/1161] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:04:26 2022] GET /identity/v3/role_assignments?user.id=5c1fb3b7549d454895a31eb7a5832aaf&scope.project.id=8439023d6136488499dbe5104601f700&role.id=4588ca63994f4e2d9ce482d475edbabd => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:29.300866 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c9dc9-7b5e-43b2-8e82-da7d9ae0bac9 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:29.301399 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c9dc9-7b5e-43b2-8e82-da7d9ae0bac9 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:29.301399 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c9dc9-7b5e-43b2-8e82-da7d9ae0bac9 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:29.302788 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 568/1162] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:04:29.308245 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccd5b0-2d61-4718-afb6-dcd6da89d423 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:29.308655 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccd5b0-2d61-4718-afb6-dcd6da89d423 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:29.308796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccd5b0-2d61-4718-afb6-dcd6da89d423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:29.328693 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-e6ccd5b0-2d61-4718-afb6-dcd6da89d423 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:29.329915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-e6ccd5b0-2d61-4718-afb6-dcd6da89d423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:29.396949 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 595/1163] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:04:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:04:29.419671 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c9dc9-7b5e-43b2-8e82-da7d9ae0bac9 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:29.515683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:29.522432 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c9dc9-7b5e-43b2-8e82-da7d9ae0bac9 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:29.556230 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7476c0-858e-4bb7-9be8-ac4ee1149020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:29.556795 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7476c0-858e-4bb7-9be8-ac4ee1149020 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:29.557079 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7476c0-858e-4bb7-9be8-ac4ee1149020 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:29.557349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7476c0-858e-4bb7-9be8-ac4ee1149020 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:29.625980 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7476c0-858e-4bb7-9be8-ac4ee1149020 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:29.627414 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7476c0-858e-4bb7-9be8-ac4ee1149020 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:29.720454 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:29.726998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 569/1164] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:04:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 19:04:29.733174 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccd5b0-2d61-4718-afb6-dcd6da89d423 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:29.755053 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:29.833871 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccd5b0-2d61-4718-afb6-dcd6da89d423 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:29.867522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37ecbc-cc36-4916-9da5-5a7439081c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:29.868376 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37ecbc-cc36-4916-9da5-5a7439081c24 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:29.868652 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37ecbc-cc36-4916-9da5-5a7439081c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:29.868918 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37ecbc-cc36-4916-9da5-5a7439081c24 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:29.875644 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37ecbc-cc36-4916-9da5-5a7439081c24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:29.877120 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37ecbc-cc36-4916-9da5-5a7439081c24 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:29.891604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-3b37ecbc-cc36-4916-9da5-5a7439081c24 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 02 19:04:29.891604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:04:29.891604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 02 19:04:29.891604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 02 19:04:29.891604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:04:29.891604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:04:29.891604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:04:29.891604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:04:29.891604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 02 19:04:29.891604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:04:29.891604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:04:29.891604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:04:29.891604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:04:29.891604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:04:29.891604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:04:29.891604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:04:29.891604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:04:29.892899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:04:29.892899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:04:29.892899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:04:29.892899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:04:29.892899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:04:29.892899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:04:29.892899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:04:29.892899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:04:29.892899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:04:29.892899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:04:29.892899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:04:29.892899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:04:29.892899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:04:29.892899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:04:29.892899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:04:29.892899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:04:29.893952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:04:29.893952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:04:29.893952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:04:29.893952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:04:29.893952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:04:29.893952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:04:29.893952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:04:29.893952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:04:29.893952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:04:29.893952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:04:29.893952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 02 19:04:29.893952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:04:29.893952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 02 19:04:29.893952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:04:29.893952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 596/1165] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Jun 2 19:04:29 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:04:29.898958 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7476c0-858e-4bb7-9be8-ac4ee1149020 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:30.012832 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7476c0-858e-4bb7-9be8-ac4ee1149020 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:30.048594 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83754766-cad5-4343-83ee-6ceea70728bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:30.049257 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83754766-cad5-4343-83ee-6ceea70728bb None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:30.049540 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83754766-cad5-4343-83ee-6ceea70728bb None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:30.049818 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83754766-cad5-4343-83ee-6ceea70728bb None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:30.050547 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83754766-cad5-4343-83ee-6ceea70728bb None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:04:30.050850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83754766-cad5-4343-83ee-6ceea70728bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:30.052237 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83754766-cad5-4343-83ee-6ceea70728bb None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:30.059526 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 570/1166] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Jun 2 19:04:29 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:32.313326 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9d4a5-ee72-4ff5-926d-cf5e634b30eb None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:32.313902 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9d4a5-ee72-4ff5-926d-cf5e634b30eb None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:32.313902 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9d4a5-ee72-4ff5-926d-cf5e634b30eb None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:32.315292 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 597/1167] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:04:32.321104 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ac288-8c6d-4e4c-b4ec-060f94d4edc3 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:32.321567 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ac288-8c6d-4e4c-b4ec-060f94d4edc3 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:32.321741 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ac288-8c6d-4e4c-b4ec-060f94d4edc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:32.338337 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-706ac288-8c6d-4e4c-b4ec-060f94d4edc3 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:32.339776 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-706ac288-8c6d-4e4c-b4ec-060f94d4edc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:32.394836 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:32.406363 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 571/1168] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:04:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:04:32.429629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9d4a5-ee72-4ff5-926d-cf5e634b30eb None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:32.511644 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:32.531912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9d4a5-ee72-4ff5-926d-cf5e634b30eb None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:32.566903 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163ffef-4e80-4b16-aaef-09c4ec5b9109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:32.567470 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163ffef-4e80-4b16-aaef-09c4ec5b9109 None admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:32.567766 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163ffef-4e80-4b16-aaef-09c4ec5b9109 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:32.568113 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163ffef-4e80-4b16-aaef-09c4ec5b9109 None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:32.568854 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8163ffef-4e80-4b16-aaef-09c4ec5b9109 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:32.570213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8163ffef-4e80-4b16-aaef-09c4ec5b9109 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:32.672416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 598/1169] 10.222.0.45 () {60 vars in 1138 bytes} [Thu Jun 2 19:04:32 2022] POST /identity/v3/domains => generated 267 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:04:35.002351 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a71059-3ee7-4430-a377-0754497a60bd None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:35.002926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a71059-3ee7-4430-a377-0754497a60bd None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:35.002926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a71059-3ee7-4430-a377-0754497a60bd None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:35.004334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 572/1170] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:04:35.009929 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a7137-e1ea-463a-8d59-e8faa23f835a None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:35.010408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a7137-e1ea-463a-8d59-e8faa23f835a None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:35.010510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a7137-e1ea-463a-8d59-e8faa23f835a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:35.027974 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-964a7137-e1ea-463a-8d59-e8faa23f835a None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:35.029202 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-964a7137-e1ea-463a-8d59-e8faa23f835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:35.106873 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 599/1171] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:04:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:04:35.131080 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a71059-3ee7-4430-a377-0754497a60bd None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:35.234519 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a71059-3ee7-4430-a377-0754497a60bd None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:35.270438 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131f9b2-ce65-475e-8bbc-64f5b4bd4379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:35.271294 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131f9b2-ce65-475e-8bbc-64f5b4bd4379 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:35.271575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131f9b2-ce65-475e-8bbc-64f5b4bd4379 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:35.271848 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131f9b2-ce65-475e-8bbc-64f5b4bd4379 None admin] PATH_INFO: `/v3/domains/9a44ce1b64d9438da3f8742bfe6e6f88` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:35.283067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131f9b2-ce65-475e-8bbc-64f5b4bd4379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9a44ce1b64d9438da3f8742bfe6e6f88)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:35.284563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131f9b2-ce65-475e-8bbc-64f5b4bd4379 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:35.286230 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 573/1172] 10.222.0.45 () {56 vars in 1183 bytes} [Thu Jun 2 19:04:35 2022] GET /identity/v3/domains/9a44ce1b64d9438da3f8742bfe6e6f88 => generated 267 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:35.292397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a7137-e1ea-463a-8d59-e8faa23f835a None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:35.361150 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:35.391066 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a7137-e1ea-463a-8d59-e8faa23f835a None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:35.425873 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c68f49-e964-4ba7-b9a9-35bd0fd34216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:35.426539 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c68f49-e964-4ba7-b9a9-35bd0fd34216 None admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:35.426824 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c68f49-e964-4ba7-b9a9-35bd0fd34216 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:35.427102 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c68f49-e964-4ba7-b9a9-35bd0fd34216 None admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:35.427827 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c68f49-e964-4ba7-b9a9-35bd0fd34216 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:35.429358 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c68f49-e964-4ba7-b9a9-35bd0fd34216 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:35.626879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 600/1173] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jun 2 19:04:35 2022] POST /identity/v3/projects => generated 361 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:04:37.922278 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067ac8e-3463-425d-b10a-5a9e7b3150c9 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:37.922788 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067ac8e-3463-425d-b10a-5a9e7b3150c9 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:37.922901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067ac8e-3463-425d-b10a-5a9e7b3150c9 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:37.924257 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 574/1174] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:04:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:04:37.929519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b3049-2adf-4beb-be22-bd5e90edd855 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:37.929978 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b3049-2adf-4beb-be22-bd5e90edd855 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:37.930083 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b3049-2adf-4beb-be22-bd5e90edd855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:37.947179 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-114b3049-2adf-4beb-be22-bd5e90edd855 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:37.948406 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-114b3049-2adf-4beb-be22-bd5e90edd855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:38.014313 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 601/1175] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:04:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:04:38.040932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067ac8e-3463-425d-b10a-5a9e7b3150c9 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:38.097449 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:38.148776 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067ac8e-3463-425d-b10a-5a9e7b3150c9 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:38.181775 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7b9f7-de2c-44c9-8654-50d28098f002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:38.182631 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7b9f7-de2c-44c9-8654-50d28098f002 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:38.182912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7b9f7-de2c-44c9-8654-50d28098f002 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:38.183183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7b9f7-de2c-44c9-8654-50d28098f002 None admin] PATH_INFO: `/v3/domains/9a44ce1b64d9438da3f8742bfe6e6f88` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:38.184393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e7b9f7-de2c-44c9-8654-50d28098f002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9a44ce1b64d9438da3f8742bfe6e6f88)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:38.185830 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e7b9f7-de2c-44c9-8654-50d28098f002 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:38.188016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 575/1176] 10.222.0.45 () {56 vars in 1183 bytes} [Thu Jun 2 19:04:38 2022] GET /identity/v3/domains/9a44ce1b64d9438da3f8742bfe6e6f88 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:38.193847 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b3049-2adf-4beb-be22-bd5e90edd855 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:38.245544 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:38.298898 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b3049-2adf-4beb-be22-bd5e90edd855 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:38.334980 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836b0ec-ead3-45e0-8571-cd4763711c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:38.335655 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836b0ec-ead3-45e0-8571-cd4763711c8f None admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:38.335934 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836b0ec-ead3-45e0-8571-cd4763711c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:38.336230 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836b0ec-ead3-45e0-8571-cd4763711c8f None admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:38.336953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836b0ec-ead3-45e0-8571-cd4763711c8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:38.338398 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836b0ec-ead3-45e0-8571-cd4763711c8f None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:38.448379 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 602/1177] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jun 2 19:04:38 2022] POST /identity/v3/users => generated 311 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:04:40.793392 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79d167-84d6-4a07-94a2-c834f5e42ed6 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:40.793925 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79d167-84d6-4a07-94a2-c834f5e42ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:40.793925 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79d167-84d6-4a07-94a2-c834f5e42ed6 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:40.795320 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 576/1178] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:04:40.801189 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1333f-14b1-4d86-987a-15f0496ace96 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:40.801660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1333f-14b1-4d86-987a-15f0496ace96 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:40.801764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1333f-14b1-4d86-987a-15f0496ace96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:40.819716 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-c6c1333f-14b1-4d86-987a-15f0496ace96 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:40.820962 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c6c1333f-14b1-4d86-987a-15f0496ace96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:40.892139 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 603/1179] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:04:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:04:40.915533 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79d167-84d6-4a07-94a2-c834f5e42ed6 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:41.019177 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79d167-84d6-4a07-94a2-c834f5e42ed6 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:41.038704 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:41.055680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4a460-098c-40f3-85a5-5a6edf683cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:41.056445 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4a460-098c-40f3-85a5-5a6edf683cef None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:41.056729 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4a460-098c-40f3-85a5-5a6edf683cef None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:41.057003 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4a460-098c-40f3-85a5-5a6edf683cef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:41.068159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4a460-098c-40f3-85a5-5a6edf683cef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:04:41.077363 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-fbd4a460-098c-40f3-85a5-5a6edf683cef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:04:41.077363 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:04:41.077363 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:04:41.077363 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:04:41.077363 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:04:41.077363 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:04:41.077363 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:04:41.077363 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:04:41.077363 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:04:41.077363 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:04:41.077363 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:04:41.077363 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:04:41.077363 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:04:41.077363 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:04:41.077363 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:04:41.077363 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:04:41.078756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:04:41.078756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:04:41.078756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:04:41.078756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:04:41.078756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:04:41.078756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:04:41.078756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:04:41.078756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:04:41.078756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:04:41.078756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:04:41.078756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:04:41.078756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:04:41.078756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:04:41.078756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:04:41.078756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:04:41.078756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:04:41.079829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:04:41.079829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:04:41.079829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:04:41.079829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:04:41.079829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:04:41.079829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:04:41.079829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:04:41.079829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:04:41.079829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:04:41.079829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:04:41.079829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:04:41.079829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:04:41.079829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 577/1180] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:04:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:04:41.085363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1333f-14b1-4d86-987a-15f0496ace96 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:41.126021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:41.184567 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1333f-14b1-4d86-987a-15f0496ace96 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:41.219275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12207374-6856-45ac-b7ab-132179751227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:41.219956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12207374-6856-45ac-b7ab-132179751227 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:41.220268 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12207374-6856-45ac-b7ab-132179751227 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:41.220546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12207374-6856-45ac-b7ab-132179751227 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:41.221289 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12207374-6856-45ac-b7ab-132179751227 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:04:41.221594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12207374-6856-45ac-b7ab-132179751227 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:41.222968 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12207374-6856-45ac-b7ab-132179751227 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:41.231107 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 604/1181] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:04:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:41.237613 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4a460-098c-40f3-85a5-5a6edf683cef None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:41.335134 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4a460-098c-40f3-85a5-5a6edf683cef None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:41.370702 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41276339-8032-4348-be78-a3048c9cb5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:41.371574 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41276339-8032-4348-be78-a3048c9cb5ec None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:41.371852 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41276339-8032-4348-be78-a3048c9cb5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:41.372163 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41276339-8032-4348-be78-a3048c9cb5ec None admin] PATH_INFO: `/v3/users/4effc1a7730144358b72c938f91b95d2` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:41.385036 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41276339-8032-4348-be78-a3048c9cb5ec None admin] RBAC: Authorizing `identity:get_user(user_id=4effc1a7730144358b72c938f91b95d2)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:41.386475 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41276339-8032-4348-be78-a3048c9cb5ec None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:41.388254 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 578/1182] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:04:41 2022] GET /identity/v3/users/4effc1a7730144358b72c938f91b95d2 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:41.394178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12207374-6856-45ac-b7ab-132179751227 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:41.490583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:41.493532 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12207374-6856-45ac-b7ab-132179751227 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:41.526931 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab155ffd-0ea2-47a2-bf84-4bb09c42f52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:41.527580 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab155ffd-0ea2-47a2-bf84-4bb09c42f52e None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:41.527862 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab155ffd-0ea2-47a2-bf84-4bb09c42f52e None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:41.528175 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab155ffd-0ea2-47a2-bf84-4bb09c42f52e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:41.595694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab155ffd-0ea2-47a2-bf84-4bb09c42f52e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:41.597105 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab155ffd-0ea2-47a2-bf84-4bb09c42f52e None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:41.690365 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:41.693957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 605/1183] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:04:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 19:04:41.700031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41276339-8032-4348-be78-a3048c9cb5ec None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:41.735316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:41.801196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41276339-8032-4348-be78-a3048c9cb5ec None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:41.835044 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef3c0e-1dd1-499b-ac3b-252b98f0a06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:41.835901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef3c0e-1dd1-499b-ac3b-252b98f0a06c None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:41.836212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef3c0e-1dd1-499b-ac3b-252b98f0a06c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:41.836489 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef3c0e-1dd1-499b-ac3b-252b98f0a06c None admin] PATH_INFO: `/v3/projects/f6d9297f0ba64c90a9a3af9dec19de11` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:41.837663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef3c0e-1dd1-499b-ac3b-252b98f0a06c None admin] RBAC: Authorizing `identity:get_project(project_id=f6d9297f0ba64c90a9a3af9dec19de11)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:41.839097 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef3c0e-1dd1-499b-ac3b-252b98f0a06c None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:41.841089 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 579/1184] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:04:41 2022] GET /identity/v3/projects/f6d9297f0ba64c90a9a3af9dec19de11 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:41.847437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab155ffd-0ea2-47a2-bf84-4bb09c42f52e None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:41.944947 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab155ffd-0ea2-47a2-bf84-4bb09c42f52e None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:41.978770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3ef35-1808-4bce-9fda-77eb9657e60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:41.979409 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3ef35-1808-4bce-9fda-77eb9657e60a None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:41.979690 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3ef35-1808-4bce-9fda-77eb9657e60a None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:41.979961 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3ef35-1808-4bce-9fda-77eb9657e60a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:41.980812 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3ef35-1808-4bce-9fda-77eb9657e60a None admin] RBAC: Adding query filter params (role.id=4588ca63994f4e2d9ce482d475edbabd, scope.project.id=f6d9297f0ba64c90a9a3af9dec19de11, user.id=4effc1a7730144358b72c938f91b95d2) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:04:41.981120 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3ef35-1808-4bce-9fda-77eb9657e60a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:41.982555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3ef35-1808-4bce-9fda-77eb9657e60a None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:41.988453 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 606/1185] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:04:41 2022] GET /identity/v3/role_assignments?user.id=4effc1a7730144358b72c938f91b95d2&scope.project.id=f6d9297f0ba64c90a9a3af9dec19de11&role.id=4588ca63994f4e2d9ce482d475edbabd => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:44.229494 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da1315-175e-4828-9f6e-d31aed4ac9e7 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:44.230055 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da1315-175e-4828-9f6e-d31aed4ac9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:44.230055 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da1315-175e-4828-9f6e-d31aed4ac9e7 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:44.231419 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 580/1186] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:04:44.237457 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bc4aa-ddb9-4b7c-8ea8-47b2daf400c6 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:44.237908 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bc4aa-ddb9-4b7c-8ea8-47b2daf400c6 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:44.238020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bc4aa-ddb9-4b7c-8ea8-47b2daf400c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:44.255189 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-7c0bc4aa-ddb9-4b7c-8ea8-47b2daf400c6 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:44.256410 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-7c0bc4aa-ddb9-4b7c-8ea8-47b2daf400c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:44.314261 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:44.322142 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 607/1187] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:04:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:04:44.345470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da1315-175e-4828-9f6e-d31aed4ac9e7 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:44.447494 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da1315-175e-4828-9f6e-d31aed4ac9e7 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:44.449809 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:44.480978 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb2879-7ac4-4fab-b903-0769cea86380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:44.481688 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb2879-7ac4-4fab-b903-0769cea86380 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:44.481964 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb2879-7ac4-4fab-b903-0769cea86380 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:44.482230 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb2879-7ac4-4fab-b903-0769cea86380 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:44.491950 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb2879-7ac4-4fab-b903-0769cea86380 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:04:44.499913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-86bb2879-7ac4-4fab-b903-0769cea86380 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:04:44.499913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:04:44.499913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:04:44.499913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:04:44.499913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:04:44.499913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:04:44.499913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:04:44.499913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:04:44.499913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:04:44.499913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:04:44.499913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:04:44.499913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:04:44.499913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:04:44.499913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:04:44.499913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:04:44.499913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:04:44.501081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:04:44.501081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:04:44.501081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:04:44.501081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:04:44.501081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:04:44.501081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:04:44.501081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:04:44.501081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:04:44.501081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:04:44.501081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:04:44.501081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:04:44.501081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:04:44.501081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:04:44.501081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:04:44.501081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:04:44.501081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:04:44.502126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:04:44.502126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:04:44.502126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:04:44.502126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:04:44.502126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:04:44.502126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:04:44.502126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:04:44.502126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:04:44.502126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:04:44.502126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:04:44.502126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:04:44.502126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:04:44.502126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 581/1188] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:04:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:04:44.507200 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bc4aa-ddb9-4b7c-8ea8-47b2daf400c6 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:44.604492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bc4aa-ddb9-4b7c-8ea8-47b2daf400c6 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:44.640632 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7a891-79b6-4d60-af25-70f4386716da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:44.641298 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7a891-79b6-4d60-af25-70f4386716da None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:44.641578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7a891-79b6-4d60-af25-70f4386716da None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:44.641856 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7a891-79b6-4d60-af25-70f4386716da None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:44.642591 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7a891-79b6-4d60-af25-70f4386716da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:04:44.642894 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7a891-79b6-4d60-af25-70f4386716da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:44.644282 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7a891-79b6-4d60-af25-70f4386716da None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:44.652414 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 608/1189] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:04:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:44.658320 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb2879-7ac4-4fab-b903-0769cea86380 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:44.758121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb2879-7ac4-4fab-b903-0769cea86380 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:44.791491 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65814e0c-46ef-435b-9519-1c7ab2ecd188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:44.792400 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65814e0c-46ef-435b-9519-1c7ab2ecd188 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:44.792677 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65814e0c-46ef-435b-9519-1c7ab2ecd188 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:44.794604 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65814e0c-46ef-435b-9519-1c7ab2ecd188 None admin] PATH_INFO: `/v3/users/4effc1a7730144358b72c938f91b95d2` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:44.794604 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65814e0c-46ef-435b-9519-1c7ab2ecd188 None admin] RBAC: Authorizing `identity:get_user(user_id=4effc1a7730144358b72c938f91b95d2)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:44.796205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65814e0c-46ef-435b-9519-1c7ab2ecd188 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:44.797848 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 582/1190] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:04:44 2022] GET /identity/v3/users/4effc1a7730144358b72c938f91b95d2 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:44.803669 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7a891-79b6-4d60-af25-70f4386716da None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:44.859835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:44.903460 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7a891-79b6-4d60-af25-70f4386716da None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:44.936696 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b648a03-3298-448b-8168-3413b7a1adaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:44.937552 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b648a03-3298-448b-8168-3413b7a1adaf None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:44.937825 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b648a03-3298-448b-8168-3413b7a1adaf None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:44.938093 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b648a03-3298-448b-8168-3413b7a1adaf None admin] PATH_INFO: `/v3/projects/f6d9297f0ba64c90a9a3af9dec19de11` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:44.939257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b648a03-3298-448b-8168-3413b7a1adaf None admin] RBAC: Authorizing `identity:get_project(project_id=f6d9297f0ba64c90a9a3af9dec19de11)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:44.940711 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b648a03-3298-448b-8168-3413b7a1adaf None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:44.942401 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 609/1191] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:04:44 2022] GET /identity/v3/projects/f6d9297f0ba64c90a9a3af9dec19de11 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:44.948319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65814e0c-46ef-435b-9519-1c7ab2ecd188 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:44.979332 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:45.047026 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65814e0c-46ef-435b-9519-1c7ab2ecd188 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:45.079100 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74054d-062b-4374-a67e-92c5cdab0025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:45.080023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74054d-062b-4374-a67e-92c5cdab0025 None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:45.080311 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74054d-062b-4374-a67e-92c5cdab0025 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:45.080584 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74054d-062b-4374-a67e-92c5cdab0025 None admin] PATH_INFO: `/v3/projects/f6d9297f0ba64c90a9a3af9dec19de11/users/4effc1a7730144358b72c938f91b95d2/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:45.082545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74054d-062b-4374-a67e-92c5cdab0025 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6d9297f0ba64c90a9a3af9dec19de11, user_id=4effc1a7730144358b72c938f91b95d2, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:45.083976 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74054d-062b-4374-a67e-92c5cdab0025 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:45.173942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 583/1192] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jun 2 19:04:44 2022] PUT /identity/v3/projects/f6d9297f0ba64c90a9a3af9dec19de11/users/4effc1a7730144358b72c938f91b95d2/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:04:47.425697 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6012b5-ff4f-45b7-a652-9fcfa2669248 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:47.426233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6012b5-ff4f-45b7-a652-9fcfa2669248 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:47.426233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6012b5-ff4f-45b7-a652-9fcfa2669248 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:47.427651 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 610/1193] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:04:47.433096 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9062004-0586-4da1-8281-284e6c882cd2 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:47.433503 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9062004-0586-4da1-8281-284e6c882cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:47.433651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9062004-0586-4da1-8281-284e6c882cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:47.450925 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-b9062004-0586-4da1-8281-284e6c882cd2 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:47.452814 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b9062004-0586-4da1-8281-284e6c882cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:47.517635 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 584/1194] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:04:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:04:47.541114 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6012b5-ff4f-45b7-a652-9fcfa2669248 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:47.640607 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6012b5-ff4f-45b7-a652-9fcfa2669248 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:47.662416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:47.673330 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e810bd9-08df-40f6-a61c-fbb0f0d0bab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:47.674114 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e810bd9-08df-40f6-a61c-fbb0f0d0bab6 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:47.674476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e810bd9-08df-40f6-a61c-fbb0f0d0bab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:47.674757 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e810bd9-08df-40f6-a61c-fbb0f0d0bab6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:47.685396 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e810bd9-08df-40f6-a61c-fbb0f0d0bab6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:04:47.693945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-2e810bd9-08df-40f6-a61c-fbb0f0d0bab6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:04:47.693945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:04:47.693945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:04:47.693945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:04:47.693945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:04:47.693945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:04:47.693945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:04:47.693945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:04:47.693945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:04:47.693945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:04:47.693945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:04:47.693945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:04:47.693945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:04:47.693945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:04:47.693945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:04:47.693945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:04:47.695021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:04:47.695021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:04:47.695021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:04:47.695021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:04:47.695021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:04:47.695021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:04:47.695021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:04:47.695021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:04:47.695021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:04:47.695021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:04:47.695021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:04:47.695021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:04:47.695021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:04:47.695021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:04:47.695021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:04:47.695021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:04:47.696091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:04:47.696091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:04:47.696091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:04:47.696091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:04:47.696091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:04:47.696091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:04:47.696091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:04:47.696091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:04:47.696091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:04:47.696091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:04:47.696091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:04:47.696091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:04:47.696091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 611/1195] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:04:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:04:47.701276 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9062004-0586-4da1-8281-284e6c882cd2 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:47.724735 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:47.798631 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9062004-0586-4da1-8281-284e6c882cd2 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:47.831981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519018e2-016d-490c-915a-19db1281750c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:47.832668 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519018e2-016d-490c-915a-19db1281750c None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:47.832948 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519018e2-016d-490c-915a-19db1281750c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:47.833220 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519018e2-016d-490c-915a-19db1281750c None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:47.833958 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519018e2-016d-490c-915a-19db1281750c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:04:47.834257 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519018e2-016d-490c-915a-19db1281750c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:47.835612 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519018e2-016d-490c-915a-19db1281750c None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:47.844711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 585/1196] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:04:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:47.850674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e810bd9-08df-40f6-a61c-fbb0f0d0bab6 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:47.947892 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e810bd9-08df-40f6-a61c-fbb0f0d0bab6 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:47.981879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603473fb-521f-48b8-8648-6dbf59371f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:47.982751 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603473fb-521f-48b8-8648-6dbf59371f66 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:47.983034 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603473fb-521f-48b8-8648-6dbf59371f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:47.983310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603473fb-521f-48b8-8648-6dbf59371f66 None admin] PATH_INFO: `/v3/users/4effc1a7730144358b72c938f91b95d2` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:47.984527 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603473fb-521f-48b8-8648-6dbf59371f66 None admin] RBAC: Authorizing `identity:get_user(user_id=4effc1a7730144358b72c938f91b95d2)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:47.985965 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603473fb-521f-48b8-8648-6dbf59371f66 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:47.987591 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 612/1197] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jun 2 19:04:47 2022] GET /identity/v3/users/4effc1a7730144358b72c938f91b95d2 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:47.993391 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519018e2-016d-490c-915a-19db1281750c None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:48.076460 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:48.094605 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519018e2-016d-490c-915a-19db1281750c None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:48.129881 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d6b48-0ace-4200-ad3a-3a947cb2856d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:48.130530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d6b48-0ace-4200-ad3a-3a947cb2856d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:48.130813 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d6b48-0ace-4200-ad3a-3a947cb2856d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:48.131089 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d6b48-0ace-4200-ad3a-3a947cb2856d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:48.197216 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d6b48-0ace-4200-ad3a-3a947cb2856d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:48.198761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d6b48-0ace-4200-ad3a-3a947cb2856d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:48.279815 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:48.295571 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 586/1198] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:04:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 19:04:48.301473 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603473fb-521f-48b8-8648-6dbf59371f66 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:48.353941 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:48.403564 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603473fb-521f-48b8-8648-6dbf59371f66 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:48.438827 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12efe7-9e85-49b0-919d-8b2ae0381198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:48.445238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12efe7-9e85-49b0-919d-8b2ae0381198 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:48.445238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12efe7-9e85-49b0-919d-8b2ae0381198 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:48.445238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12efe7-9e85-49b0-919d-8b2ae0381198 None admin] PATH_INFO: `/v3/projects/f6d9297f0ba64c90a9a3af9dec19de11` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:48.445238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12efe7-9e85-49b0-919d-8b2ae0381198 None admin] RBAC: Authorizing `identity:get_project(project_id=f6d9297f0ba64c90a9a3af9dec19de11)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:48.445238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12efe7-9e85-49b0-919d-8b2ae0381198 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:48.445238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 613/1199] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jun 2 19:04:48 2022] GET /identity/v3/projects/f6d9297f0ba64c90a9a3af9dec19de11 => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:48.450886 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d6b48-0ace-4200-ad3a-3a947cb2856d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:48.549801 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d6b48-0ace-4200-ad3a-3a947cb2856d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:48.584339 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe542318-7732-467e-9793-01a9b4fca4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:48.584990 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe542318-7732-467e-9793-01a9b4fca4cd None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:48.585265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe542318-7732-467e-9793-01a9b4fca4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:48.585541 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe542318-7732-467e-9793-01a9b4fca4cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:48.586357 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe542318-7732-467e-9793-01a9b4fca4cd None admin] RBAC: Adding query filter params (role.id=4588ca63994f4e2d9ce482d475edbabd, scope.project.id=f6d9297f0ba64c90a9a3af9dec19de11, user.id=4effc1a7730144358b72c938f91b95d2) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:04:48.586667 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe542318-7732-467e-9793-01a9b4fca4cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:48.588110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe542318-7732-467e-9793-01a9b4fca4cd None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:48.594265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 587/1200] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:04:48 2022] GET /identity/v3/role_assignments?user.id=4effc1a7730144358b72c938f91b95d2&scope.project.id=f6d9297f0ba64c90a9a3af9dec19de11&role.id=4588ca63994f4e2d9ce482d475edbabd => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:58.433967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=40 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:58.591554 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=76 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:12.084692 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce137c5d-586c-4522-976f-81e3dc857b4d None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:12.085263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce137c5d-586c-4522-976f-81e3dc857b4d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:12.085263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce137c5d-586c-4522-976f-81e3dc857b4d None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:12.086666 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 614/1201] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:06:12.092599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d670c1-93ba-42af-a0a4-6bbb11686aa4 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:12.093092 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d670c1-93ba-42af-a0a4-6bbb11686aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:12.093187 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d670c1-93ba-42af-a0a4-6bbb11686aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:12.111229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-99d670c1-93ba-42af-a0a4-6bbb11686aa4 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:06:12.112479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-99d670c1-93ba-42af-a0a4-6bbb11686aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:06:12.179128 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 588/1202] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:06:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:06:12.204773 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce137c5d-586c-4522-976f-81e3dc857b4d None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:12.305100 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce137c5d-586c-4522-976f-81e3dc857b4d None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:12.338907 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a934b-3df7-4ca7-a009-710d6160868b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:12.339620 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a934b-3df7-4ca7-a009-710d6160868b None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:12.339898 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a934b-3df7-4ca7-a009-710d6160868b None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:12.340199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a934b-3df7-4ca7-a009-710d6160868b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:12.350609 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a934b-3df7-4ca7-a009-710d6160868b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:12.352188 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a934b-3df7-4ca7-a009-710d6160868b None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:12.369136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-ee2a934b-3df7-4ca7-a009-710d6160868b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:06:12.369136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:12.369136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:12.369136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:12.369136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:12.369136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:12.369136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:12.369136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:12.369136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:12.369136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:12.369136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:12.369136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:12.369136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:06:12.369136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:06:12.369136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:06:12.370343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:06:12.370343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:12.370343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:12.370343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:12.370343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:12.370343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:12.370343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:12.370343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:12.370343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:12.370343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:12.370343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:12.370343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:12.370343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:12.370343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:12.370343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:12.370343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:12.370343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:12.371503 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:06:12.371503 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:06:12.371503 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:06:12.371503 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:06:12.371503 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 615/1203] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:06:12.376627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d670c1-93ba-42af-a0a4-6bbb11686aa4 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:12.473589 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d670c1-93ba-42af-a0a4-6bbb11686aa4 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:12.500996 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:12.506535 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd239b-c049-4d75-970f-ec5c78aedb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:12.507188 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd239b-c049-4d75-970f-ec5c78aedb2d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:12.507584 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd239b-c049-4d75-970f-ec5c78aedb2d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:12.507874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd239b-c049-4d75-970f-ec5c78aedb2d None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:12.508612 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd239b-c049-4d75-970f-ec5c78aedb2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:12.513353 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd239b-c049-4d75-970f-ec5c78aedb2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:12.513353 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd239b-c049-4d75-970f-ec5c78aedb2d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:12.521830 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 589/1204] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:12.527689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a934b-3df7-4ca7-a009-710d6160868b None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:12.580600 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:12.626879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a934b-3df7-4ca7-a009-710d6160868b None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:12.660152 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116bc22-ca34-4824-b069-c1d088ed9d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:12.660811 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116bc22-ca34-4824-b069-c1d088ed9d8b None admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:12.661143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116bc22-ca34-4824-b069-c1d088ed9d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:12.661423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116bc22-ca34-4824-b069-c1d088ed9d8b None admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:12.662106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116bc22-ca34-4824-b069-c1d088ed9d8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:12.663533 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116bc22-ca34-4824-b069-c1d088ed9d8b None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:12.772585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 616/1205] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jun 2 19:06:12 2022] POST /identity/v3/users => generated 251 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:06:15.021985 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6149cb6-2626-41be-a8c1-2ae6fe1ae03a None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:15.022575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6149cb6-2626-41be-a8c1-2ae6fe1ae03a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:15.022575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6149cb6-2626-41be-a8c1-2ae6fe1ae03a None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:15.024026 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 590/1206] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:06:15.029320 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d8fca-3526-4839-82ad-7cc2cecceed4 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:15.029745 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d8fca-3526-4839-82ad-7cc2cecceed4 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:15.029879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d8fca-3526-4839-82ad-7cc2cecceed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:15.046515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-c76d8fca-3526-4839-82ad-7cc2cecceed4 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:06:15.047627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c76d8fca-3526-4839-82ad-7cc2cecceed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:06:15.116297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 617/1207] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:06:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:06:15.139959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6149cb6-2626-41be-a8c1-2ae6fe1ae03a None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:15.242151 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6149cb6-2626-41be-a8c1-2ae6fe1ae03a None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:15.275322 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee85ba0-6a57-4d99-ae06-637c9b85b134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:15.276172 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee85ba0-6a57-4d99-ae06-637c9b85b134 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:15.276457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee85ba0-6a57-4d99-ae06-637c9b85b134 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:15.276734 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee85ba0-6a57-4d99-ae06-637c9b85b134 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:15.286993 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee85ba0-6a57-4d99-ae06-637c9b85b134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:06:15.294718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-cee85ba0-6a57-4d99-ae06-637c9b85b134 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:06:15.294718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:15.294718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:15.294718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:15.294718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:15.294718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:15.294718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:15.294718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:15.294718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:15.294718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:15.294718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:15.294718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:15.294718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:06:15.294718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:06:15.294718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:06:15.294718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:06:15.295864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:06:15.295864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:06:15.295864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:06:15.295864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:06:15.295864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:15.295864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:15.295864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:15.295864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:15.295864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:15.295864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:15.295864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:15.295864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:15.295864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:15.295864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:15.295864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:15.295864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:15.297205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:15.297205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:15.297205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:15.297205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:15.297205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:06:15.297205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:06:15.297205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:06:15.297205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:06:15.297205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:06:15.297205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:06:15.297205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:06:15.297205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:06:15.297205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 591/1208] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jun 2 19:06:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:15.302509 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d8fca-3526-4839-82ad-7cc2cecceed4 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:15.341922 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:15.398868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d8fca-3526-4839-82ad-7cc2cecceed4 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:15.431551 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7348c-e125-44ec-b0de-87a282bba414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:15.432239 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7348c-e125-44ec-b0de-87a282bba414 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:15.432525 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7348c-e125-44ec-b0de-87a282bba414 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:15.432795 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7348c-e125-44ec-b0de-87a282bba414 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:15.433558 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7348c-e125-44ec-b0de-87a282bba414 None admin] RBAC: Adding query filter params (name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:15.433854 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7348c-e125-44ec-b0de-87a282bba414 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:15.435215 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7348c-e125-44ec-b0de-87a282bba414 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:15.444217 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 618/1209] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jun 2 19:06:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:15.449969 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee85ba0-6a57-4d99-ae06-637c9b85b134 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:15.499136 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:15.546162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee85ba0-6a57-4d99-ae06-637c9b85b134 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:15.579296 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d8ce1-f374-47ba-ae35-050fefc22d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:15.580099 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d8ce1-f374-47ba-ae35-050fefc22d42 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:15.580382 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d8ce1-f374-47ba-ae35-050fefc22d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:15.580655 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d8ce1-f374-47ba-ae35-050fefc22d42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:15.590639 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d8ce1-f374-47ba-ae35-050fefc22d42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:15.592107 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d8ce1-f374-47ba-ae35-050fefc22d42 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:15.612175 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-9d7d8ce1-f374-47ba-ae35-050fefc22d42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:06:15.612175 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:15.612175 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:15.612175 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:15.612175 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:15.612175 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:15.612175 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:15.612175 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:15.612175 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:15.612175 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:15.612175 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:15.612175 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:15.612175 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:06:15.612175 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:06:15.612175 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:06:15.613233 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:06:15.613233 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:15.613233 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:15.613233 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:15.613233 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:15.613233 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:15.613233 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:15.613233 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:15.613233 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:15.613233 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:15.613233 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:15.613233 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:15.613233 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:15.613233 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:15.613233 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:15.613233 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:15.613233 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:15.614243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:06:15.614243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:06:15.614243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:06:15.614243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:06:15.614243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 592/1210] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:06:15.619107 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7348c-e125-44ec-b0de-87a282bba414 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:15.715205 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:15.721656 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7348c-e125-44ec-b0de-87a282bba414 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:15.755438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a36cd-39b3-47c3-a20d-2aa6edb669c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:15.756142 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a36cd-39b3-47c3-a20d-2aa6edb669c1 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:15.756424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a36cd-39b3-47c3-a20d-2aa6edb669c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:15.756701 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a36cd-39b3-47c3-a20d-2aa6edb669c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:15.757419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a36cd-39b3-47c3-a20d-2aa6edb669c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:15.757725 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a36cd-39b3-47c3-a20d-2aa6edb669c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:15.759097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a36cd-39b3-47c3-a20d-2aa6edb669c1 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:15.771401 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 619/1211] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:15.777230 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d8ce1-f374-47ba-ae35-050fefc22d42 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:15.876414 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d8ce1-f374-47ba-ae35-050fefc22d42 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:15.878024 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:15.909902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab6514-aa3c-471d-8a3b-3901611852cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:15.910698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab6514-aa3c-471d-8a3b-3901611852cb None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:15.910973 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab6514-aa3c-471d-8a3b-3901611852cb None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:15.911243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab6514-aa3c-471d-8a3b-3901611852cb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:15.918142 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab6514-aa3c-471d-8a3b-3901611852cb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:15.919601 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab6514-aa3c-471d-8a3b-3901611852cb None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:15.934912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-f6ab6514-aa3c-471d-8a3b-3901611852cb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 19:06:15.934912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:15.934912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:15.934912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:15.934912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:15.934912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:15.934912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:15.934912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:15.934912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:15.934912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:15.934912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:15.934912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:15.934912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:06:15.934912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:06:15.934912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:06:15.934912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:06:15.936279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:15.936279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:15.936279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:06:15.936279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:06:15.936279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:06:15.936279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:06:15.936279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:15.936279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:15.936279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:15.936279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:15.936279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:15.936279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:15.936279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:15.936279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:15.936279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:15.936279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:15.936279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:15.936279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:15.937555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:15.937555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:15.937555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:06:15.937555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:06:15.937555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:06:15.937555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:06:15.937555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:06:15.937555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:06:15.937555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 19:06:15.937555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:06:15.937555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 593/1212] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:06:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:15.942102 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a36cd-39b3-47c3-a20d-2aa6edb669c1 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:16.039920 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a36cd-39b3-47c3-a20d-2aa6edb669c1 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:16.073836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d332ab-0136-4357-aabb-e1941a56bc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:16.074589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d332ab-0136-4357-aabb-e1941a56bc3c None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:16.074777 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d332ab-0136-4357-aabb-e1941a56bc3c None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:16.075054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d332ab-0136-4357-aabb-e1941a56bc3c None admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:16.075869 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d332ab-0136-4357-aabb-e1941a56bc3c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:16.076206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d332ab-0136-4357-aabb-e1941a56bc3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:16.077624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d332ab-0136-4357-aabb-e1941a56bc3c None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:16.098103 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 620/1213] 10.222.0.45 () {56 vars in 1143 bytes} [Thu Jun 2 19:06:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:16.104050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab6514-aa3c-471d-8a3b-3901611852cb None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:16.201995 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab6514-aa3c-471d-8a3b-3901611852cb None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:16.236448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b098d5e-a091-4903-a135-ed7c132c7f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:16.237088 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b098d5e-a091-4903-a135-ed7c132c7f31 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:16.237376 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b098d5e-a091-4903-a135-ed7c132c7f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:16.237651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b098d5e-a091-4903-a135-ed7c132c7f31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:16.267435 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:16.304366 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b098d5e-a091-4903-a135-ed7c132c7f31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:16.305846 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b098d5e-a091-4903-a135-ed7c132c7f31 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:16.403156 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 594/1214] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:06:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:16.409380 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d332ab-0136-4357-aabb-e1941a56bc3c None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:16.427856 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:16.507792 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d332ab-0136-4357-aabb-e1941a56bc3c None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:16.540813 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac07f98-4128-4306-b294-d9f4c5bbb415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:16.541597 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac07f98-4128-4306-b294-d9f4c5bbb415 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:16.541875 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac07f98-4128-4306-b294-d9f4c5bbb415 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:16.542149 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac07f98-4128-4306-b294-d9f4c5bbb415 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:16.551896 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac07f98-4128-4306-b294-d9f4c5bbb415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:16.553371 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac07f98-4128-4306-b294-d9f4c5bbb415 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:16.571036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-1ac07f98-4128-4306-b294-d9f4c5bbb415 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:06:16.571036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:16.571036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:16.571036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:16.571036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:16.571036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:16.571036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:16.571036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:16.571036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:16.571036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:16.571036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:16.571036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:16.571036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:06:16.571036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:06:16.571036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:06:16.572207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:06:16.572207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:16.572207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:16.572207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:16.572207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:16.572207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:16.572207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:16.572207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:16.572207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:16.572207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:16.572207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:16.572207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:16.572207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:16.572207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:16.572207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:16.572207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:16.572207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:16.573136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:06:16.573136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:06:16.573136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:06:16.573136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:06:16.573136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 621/1215] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:06:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:16.578270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b098d5e-a091-4903-a135-ed7c132c7f31 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:16.638235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:16.674789 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b098d5e-a091-4903-a135-ed7c132c7f31 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:16.710128 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1c424-8ac5-469c-b72a-fdd3b4d6011d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:16.710797 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1c424-8ac5-469c-b72a-fdd3b4d6011d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:16.711076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1c424-8ac5-469c-b72a-fdd3b4d6011d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:16.711351 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1c424-8ac5-469c-b72a-fdd3b4d6011d None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:16.712102 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1c424-8ac5-469c-b72a-fdd3b4d6011d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:16.712410 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1c424-8ac5-469c-b72a-fdd3b4d6011d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:16.714036 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1c424-8ac5-469c-b72a-fdd3b4d6011d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:16.725559 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 595/1216] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:16.731149 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac07f98-4128-4306-b294-d9f4c5bbb415 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:16.809363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:16.843097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac07f98-4128-4306-b294-d9f4c5bbb415 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:16.875366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074fadc6-5028-4063-8ee0-4840c0c6fc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:16.876769 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fadc6-5028-4063-8ee0-4840c0c6fc8f None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:16.877099 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fadc6-5028-4063-8ee0-4840c0c6fc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:16.877379 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fadc6-5028-4063-8ee0-4840c0c6fc8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:16.883721 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074fadc6-5028-4063-8ee0-4840c0c6fc8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:16.885237 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074fadc6-5028-4063-8ee0-4840c0c6fc8f None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:16.898594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-074fadc6-5028-4063-8ee0-4840c0c6fc8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:06:16.898594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:16.898594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:16.898594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:16.898594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:16.898594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:16.898594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:16.898594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:16.898594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:16.898594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:16.898594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:16.898594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:16.898594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:06:16.898594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:06:16.898594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:06:16.899628 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:06:16.899628 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:16.899628 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:16.899628 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:16.899628 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:16.899628 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:16.899628 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:16.899628 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:16.899628 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:16.899628 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:16.899628 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:16.899628 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:16.899628 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:16.899628 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:16.899628 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:16.899628 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:16.899628 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:16.900658 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:06:16.900658 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:06:16.900658 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:06:16.900658 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:06:16.900658 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:06:16.900658 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:06:16.900658 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:06:16.900658 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:06:16.900658 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 622/1217] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:06:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:16.905610 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1c424-8ac5-469c-b72a-fdd3b4d6011d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:17.004277 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1c424-8ac5-469c-b72a-fdd3b4d6011d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:17.025441 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:17.037624 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db241c9-3746-449b-813f-73953f0b5ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:17.038280 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db241c9-3746-449b-813f-73953f0b5ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:17.038557 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db241c9-3746-449b-813f-73953f0b5ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:17.038823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db241c9-3746-449b-813f-73953f0b5ca3 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:17.039600 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db241c9-3746-449b-813f-73953f0b5ca3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:17.039899 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db241c9-3746-449b-813f-73953f0b5ca3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:17.041402 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db241c9-3746-449b-813f-73953f0b5ca3 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:17.054293 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 596/1218] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:06:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:17.060586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074fadc6-5028-4063-8ee0-4840c0c6fc8f None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:17.161985 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074fadc6-5028-4063-8ee0-4840c0c6fc8f None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:17.190285 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:17.196040 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe010a7-dc5a-4386-92a8-a59fef1ae7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:17.196728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe010a7-dc5a-4386-92a8-a59fef1ae7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:17.197013 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe010a7-dc5a-4386-92a8-a59fef1ae7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:17.197289 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe010a7-dc5a-4386-92a8-a59fef1ae7b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:17.198108 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe010a7-dc5a-4386-92a8-a59fef1ae7b8 None admin] RBAC: Adding query filter params (role.id=13ff8a5ffa5648c28ec00aa75b69d913, scope.project.id=b11b7e66a993492d8163097bce955c0b, user.id=3ebc95c1b3284c1d8321900cf442a811) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:17.198424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe010a7-dc5a-4386-92a8-a59fef1ae7b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:17.199844 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe010a7-dc5a-4386-92a8-a59fef1ae7b8 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:17.205170 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 623/1219] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:06:17 2022] GET /identity/v3/role_assignments?user.id=3ebc95c1b3284c1d8321900cf442a811&scope.project.id=b11b7e66a993492d8163097bce955c0b&role.id=13ff8a5ffa5648c28ec00aa75b69d913 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:19.421071 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c55c2-534d-4e76-ae54-5f54f5fa1b9b None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:19.421637 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c55c2-534d-4e76-ae54-5f54f5fa1b9b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:19.421793 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c55c2-534d-4e76-ae54-5f54f5fa1b9b None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:19.423208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 597/1220] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:06:19.428349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667762dd-9d7b-4239-aa66-60170af7a2b8 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:19.428736 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667762dd-9d7b-4239-aa66-60170af7a2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:19.428907 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667762dd-9d7b-4239-aa66-60170af7a2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:19.446200 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-667762dd-9d7b-4239-aa66-60170af7a2b8 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:06:19.447375 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-667762dd-9d7b-4239-aa66-60170af7a2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:06:19.513806 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 624/1221] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:06:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:06:19.536859 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c55c2-534d-4e76-ae54-5f54f5fa1b9b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:19.636216 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c55c2-534d-4e76-ae54-5f54f5fa1b9b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:19.669585 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49a8da-4abb-469c-b3ca-6dfead61b084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:19.670368 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49a8da-4abb-469c-b3ca-6dfead61b084 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:19.670645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49a8da-4abb-469c-b3ca-6dfead61b084 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:19.670912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49a8da-4abb-469c-b3ca-6dfead61b084 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:19.680849 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a49a8da-4abb-469c-b3ca-6dfead61b084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:06:19.688998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-7a49a8da-4abb-469c-b3ca-6dfead61b084 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:06:19.688998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:19.688998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:19.688998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:19.688998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:19.688998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:19.688998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:19.688998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:19.688998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:19.688998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:19.688998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:19.688998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:19.688998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:06:19.688998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:06:19.688998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:06:19.688998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:06:19.708828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:06:19.708828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:06:19.708828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:06:19.708828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:06:19.708828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:19.708828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:19.708828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:19.708828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:19.708828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:19.708828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:19.708828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:19.708828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:19.708828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:19.708828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:19.708828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:19.708828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:19.709678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:19.709678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:19.709678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:19.709678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:19.709678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:06:19.709678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:06:19.709678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:06:19.709678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:06:19.709678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:06:19.709678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:06:19.709678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:06:19.709678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:06:19.709678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 598/1222] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jun 2 19:06:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:19.710463 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667762dd-9d7b-4239-aa66-60170af7a2b8 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:19.794915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667762dd-9d7b-4239-aa66-60170af7a2b8 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:19.819809 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:19.830206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111d055-c017-439d-9dc5-e5488ace81d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:19.830879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111d055-c017-439d-9dc5-e5488ace81d8 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:19.831165 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111d055-c017-439d-9dc5-e5488ace81d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:19.831445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111d055-c017-439d-9dc5-e5488ace81d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:19.832222 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111d055-c017-439d-9dc5-e5488ace81d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:19.832529 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111d055-c017-439d-9dc5-e5488ace81d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:19.834012 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111d055-c017-439d-9dc5-e5488ace81d8 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:19.842076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 625/1223] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jun 2 19:06:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:19.847962 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49a8da-4abb-469c-b3ca-6dfead61b084 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:19.892255 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:19.946752 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49a8da-4abb-469c-b3ca-6dfead61b084 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:19.978628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd58733-543d-4e9a-bac8-8d4bf944d8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:19.979452 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd58733-543d-4e9a-bac8-8d4bf944d8dd None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:19.979731 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd58733-543d-4e9a-bac8-8d4bf944d8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:19.980013 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd58733-543d-4e9a-bac8-8d4bf944d8dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:19.990793 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd58733-543d-4e9a-bac8-8d4bf944d8dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:19.992262 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd58733-543d-4e9a-bac8-8d4bf944d8dd None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:20.010603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-5bd58733-543d-4e9a-bac8-8d4bf944d8dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:06:20.010603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:20.010603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:20.010603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:20.010603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:20.010603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:20.010603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:20.010603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:20.010603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:20.010603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:20.010603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:20.010603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:20.010603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:06:20.010603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:06:20.010603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:06:20.011698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:06:20.011698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:20.011698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:20.011698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:20.011698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:20.011698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:20.011698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:20.011698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:20.011698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:20.011698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:20.011698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:20.011698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:20.011698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:20.011698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:20.011698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:20.011698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:20.011698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:20.013026 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:06:20.013026 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:06:20.013026 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:06:20.013026 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:06:20.013026 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 599/1224] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:20.017688 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111d055-c017-439d-9dc5-e5488ace81d8 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:20.119160 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111d055-c017-439d-9dc5-e5488ace81d8 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:20.151439 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed5747-b8e2-4886-8e81-37f75beded17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:20.152123 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed5747-b8e2-4886-8e81-37f75beded17 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:20.152406 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed5747-b8e2-4886-8e81-37f75beded17 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:20.152681 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed5747-b8e2-4886-8e81-37f75beded17 None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:20.153398 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed5747-b8e2-4886-8e81-37f75beded17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:20.153700 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed5747-b8e2-4886-8e81-37f75beded17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:20.155059 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed5747-b8e2-4886-8e81-37f75beded17 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:20.166977 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 626/1225] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:20.172742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd58733-543d-4e9a-bac8-8d4bf944d8dd None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:20.266451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:20.272921 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd58733-543d-4e9a-bac8-8d4bf944d8dd None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:20.306565 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc83cd-132c-4786-8997-87850a9dc99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:20.307364 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc83cd-132c-4786-8997-87850a9dc99d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:20.307646 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc83cd-132c-4786-8997-87850a9dc99d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:20.307918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc83cd-132c-4786-8997-87850a9dc99d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:20.315345 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc83cd-132c-4786-8997-87850a9dc99d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:20.316806 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc83cd-132c-4786-8997-87850a9dc99d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:20.330826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-43bc83cd-132c-4786-8997-87850a9dc99d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 19:06:20.330826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:20.330826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:20.330826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:20.330826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:20.330826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:20.330826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:20.330826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:20.330826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:20.330826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:20.330826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:20.330826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:20.330826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:06:20.330826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:06:20.330826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:06:20.330826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:06:20.331971 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:20.331971 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:20.331971 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:06:20.331971 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:06:20.331971 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:06:20.331971 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:06:20.331971 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:20.331971 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:20.331971 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:20.331971 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:20.331971 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:20.331971 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:20.331971 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:20.331971 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:20.331971 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:20.331971 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:20.331971 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:20.331971 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:20.332981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:20.332981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:20.332981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:06:20.332981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:06:20.332981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:06:20.332981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:06:20.332981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:06:20.332981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:06:20.332981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 19:06:20.332981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:06:20.332981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 600/1226] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:06:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:20.337907 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed5747-b8e2-4886-8e81-37f75beded17 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:20.384221 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:20.436229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed5747-b8e2-4886-8e81-37f75beded17 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:20.469291 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a19c6-7763-4631-8633-e18b48743941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:20.470567 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a19c6-7763-4631-8633-e18b48743941 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:20.470848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a19c6-7763-4631-8633-e18b48743941 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:20.471122 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a19c6-7763-4631-8633-e18b48743941 None admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:20.471949 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a19c6-7763-4631-8633-e18b48743941 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:20.472282 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a19c6-7763-4631-8633-e18b48743941 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:20.473714 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a19c6-7763-4631-8633-e18b48743941 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:20.490052 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 627/1227] 10.222.0.45 () {56 vars in 1143 bytes} [Thu Jun 2 19:06:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:20.495767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc83cd-132c-4786-8997-87850a9dc99d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:20.598335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc83cd-132c-4786-8997-87850a9dc99d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:20.631594 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85931a0d-f553-41c0-a6d8-ee65f47934bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:20.632403 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85931a0d-f553-41c0-a6d8-ee65f47934bf None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:20.632682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85931a0d-f553-41c0-a6d8-ee65f47934bf None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:20.632951 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85931a0d-f553-41c0-a6d8-ee65f47934bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:20.644757 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85931a0d-f553-41c0-a6d8-ee65f47934bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:20.646200 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85931a0d-f553-41c0-a6d8-ee65f47934bf None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:20.663673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-85931a0d-f553-41c0-a6d8-ee65f47934bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:06:20.663673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:20.663673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:20.663673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:20.663673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:20.663673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:20.663673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:20.663673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:20.663673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:20.663673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:20.663673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:20.663673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:20.663673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:06:20.663673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:06:20.663673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:06:20.664748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:06:20.664748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:20.664748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:20.664748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:20.664748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:20.664748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:20.664748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:20.664748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:20.664748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:20.664748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:20.664748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:20.664748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:20.664748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:20.664748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:20.664748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:20.664748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:20.664748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:20.665770 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:06:20.665770 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:06:20.665770 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:06:20.665770 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:06:20.665770 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 601/1228] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:20.670560 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a19c6-7763-4631-8633-e18b48743941 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:20.769182 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a19c6-7763-4631-8633-e18b48743941 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:20.771604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:20.802480 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5363584-ae7e-4546-b82c-b20626adff88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:20.803144 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5363584-ae7e-4546-b82c-b20626adff88 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:20.803421 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5363584-ae7e-4546-b82c-b20626adff88 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:20.803735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5363584-ae7e-4546-b82c-b20626adff88 None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:20.804463 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5363584-ae7e-4546-b82c-b20626adff88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:20.804767 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5363584-ae7e-4546-b82c-b20626adff88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:20.806169 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5363584-ae7e-4546-b82c-b20626adff88 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:20.817150 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 628/1229] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:20.822852 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85931a0d-f553-41c0-a6d8-ee65f47934bf None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:20.832803 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:20.922228 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85931a0d-f553-41c0-a6d8-ee65f47934bf None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:20.955072 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f37b29-ba13-4f90-9f63-24671a40be76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:20.955847 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f37b29-ba13-4f90-9f63-24671a40be76 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:20.956154 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f37b29-ba13-4f90-9f63-24671a40be76 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:20.956425 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f37b29-ba13-4f90-9f63-24671a40be76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:20.962824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f37b29-ba13-4f90-9f63-24671a40be76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:20.964583 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f37b29-ba13-4f90-9f63-24671a40be76 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:20.978265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-19f37b29-ba13-4f90-9f63-24671a40be76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:06:20.978265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:20.978265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:20.978265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:20.978265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:20.978265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:20.978265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:20.978265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:20.978265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:20.978265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:20.978265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:20.978265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:20.978265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:06:20.978265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:06:20.978265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:06:20.982496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:06:20.982496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:20.982496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:20.982496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:20.982496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:20.982496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:20.982496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:20.982496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:20.982496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:20.982496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:20.982496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:20.982496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:20.982496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:20.982496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:20.982496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:20.982496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:20.982496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:20.983603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:06:20.983603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:06:20.983603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:06:20.983603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:06:20.983603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:06:20.983603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:06:20.983603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:06:20.983603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:06:20.983603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 602/1230] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:06:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:20.985348 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5363584-ae7e-4546-b82c-b20626adff88 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:21.084584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5363584-ae7e-4546-b82c-b20626adff88 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:21.118787 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2ecdf-2b43-46dc-9bc1-8a27701a4c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:21.119517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2ecdf-2b43-46dc-9bc1-8a27701a4c98 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:21.119860 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2ecdf-2b43-46dc-9bc1-8a27701a4c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:21.120180 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2ecdf-2b43-46dc-9bc1-8a27701a4c98 None admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:21.120971 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2ecdf-2b43-46dc-9bc1-8a27701a4c98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:21.121283 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2ecdf-2b43-46dc-9bc1-8a27701a4c98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:21.122721 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2ecdf-2b43-46dc-9bc1-8a27701a4c98 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:21.135206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 629/1231] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:06:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:21.141336 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f37b29-ba13-4f90-9f63-24671a40be76 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:21.206415 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:21.240612 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f37b29-ba13-4f90-9f63-24671a40be76 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:21.273934 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ee164-27d0-43d8-b318-bf9858d171e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:21.274817 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ee164-27d0-43d8-b318-bf9858d171e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:21.275101 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ee164-27d0-43d8-b318-bf9858d171e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:21.275379 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ee164-27d0-43d8-b318-bf9858d171e0 None admin] PATH_INFO: `/v3/projects/b11b7e66a993492d8163097bce955c0b/users/3ebc95c1b3284c1d8321900cf442a811/roles/13ff8a5ffa5648c28ec00aa75b69d913` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:21.289150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ee164-27d0-43d8-b318-bf9858d171e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b11b7e66a993492d8163097bce955c0b, user_id=3ebc95c1b3284c1d8321900cf442a811, role_id=13ff8a5ffa5648c28ec00aa75b69d913)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:21.290645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ee164-27d0-43d8-b318-bf9858d171e0 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:21.371058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 603/1232] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jun 2 19:06:21 2022] PUT /identity/v3/projects/b11b7e66a993492d8163097bce955c0b/users/3ebc95c1b3284c1d8321900cf442a811/roles/13ff8a5ffa5648c28ec00aa75b69d913 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:06:23.585646 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1d739-c46d-4749-b196-ed7d7d3b8fd7 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:23.586175 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1d739-c46d-4749-b196-ed7d7d3b8fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:23.586175 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1d739-c46d-4749-b196-ed7d7d3b8fd7 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:23.587552 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 630/1233] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:06:23.592990 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d5c48-4322-4e7e-aecb-153082642812 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:23.593416 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d5c48-4322-4e7e-aecb-153082642812 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:23.593606 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d5c48-4322-4e7e-aecb-153082642812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:23.610173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-bb5d5c48-4322-4e7e-aecb-153082642812 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:06:23.611361 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-bb5d5c48-4322-4e7e-aecb-153082642812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:06:23.678431 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 604/1234] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:06:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:06:23.702350 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1d739-c46d-4749-b196-ed7d7d3b8fd7 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:23.728490 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:23.802098 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1d739-c46d-4749-b196-ed7d7d3b8fd7 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:23.835007 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625999ef-5c16-4172-9c51-f52f82184b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:23.835837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625999ef-5c16-4172-9c51-f52f82184b54 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:23.836095 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625999ef-5c16-4172-9c51-f52f82184b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:23.836367 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625999ef-5c16-4172-9c51-f52f82184b54 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:23.846970 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625999ef-5c16-4172-9c51-f52f82184b54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:06:23.854612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-625999ef-5c16-4172-9c51-f52f82184b54 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:06:23.854612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:23.854612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:23.854612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:23.854612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:23.854612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:23.854612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:23.854612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:23.854612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:23.854612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:23.854612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:23.854612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:23.854612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:06:23.854612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:06:23.854612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:06:23.854612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:06:23.855730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:06:23.855730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:06:23.855730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:06:23.855730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:06:23.855730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:23.855730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:23.855730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:23.855730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:23.855730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:23.855730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:23.855730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:23.855730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:23.855730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:23.855730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:23.855730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:23.855730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:23.856994 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:23.856994 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:23.856994 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:23.856994 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:23.856994 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:06:23.856994 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:06:23.856994 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:06:23.856994 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:06:23.856994 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:06:23.856994 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:06:23.856994 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 19:06:23.856994 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:06:23.856994 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 631/1235] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jun 2 19:06:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:06:23.861792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d5c48-4322-4e7e-aecb-153082642812 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:23.907275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:23.959135 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d5c48-4322-4e7e-aecb-153082642812 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:23.992307 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86a928-3e9f-4fb6-a181-dd4eb8c28218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:23.992971 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86a928-3e9f-4fb6-a181-dd4eb8c28218 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:23.993259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86a928-3e9f-4fb6-a181-dd4eb8c28218 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:23.993533 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86a928-3e9f-4fb6-a181-dd4eb8c28218 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:23.994270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86a928-3e9f-4fb6-a181-dd4eb8c28218 None admin] RBAC: Adding query filter params (name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:23.994575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86a928-3e9f-4fb6-a181-dd4eb8c28218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:23.995932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86a928-3e9f-4fb6-a181-dd4eb8c28218 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:24.004824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 605/1236] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jun 2 19:06:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:24.010609 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625999ef-5c16-4172-9c51-f52f82184b54 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:24.095802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:24.110976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625999ef-5c16-4172-9c51-f52f82184b54 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:24.144468 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acab8b-38b6-471b-9aea-cef0313a2b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:24.145254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acab8b-38b6-471b-9aea-cef0313a2b57 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:24.145538 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acab8b-38b6-471b-9aea-cef0313a2b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:24.145814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acab8b-38b6-471b-9aea-cef0313a2b57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:24.155971 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08acab8b-38b6-471b-9aea-cef0313a2b57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:24.157476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08acab8b-38b6-471b-9aea-cef0313a2b57 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:24.174050 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-08acab8b-38b6-471b-9aea-cef0313a2b57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:06:24.174050 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:24.174050 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:24.174050 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:24.174050 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:24.174050 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:24.174050 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:24.174050 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:24.174050 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:24.174050 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:24.174050 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:24.174050 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:24.174050 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:06:24.174050 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:06:24.174050 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:06:24.175076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:06:24.175076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:24.175076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:24.175076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:24.175076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:24.175076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:24.175076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:24.175076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:24.175076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:24.175076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:24.175076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:24.175076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:24.175076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:24.175076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:24.175076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:24.175076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:24.175076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:24.176053 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:06:24.176053 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:06:24.176053 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:06:24.176053 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:06:24.176053 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 632/1237] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:24.181049 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86a928-3e9f-4fb6-a181-dd4eb8c28218 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:24.279182 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86a928-3e9f-4fb6-a181-dd4eb8c28218 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:24.288819 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:24.312495 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63238b76-b962-4545-a720-9e8dd23c2a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:24.313146 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63238b76-b962-4545-a720-9e8dd23c2a0a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:24.313479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63238b76-b962-4545-a720-9e8dd23c2a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:24.314243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63238b76-b962-4545-a720-9e8dd23c2a0a None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:24.315022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63238b76-b962-4545-a720-9e8dd23c2a0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:24.315325 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63238b76-b962-4545-a720-9e8dd23c2a0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:24.316712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63238b76-b962-4545-a720-9e8dd23c2a0a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:24.327404 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 606/1238] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:24.333225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acab8b-38b6-471b-9aea-cef0313a2b57 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:24.431853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acab8b-38b6-471b-9aea-cef0313a2b57 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:24.465471 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f56c94-6b5c-4de5-96d4-cda2b7ac0f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:24.466258 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f56c94-6b5c-4de5-96d4-cda2b7ac0f23 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:24.466545 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f56c94-6b5c-4de5-96d4-cda2b7ac0f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:24.466825 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f56c94-6b5c-4de5-96d4-cda2b7ac0f23 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:24.469689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:24.474517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f56c94-6b5c-4de5-96d4-cda2b7ac0f23 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:24.475955 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f56c94-6b5c-4de5-96d4-cda2b7ac0f23 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:24.490512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-e4f56c94-6b5c-4de5-96d4-cda2b7ac0f23 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 19:06:24.490512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:24.490512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:24.490512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:24.490512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:24.490512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:24.490512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:24.490512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:24.490512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:24.490512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:24.490512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:24.490512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:24.490512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:06:24.490512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:06:24.490512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:06:24.490512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:06:24.491476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:24.491476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:24.491476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:06:24.491476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:06:24.491476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:06:24.491476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:06:24.491476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:24.491476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:24.491476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:24.491476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:24.491476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:24.491476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:24.491476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:24.491476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:24.491476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:24.491476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:24.491476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:24.491476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:24.492838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:24.492838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:24.492838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:06:24.492838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:06:24.492838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:06:24.492838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:06:24.492838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:06:24.492838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:06:24.492838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 19:06:24.492838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:06:24.492838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 633/1239] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:06:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:24.497521 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63238b76-b962-4545-a720-9e8dd23c2a0a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:24.596626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63238b76-b962-4545-a720-9e8dd23c2a0a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:24.630421 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb952ce-1473-4b6e-84c1-b5252446b71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:24.631095 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb952ce-1473-4b6e-84c1-b5252446b71d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:24.631376 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb952ce-1473-4b6e-84c1-b5252446b71d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:24.631698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb952ce-1473-4b6e-84c1-b5252446b71d None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:24.632573 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb952ce-1473-4b6e-84c1-b5252446b71d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:24.632877 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb952ce-1473-4b6e-84c1-b5252446b71d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:24.634294 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb952ce-1473-4b6e-84c1-b5252446b71d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:24.651304 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 607/1240] 10.222.0.45 () {56 vars in 1143 bytes} [Thu Jun 2 19:06:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:24.657834 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f56c94-6b5c-4de5-96d4-cda2b7ac0f23 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:24.755153 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f56c94-6b5c-4de5-96d4-cda2b7ac0f23 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:24.787733 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb91256-9e93-4193-84bb-e22892f145df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:24.788404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb91256-9e93-4193-84bb-e22892f145df None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:24.788689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb91256-9e93-4193-84bb-e22892f145df None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:24.788966 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb91256-9e93-4193-84bb-e22892f145df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:24.850521 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:24.856940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb91256-9e93-4193-84bb-e22892f145df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:24.858387 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb91256-9e93-4193-84bb-e22892f145df None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:24.955137 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 634/1241] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:06:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:24.961026 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb952ce-1473-4b6e-84c1-b5252446b71d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:24.988393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:25.057626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb952ce-1473-4b6e-84c1-b5252446b71d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:25.092455 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064df2a-8274-4443-9b76-ceec241283b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:25.093255 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064df2a-8274-4443-9b76-ceec241283b0 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:25.093539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064df2a-8274-4443-9b76-ceec241283b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:25.093817 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064df2a-8274-4443-9b76-ceec241283b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:25.104754 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9064df2a-8274-4443-9b76-ceec241283b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:25.106201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9064df2a-8274-4443-9b76-ceec241283b0 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:25.123607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-9064df2a-8274-4443-9b76-ceec241283b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:06:25.123607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:25.123607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:25.123607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:25.123607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:25.123607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:25.123607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:25.123607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:25.123607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:25.123607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:25.123607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:25.123607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:25.123607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:06:25.123607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:06:25.123607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:06:25.124742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:06:25.124742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:25.124742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:25.124742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:25.124742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:25.124742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:25.124742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:25.124742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:25.124742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:25.124742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:25.124742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:25.124742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:25.124742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:25.124742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:25.124742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:25.124742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:25.124742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:25.126101 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:06:25.126101 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:06:25.126101 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:06:25.126101 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:06:25.126101 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 608/1242] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:25.130772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb91256-9e93-4193-84bb-e22892f145df None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:25.222503 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:25.228261 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb91256-9e93-4193-84bb-e22892f145df None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:25.260788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecce286-16e8-4e69-aa63-193563963f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:25.261518 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecce286-16e8-4e69-aa63-193563963f40 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:25.261798 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecce286-16e8-4e69-aa63-193563963f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:25.262071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecce286-16e8-4e69-aa63-193563963f40 None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:25.262788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecce286-16e8-4e69-aa63-193563963f40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:25.263093 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecce286-16e8-4e69-aa63-193563963f40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:25.264494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecce286-16e8-4e69-aa63-193563963f40 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:25.276190 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 635/1243] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:25.281980 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064df2a-8274-4443-9b76-ceec241283b0 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:25.358995 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:25.380577 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064df2a-8274-4443-9b76-ceec241283b0 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:25.414647 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc361da-9899-4d63-842f-29b002ae0ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:25.415436 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc361da-9899-4d63-842f-29b002ae0ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:25.415719 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc361da-9899-4d63-842f-29b002ae0ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:25.416019 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc361da-9899-4d63-842f-29b002ae0ba9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:25.422678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc361da-9899-4d63-842f-29b002ae0ba9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:25.424161 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc361da-9899-4d63-842f-29b002ae0ba9 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:25.438069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-8dc361da-9899-4d63-842f-29b002ae0ba9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:06:25.438069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:25.438069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:25.438069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:25.438069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:25.438069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:25.438069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:25.438069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:25.438069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:25.438069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:25.438069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:25.438069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:25.438069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:06:25.438069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:06:25.438069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:06:25.441572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:06:25.441572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:25.441572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:25.441572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:25.441572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:25.441572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:25.441572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:25.441572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:25.441572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:25.441572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:25.441572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:25.441572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:25.441572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:25.441572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:25.441572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:25.441572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:25.441572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:25.442606 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:06:25.442606 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:06:25.442606 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:06:25.442606 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:06:25.442606 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:06:25.442606 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:06:25.442606 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:06:25.442606 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:06:25.442606 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 609/1244] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:06:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:25.445946 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecce286-16e8-4e69-aa63-193563963f40 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:25.545104 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecce286-16e8-4e69-aa63-193563963f40 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:25.579675 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129f579-3c60-4e52-af00-4a506d238a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:25.580428 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129f579-3c60-4e52-af00-4a506d238a8d None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:25.580716 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129f579-3c60-4e52-af00-4a506d238a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:25.580984 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129f579-3c60-4e52-af00-4a506d238a8d None admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:25.581800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129f579-3c60-4e52-af00-4a506d238a8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:25.582113 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129f579-3c60-4e52-af00-4a506d238a8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:25.583682 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129f579-3c60-4e52-af00-4a506d238a8d None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:25.596171 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 636/1245] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:06:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:25.602190 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc361da-9899-4d63-842f-29b002ae0ba9 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:25.702005 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc361da-9899-4d63-842f-29b002ae0ba9 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:25.736364 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28baedee-c51c-4bf2-b94e-be607694f7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:25.737056 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28baedee-c51c-4bf2-b94e-be607694f7ce None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:25.737336 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28baedee-c51c-4bf2-b94e-be607694f7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:25.737609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28baedee-c51c-4bf2-b94e-be607694f7ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:25.738442 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28baedee-c51c-4bf2-b94e-be607694f7ce None admin] RBAC: Adding query filter params (role.id=13ff8a5ffa5648c28ec00aa75b69d913, scope.project.id=b11b7e66a993492d8163097bce955c0b, user.id=3ebc95c1b3284c1d8321900cf442a811) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:25.738733 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28baedee-c51c-4bf2-b94e-be607694f7ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:25.740169 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28baedee-c51c-4bf2-b94e-be607694f7ce None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:25.745938 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 610/1246] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:06:25 2022] GET /identity/v3/role_assignments?user.id=3ebc95c1b3284c1d8321900cf442a811&scope.project.id=b11b7e66a993492d8163097bce955c0b&role.id=13ff8a5ffa5648c28ec00aa75b69d913 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:28.044586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef505dd-aebc-42ab-a610-f42e79878e05 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:28.045182 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef505dd-aebc-42ab-a610-f42e79878e05 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:28.045182 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef505dd-aebc-42ab-a610-f42e79878e05 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:28.046505 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 637/1247] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:06:28.051818 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10b817-e809-4b67-8b1c-82d4b1310c5a None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:28.052247 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10b817-e809-4b67-8b1c-82d4b1310c5a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:28.052462 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10b817-e809-4b67-8b1c-82d4b1310c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:28.057434 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:28.069834 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-6e10b817-e809-4b67-8b1c-82d4b1310c5a None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:06:28.071081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6e10b817-e809-4b67-8b1c-82d4b1310c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:06:28.139973 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 611/1248] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:06:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:06:28.164346 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef505dd-aebc-42ab-a610-f42e79878e05 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:28.183249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:28.263063 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef505dd-aebc-42ab-a610-f42e79878e05 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:28.296690 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c62ca5-0f53-40e1-8165-19c01ccbffd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:28.297406 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c62ca5-0f53-40e1-8165-19c01ccbffd2 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:28.297690 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c62ca5-0f53-40e1-8165-19c01ccbffd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:28.297965 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c62ca5-0f53-40e1-8165-19c01ccbffd2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:28.308041 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c62ca5-0f53-40e1-8165-19c01ccbffd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:06:28.316423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-76c62ca5-0f53-40e1-8165-19c01ccbffd2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:06:28.316423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:28.316423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:28.316423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:28.316423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:28.316423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:28.316423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:28.316423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:28.316423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:28.316423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:28.316423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:28.316423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:28.316423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:06:28.316423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:06:28.316423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:06:28.316423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:06:28.322492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:06:28.322492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:06:28.322492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:06:28.322492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:06:28.322492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:28.322492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:28.322492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:28.322492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:28.322492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:28.322492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:28.322492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:28.322492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:28.322492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:28.322492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:28.322492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:28.322492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:28.323374 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:28.323374 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:28.323374 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:28.323374 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:28.323374 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:06:28.323374 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:06:28.323374 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:06:28.323374 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:06:28.323374 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:06:28.323374 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:06:28.323374 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:06:28.323374 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:06:28.323374 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 638/1249] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:06:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:28.324137 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10b817-e809-4b67-8b1c-82d4b1310c5a None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:28.424896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10b817-e809-4b67-8b1c-82d4b1310c5a None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:28.453258 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:28.458708 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a5519-423e-4f1c-8021-c08237bc6606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:28.459370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a5519-423e-4f1c-8021-c08237bc6606 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:28.459653 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a5519-423e-4f1c-8021-c08237bc6606 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:28.459925 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a5519-423e-4f1c-8021-c08237bc6606 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:28.460693 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a5519-423e-4f1c-8021-c08237bc6606 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:28.460993 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a5519-423e-4f1c-8021-c08237bc6606 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:28.462349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a5519-423e-4f1c-8021-c08237bc6606 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:28.470415 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 612/1250] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:06:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:28.476278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c62ca5-0f53-40e1-8165-19c01ccbffd2 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:28.555502 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:28.577501 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c62ca5-0f53-40e1-8165-19c01ccbffd2 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:28.610238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a3ea7-422f-4384-8dfb-bd41fb1af310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:28.611022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a3ea7-422f-4384-8dfb-bd41fb1af310 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:28.611300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a3ea7-422f-4384-8dfb-bd41fb1af310 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:28.611570 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a3ea7-422f-4384-8dfb-bd41fb1af310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:28.622865 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a3ea7-422f-4384-8dfb-bd41fb1af310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:28.624779 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a3ea7-422f-4384-8dfb-bd41fb1af310 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:28.642571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-005a3ea7-422f-4384-8dfb-bd41fb1af310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:06:28.642571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:28.642571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:28.642571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:28.642571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:28.642571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:28.642571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:28.642571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:28.642571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:28.642571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:28.642571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:28.642571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:28.642571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:06:28.642571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:06:28.642571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:06:28.643578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:06:28.643578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:28.643578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:28.643578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:28.643578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:28.643578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:28.643578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:28.643578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:28.643578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:28.643578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:28.643578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:28.643578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:28.643578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:28.643578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:28.643578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:28.643578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:28.643578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:28.644573 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:06:28.644573 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:06:28.644573 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:06:28.644573 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:06:28.644573 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 639/1251] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:28.649818 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a5519-423e-4f1c-8021-c08237bc6606 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:28.753894 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a5519-423e-4f1c-8021-c08237bc6606 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:28.786626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66eba7-27ec-454b-be98-3f6881b7bfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:28.787272 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66eba7-27ec-454b-be98-3f6881b7bfd4 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:28.787550 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66eba7-27ec-454b-be98-3f6881b7bfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:28.787821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66eba7-27ec-454b-be98-3f6881b7bfd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:28.788565 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f66eba7-27ec-454b-be98-3f6881b7bfd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:28.788865 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f66eba7-27ec-454b-be98-3f6881b7bfd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:28.790214 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f66eba7-27ec-454b-be98-3f6881b7bfd4 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:28.802375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 613/1252] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:28.808128 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a3ea7-422f-4384-8dfb-bd41fb1af310 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:28.906902 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a3ea7-422f-4384-8dfb-bd41fb1af310 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:28.932685 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:28.940823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ba58d-a908-41a7-aefa-bc195cb75d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:28.941638 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ba58d-a908-41a7-aefa-bc195cb75d0a None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:28.941920 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ba58d-a908-41a7-aefa-bc195cb75d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:28.942195 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ba58d-a908-41a7-aefa-bc195cb75d0a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:28.949512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ba58d-a908-41a7-aefa-bc195cb75d0a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:28.950950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ba58d-a908-41a7-aefa-bc195cb75d0a None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:28.965323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-de3ba58d-a908-41a7-aefa-bc195cb75d0a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 19:06:28.965323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:28.965323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:28.965323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:28.965323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:28.965323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:28.965323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:28.965323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:28.965323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:28.965323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:28.965323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:28.965323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:28.965323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:06:28.965323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:06:28.965323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:06:28.965323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:06:28.971000 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:28.971000 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:28.971000 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:06:28.971000 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:06:28.971000 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:06:28.971000 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:06:28.971000 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:28.971000 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:28.971000 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:28.971000 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:28.971000 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:28.971000 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:28.971000 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:28.971000 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:28.971000 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:28.971000 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:28.971000 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:28.971000 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:28.972217 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:28.972217 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:28.972217 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:06:28.972217 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:06:28.972217 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:06:28.972217 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:06:28.972217 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:06:28.972217 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:06:28.972217 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 19:06:28.972217 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:06:28.972217 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 640/1253] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:06:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:28.972930 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66eba7-27ec-454b-be98-3f6881b7bfd4 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:29.028015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:29.070516 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66eba7-27ec-454b-be98-3f6881b7bfd4 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:29.104497 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeddc6f-adb8-4a99-9b0f-7bad1c2cc73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:29.105171 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeddc6f-adb8-4a99-9b0f-7bad1c2cc73e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:29.105448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeddc6f-adb8-4a99-9b0f-7bad1c2cc73e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:29.105717 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeddc6f-adb8-4a99-9b0f-7bad1c2cc73e None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:29.106548 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeddc6f-adb8-4a99-9b0f-7bad1c2cc73e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:29.106853 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeddc6f-adb8-4a99-9b0f-7bad1c2cc73e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:29.108394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeddc6f-adb8-4a99-9b0f-7bad1c2cc73e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:29.126894 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 614/1254] 10.222.0.45 () {56 vars in 1143 bytes} [Thu Jun 2 19:06:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:29.133004 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ba58d-a908-41a7-aefa-bc195cb75d0a None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:29.230418 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ba58d-a908-41a7-aefa-bc195cb75d0a None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:29.262877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034b813-b497-4316-bf64-791acc6bff11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:29.263513 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034b813-b497-4316-bf64-791acc6bff11 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:29.263796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034b813-b497-4316-bf64-791acc6bff11 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:29.264099 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034b813-b497-4316-bf64-791acc6bff11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:29.317748 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:29.329469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034b813-b497-4316-bf64-791acc6bff11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:29.330952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034b813-b497-4316-bf64-791acc6bff11 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:29.424936 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 641/1255] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:06:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:29.431916 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeddc6f-adb8-4a99-9b0f-7bad1c2cc73e None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:29.529900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeddc6f-adb8-4a99-9b0f-7bad1c2cc73e None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:29.543141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:29.563164 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d82087-a34f-4f27-98e9-e2af55a6cb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:29.563969 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d82087-a34f-4f27-98e9-e2af55a6cb3e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:29.564295 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d82087-a34f-4f27-98e9-e2af55a6cb3e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:29.564568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d82087-a34f-4f27-98e9-e2af55a6cb3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:29.574174 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d82087-a34f-4f27-98e9-e2af55a6cb3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:29.575657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d82087-a34f-4f27-98e9-e2af55a6cb3e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:29.593393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-19d82087-a34f-4f27-98e9-e2af55a6cb3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:06:29.593393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:29.593393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:29.593393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:29.593393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:29.593393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:29.593393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:29.593393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:29.593393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:29.593393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:29.593393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:29.593393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:29.593393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:06:29.593393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:06:29.593393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:06:29.594448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:06:29.594448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:29.594448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:29.594448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:29.594448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:29.594448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:29.594448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:29.594448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:29.594448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:29.594448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:29.594448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:29.594448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:29.594448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:29.594448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:29.594448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:29.594448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:29.594448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:29.596357 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:06:29.596357 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:06:29.596357 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:06:29.596357 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:06:29.596357 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 615/1256] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:29.600836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034b813-b497-4316-bf64-791acc6bff11 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:29.687391 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:29.698760 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034b813-b497-4316-bf64-791acc6bff11 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:29.733126 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dcccc-2d0d-4481-9a11-7866b9f2cc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:29.733787 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dcccc-2d0d-4481-9a11-7866b9f2cc1e None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:29.734071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dcccc-2d0d-4481-9a11-7866b9f2cc1e None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:29.734347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dcccc-2d0d-4481-9a11-7866b9f2cc1e None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:29.735068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97dcccc-2d0d-4481-9a11-7866b9f2cc1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:29.735392 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97dcccc-2d0d-4481-9a11-7866b9f2cc1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:29.736796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97dcccc-2d0d-4481-9a11-7866b9f2cc1e None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:29.747821 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 642/1257] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:29.753735 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d82087-a34f-4f27-98e9-e2af55a6cb3e None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:29.853170 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d82087-a34f-4f27-98e9-e2af55a6cb3e None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:30.016329 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60397d6-e045-4f1d-935a-079ab3ce5137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:30.017694 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60397d6-e045-4f1d-935a-079ab3ce5137 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:30.017971 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60397d6-e045-4f1d-935a-079ab3ce5137 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:30.018249 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60397d6-e045-4f1d-935a-079ab3ce5137 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:30.024926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60397d6-e045-4f1d-935a-079ab3ce5137 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:30.026346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60397d6-e045-4f1d-935a-079ab3ce5137 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:30.040014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-a60397d6-e045-4f1d-935a-079ab3ce5137 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:06:30.040014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:30.040014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:30.040014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:30.040014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:30.040014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:30.040014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:30.040014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:30.040014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:30.040014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:30.040014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:30.040014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:30.040014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:06:30.040014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:06:30.040014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:06:30.041074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:06:30.041074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:30.041074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:30.041074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:30.041074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:30.041074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:30.041074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:30.041074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:30.041074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:30.041074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:30.041074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:30.041074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:30.041074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:30.041074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:30.041074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:30.041074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:30.041074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:30.042070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:06:30.042070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:06:30.042070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:06:30.042070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:06:30.042070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:06:30.042070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:06:30.042070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:06:30.042070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:06:30.042070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 616/1258] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:06:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 19:06:30.047011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dcccc-2d0d-4481-9a11-7866b9f2cc1e None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:30.150744 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dcccc-2d0d-4481-9a11-7866b9f2cc1e None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:30.184097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574eeab-94f6-4eea-afe8-6622e919eb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:30.184778 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574eeab-94f6-4eea-afe8-6622e919eb01 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:30.185058 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574eeab-94f6-4eea-afe8-6622e919eb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:30.185334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574eeab-94f6-4eea-afe8-6622e919eb01 None admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:30.186110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574eeab-94f6-4eea-afe8-6622e919eb01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:30.186416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574eeab-94f6-4eea-afe8-6622e919eb01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:30.187856 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574eeab-94f6-4eea-afe8-6622e919eb01 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:30.200278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 643/1259] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:06:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:30.206932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60397d6-e045-4f1d-935a-079ab3ce5137 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:30.232076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:30.303746 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60397d6-e045-4f1d-935a-079ab3ce5137 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:30.336754 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164eaaca-b2e5-4223-b4c8-d05a25d32259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:30.337392 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164eaaca-b2e5-4223-b4c8-d05a25d32259 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:30.337668 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164eaaca-b2e5-4223-b4c8-d05a25d32259 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:30.337937 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164eaaca-b2e5-4223-b4c8-d05a25d32259 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:30.339004 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164eaaca-b2e5-4223-b4c8-d05a25d32259 None admin] RBAC: Adding query filter params (role.id=4588ca63994f4e2d9ce482d475edbabd, scope.project.id=b11b7e66a993492d8163097bce955c0b, user.id=3ebc95c1b3284c1d8321900cf442a811) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:30.339305 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164eaaca-b2e5-4223-b4c8-d05a25d32259 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:30.340800 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164eaaca-b2e5-4223-b4c8-d05a25d32259 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:30.346077 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 617/1260] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:06:30 2022] GET /identity/v3/role_assignments?user.id=3ebc95c1b3284c1d8321900cf442a811&scope.project.id=b11b7e66a993492d8163097bce955c0b&role.id=4588ca63994f4e2d9ce482d475edbabd => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:32.554219 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fab0a-7963-4ff6-82c2-7eb04729581c None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:32.554777 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fab0a-7963-4ff6-82c2-7eb04729581c None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:32.554777 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fab0a-7963-4ff6-82c2-7eb04729581c None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:32.556140 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 644/1261] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:06:32.561286 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e7b96-a4b8-4840-8b66-806d9a9d9a75 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:32.561668 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e7b96-a4b8-4840-8b66-806d9a9d9a75 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:32.561829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e7b96-a4b8-4840-8b66-806d9a9d9a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:32.578289 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-2c6e7b96-a4b8-4840-8b66-806d9a9d9a75 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:06:32.579987 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2c6e7b96-a4b8-4840-8b66-806d9a9d9a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:06:32.646038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 618/1262] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:06:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 19:06:32.669397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fab0a-7963-4ff6-82c2-7eb04729581c None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:32.680281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:32.773734 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fab0a-7963-4ff6-82c2-7eb04729581c None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:32.807262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fca345-3100-4dd9-b801-a1ee3c158a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:32.807988 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fca345-3100-4dd9-b801-a1ee3c158a3d None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:32.808293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fca345-3100-4dd9-b801-a1ee3c158a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:32.808564 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fca345-3100-4dd9-b801-a1ee3c158a3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:32.818829 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fca345-3100-4dd9-b801-a1ee3c158a3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:06:32.826562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-b9fca345-3100-4dd9-b801-a1ee3c158a3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:06:32.826562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:32.826562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:32.826562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:32.826562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:32.826562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:32.826562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:32.826562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:32.826562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:32.826562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:32.826562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:32.826562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:32.826562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:06:32.826562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:06:32.826562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:06:32.826562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:06:32.827796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:06:32.827796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:06:32.827796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:06:32.827796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:06:32.827796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:32.827796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:32.827796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:32.827796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:32.827796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:32.827796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:32.827796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:32.827796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:32.827796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:32.827796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:32.827796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:32.827796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:32.828715 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:32.828715 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:32.828715 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:32.828715 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:32.828715 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:06:32.828715 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:06:32.828715 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:06:32.828715 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:06:32.828715 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:06:32.828715 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:06:32.828715 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:06:32.828715 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:06:32.828715 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 645/1263] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:06:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:32.834359 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e7b96-a4b8-4840-8b66-806d9a9d9a75 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:32.854858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:32.931526 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e7b96-a4b8-4840-8b66-806d9a9d9a75 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:32.966151 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85911666-b914-4146-951b-1d300583873f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:32.966801 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85911666-b914-4146-951b-1d300583873f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:32.967084 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85911666-b914-4146-951b-1d300583873f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:32.967363 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85911666-b914-4146-951b-1d300583873f None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:32.968135 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85911666-b914-4146-951b-1d300583873f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:32.968442 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85911666-b914-4146-951b-1d300583873f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:32.969858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85911666-b914-4146-951b-1d300583873f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:32.977822 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 619/1264] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:06:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:32.983721 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fca345-3100-4dd9-b801-a1ee3c158a3d None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:33.049844 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:33.083794 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fca345-3100-4dd9-b801-a1ee3c158a3d None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:33.116583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c84274-37f9-4059-80b2-a0f149278460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:33.117370 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c84274-37f9-4059-80b2-a0f149278460 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:33.117649 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c84274-37f9-4059-80b2-a0f149278460 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:33.117926 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c84274-37f9-4059-80b2-a0f149278460 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:33.128855 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c84274-37f9-4059-80b2-a0f149278460 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:33.130260 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c84274-37f9-4059-80b2-a0f149278460 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:33.147345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-18c84274-37f9-4059-80b2-a0f149278460 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:06:33.147345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:33.147345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:33.147345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:33.147345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:33.147345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:33.147345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:33.147345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:33.147345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:33.147345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:33.147345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:33.147345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:33.147345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:06:33.147345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:06:33.147345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:06:33.148381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:06:33.148381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:33.148381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:33.148381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:33.148381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:33.148381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:33.148381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:33.148381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:33.148381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:33.148381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:33.148381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:33.148381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:33.148381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:33.148381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:33.148381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:33.148381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:33.148381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:33.149285 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:06:33.149285 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:06:33.149285 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:06:33.149285 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:06:33.149285 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 646/1265] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:06:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:33.154532 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85911666-b914-4146-951b-1d300583873f None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:33.233589 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:33.253109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85911666-b914-4146-951b-1d300583873f None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:33.284941 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be5a21-6f37-4046-a46e-de11380a68b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:33.285590 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be5a21-6f37-4046-a46e-de11380a68b2 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:33.285868 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be5a21-6f37-4046-a46e-de11380a68b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:33.286138 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be5a21-6f37-4046-a46e-de11380a68b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:33.286849 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be5a21-6f37-4046-a46e-de11380a68b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:33.287147 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be5a21-6f37-4046-a46e-de11380a68b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:33.288530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be5a21-6f37-4046-a46e-de11380a68b2 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:33.299951 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 620/1266] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:33.305763 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c84274-37f9-4059-80b2-a0f149278460 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:33.404891 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c84274-37f9-4059-80b2-a0f149278460 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:33.424531 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:33.437964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c270bd6-e26b-47fc-9ece-54a004a017ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:33.439422 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c270bd6-e26b-47fc-9ece-54a004a017ee None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:33.439706 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c270bd6-e26b-47fc-9ece-54a004a017ee None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:33.439985 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c270bd6-e26b-47fc-9ece-54a004a017ee None admin] PATH_INFO: `/v3/users/placement` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:33.447315 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c270bd6-e26b-47fc-9ece-54a004a017ee None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:33.448790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c270bd6-e26b-47fc-9ece-54a004a017ee None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:33.463115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-8c270bd6-e26b-47fc-9ece-54a004a017ee None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 19:06:33.463115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:33.463115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:33.463115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:33.463115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:33.463115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:33.463115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:33.463115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:33.463115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:33.463115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:33.463115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:33.463115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:33.463115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:06:33.463115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:06:33.463115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:06:33.463115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:06:33.465915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:33.465915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:33.465915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:06:33.465915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:06:33.465915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:06:33.465915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:06:33.465915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:33.465915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:33.465915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:33.465915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:33.465915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:33.465915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:33.465915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:33.465915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:33.465915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:33.465915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:33.465915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:33.465915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:33.467106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:33.467106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:33.467106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:06:33.467106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:06:33.467106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:06:33.467106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:06:33.467106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:06:33.467106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:06:33.467106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 19:06:33.467106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:06:33.467106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 647/1267] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:06:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:33.470312 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be5a21-6f37-4046-a46e-de11380a68b2 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:33.568540 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be5a21-6f37-4046-a46e-de11380a68b2 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:33.601172 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cb551-6b54-42bd-95cd-bdc1e9db3810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:33.601822 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cb551-6b54-42bd-95cd-bdc1e9db3810 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:33.602103 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cb551-6b54-42bd-95cd-bdc1e9db3810 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:33.602373 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cb551-6b54-42bd-95cd-bdc1e9db3810 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:33.603199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4cb551-6b54-42bd-95cd-bdc1e9db3810 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:33.603503 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4cb551-6b54-42bd-95cd-bdc1e9db3810 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:33.604942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4cb551-6b54-42bd-95cd-bdc1e9db3810 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:33.614303 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:33.621986 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 621/1268] 10.222.0.45 () {56 vars in 1143 bytes} [Thu Jun 2 19:06:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:33.627778 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c270bd6-e26b-47fc-9ece-54a004a017ee None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:33.727278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c270bd6-e26b-47fc-9ece-54a004a017ee None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:33.761482 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979c475-4d0f-47f1-bf82-4fdbcd3d14d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:33.762264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979c475-4d0f-47f1-bf82-4fdbcd3d14d5 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:33.762545 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979c475-4d0f-47f1-bf82-4fdbcd3d14d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:33.762821 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979c475-4d0f-47f1-bf82-4fdbcd3d14d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:33.774159 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979c475-4d0f-47f1-bf82-4fdbcd3d14d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:33.775614 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979c475-4d0f-47f1-bf82-4fdbcd3d14d5 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:33.792997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-2979c475-4d0f-47f1-bf82-4fdbcd3d14d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:06:33.792997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:33.792997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:33.792997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:33.792997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:33.792997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:33.792997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:33.792997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:33.792997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:33.792997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:33.792997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:33.792997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:33.792997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:06:33.792997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:06:33.792997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:06:33.793943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:06:33.793943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:33.793943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:33.793943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:33.793943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:33.793943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:33.793943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:33.793943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:33.793943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:33.793943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:33.793943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:33.793943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:33.793943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:33.793943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:33.793943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:33.793943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:33.793943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:33.795229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:06:33.795229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:06:33.795229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:06:33.795229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:06:33.795229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 648/1269] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:33.800521 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cb551-6b54-42bd-95cd-bdc1e9db3810 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:33.896766 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cb551-6b54-42bd-95cd-bdc1e9db3810 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:33.930373 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59831d4e-0cd3-4ff0-842e-88f5a67d904a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:33.931017 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59831d4e-0cd3-4ff0-842e-88f5a67d904a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:33.931296 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59831d4e-0cd3-4ff0-842e-88f5a67d904a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:33.931569 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59831d4e-0cd3-4ff0-842e-88f5a67d904a None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:33.932317 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59831d4e-0cd3-4ff0-842e-88f5a67d904a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:33.932615 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59831d4e-0cd3-4ff0-842e-88f5a67d904a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:33.933965 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59831d4e-0cd3-4ff0-842e-88f5a67d904a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:33.945002 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 622/1270] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:33.950662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979c475-4d0f-47f1-bf82-4fdbcd3d14d5 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:33.983206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:34.050707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979c475-4d0f-47f1-bf82-4fdbcd3d14d5 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:34.082836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f12f0-c055-4c6a-a9bc-9ff771b7c5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:34.083636 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f12f0-c055-4c6a-a9bc-9ff771b7c5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:34.083918 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f12f0-c055-4c6a-a9bc-9ff771b7c5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:34.084213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f12f0-c055-4c6a-a9bc-9ff771b7c5e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:34.092241 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f12f0-c055-4c6a-a9bc-9ff771b7c5e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:34.093689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f12f0-c055-4c6a-a9bc-9ff771b7c5e3 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:34.107596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-f71f12f0-c055-4c6a-a9bc-9ff771b7c5e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:06:34.107596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:34.107596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:34.107596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:34.107596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:34.107596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:34.107596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:34.107596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:34.107596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:34.107596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:34.107596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:34.107596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:34.107596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:06:34.107596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:06:34.107596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:06:34.108555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:06:34.108555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:34.108555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:34.108555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:34.108555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:34.108555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:34.108555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:34.108555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:34.108555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:34.108555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:34.108555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:34.108555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:34.108555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:34.108555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:34.108555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:34.108555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:34.108555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:34.109644 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:06:34.109644 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:06:34.109644 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:06:34.109644 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:06:34.109644 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:06:34.109644 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:06:34.109644 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:06:34.109644 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:06:34.109644 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 649/1271] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:06:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:34.115195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59831d4e-0cd3-4ff0-842e-88f5a67d904a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:34.174055 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:34.215918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59831d4e-0cd3-4ff0-842e-88f5a67d904a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:34.248239 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf626e1-e500-4f22-bf70-79e3736c603f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:34.248831 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf626e1-e500-4f22-bf70-79e3736c603f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:34.249111 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf626e1-e500-4f22-bf70-79e3736c603f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:34.249384 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf626e1-e500-4f22-bf70-79e3736c603f None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:34.250166 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf626e1-e500-4f22-bf70-79e3736c603f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:34.250472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf626e1-e500-4f22-bf70-79e3736c603f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:34.252498 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf626e1-e500-4f22-bf70-79e3736c603f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:34.264068 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 623/1272] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:06:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:34.270162 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f12f0-c055-4c6a-a9bc-9ff771b7c5e3 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:34.361248 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:34.369849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f12f0-c055-4c6a-a9bc-9ff771b7c5e3 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:34.403046 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027b8fa-03ae-4fc4-b94a-51aebaccebcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:34.403969 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027b8fa-03ae-4fc4-b94a-51aebaccebcc None admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:34.404410 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027b8fa-03ae-4fc4-b94a-51aebaccebcc None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:34.404690 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027b8fa-03ae-4fc4-b94a-51aebaccebcc None admin] PATH_INFO: `/v3/projects/b11b7e66a993492d8163097bce955c0b/users/3ebc95c1b3284c1d8321900cf442a811/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:34.406672 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d027b8fa-03ae-4fc4-b94a-51aebaccebcc None admin] RBAC: Authorizing `identity:create_grant(project_id=b11b7e66a993492d8163097bce955c0b, user_id=3ebc95c1b3284c1d8321900cf442a811, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:34.408181 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d027b8fa-03ae-4fc4-b94a-51aebaccebcc None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:34.566880 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 650/1273] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jun 2 19:06:34 2022] PUT /identity/v3/projects/b11b7e66a993492d8163097bce955c0b/users/3ebc95c1b3284c1d8321900cf442a811/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:06:36.802303 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ae409-d654-4475-846e-2be6e8ff8cee None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:36.802825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ae409-d654-4475-846e-2be6e8ff8cee None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:36.802941 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ae409-d654-4475-846e-2be6e8ff8cee None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:36.804316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 624/1274] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:06:36.809640 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e318f12-51bf-43be-aae1-f1b24236a11d None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:36.810040 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e318f12-51bf-43be-aae1-f1b24236a11d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:36.810190 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e318f12-51bf-43be-aae1-f1b24236a11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:36.826670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-5e318f12-51bf-43be-aae1-f1b24236a11d None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:06:36.827835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5e318f12-51bf-43be-aae1-f1b24236a11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:06:36.895522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 651/1275] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:06:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:06:36.918975 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ae409-d654-4475-846e-2be6e8ff8cee None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:37.020196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ae409-d654-4475-846e-2be6e8ff8cee None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:37.036598 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:37.053089 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5469b32-c481-443c-a385-af48204394fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:37.053805 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5469b32-c481-443c-a385-af48204394fc None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:37.054084 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5469b32-c481-443c-a385-af48204394fc None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:37.054357 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5469b32-c481-443c-a385-af48204394fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:37.064637 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5469b32-c481-443c-a385-af48204394fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 19:06:37.072119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-c5469b32-c481-443c-a385-af48204394fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:06:37.072119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:37.072119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:37.072119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:37.072119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:37.072119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:37.072119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:37.072119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:37.072119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:37.072119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:37.072119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:37.072119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:37.072119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 19:06:37.072119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 19:06:37.072119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 19:06:37.072119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 19:06:37.073270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 19:06:37.073270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 19:06:37.073270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 19:06:37.073270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 19:06:37.073270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:37.073270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:37.073270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:37.073270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:37.073270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:37.073270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:37.073270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:37.073270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:37.073270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:37.073270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:37.073270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:37.073270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:37.074232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:37.074232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:37.074232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:37.074232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:37.074232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 19:06:37.074232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 19:06:37.074232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 19:06:37.074232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 19:06:37.074232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 19:06:37.074232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 19:06:37.074232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 19:06:37.074232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:06:37.074232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 625/1276] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jun 2 19:06:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:37.079604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e318f12-51bf-43be-aae1-f1b24236a11d None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:37.161076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:37.179149 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e318f12-51bf-43be-aae1-f1b24236a11d None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:37.213090 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d62fa-1176-4d33-94d9-02acf27b18f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:37.214021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d62fa-1176-4d33-94d9-02acf27b18f0 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:37.214300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d62fa-1176-4d33-94d9-02acf27b18f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:37.214572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d62fa-1176-4d33-94d9-02acf27b18f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:37.215312 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d62fa-1176-4d33-94d9-02acf27b18f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:37.215615 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d62fa-1176-4d33-94d9-02acf27b18f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:37.217021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d62fa-1176-4d33-94d9-02acf27b18f0 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:37.225319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 652/1277] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jun 2 19:06:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:37.231312 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5469b32-c481-443c-a385-af48204394fc None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:37.328430 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5469b32-c481-443c-a385-af48204394fc None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:37.366206 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dbd67c-0e1c-49d2-aa32-831178ddbb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:37.366994 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbd67c-0e1c-49d2-aa32-831178ddbb42 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:37.367271 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbd67c-0e1c-49d2-aa32-831178ddbb42 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:37.367535 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbd67c-0e1c-49d2-aa32-831178ddbb42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:37.378688 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dbd67c-0e1c-49d2-aa32-831178ddbb42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:37.380136 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dbd67c-0e1c-49d2-aa32-831178ddbb42 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:37.396780 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-c0dbd67c-0e1c-49d2-aa32-831178ddbb42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:06:37.396780 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:37.396780 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:37.396780 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:37.396780 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:37.396780 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:37.396780 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:37.396780 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:37.396780 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:37.396780 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:37.396780 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:37.396780 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:37.396780 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:06:37.396780 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:06:37.396780 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:06:37.397884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:06:37.397884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:37.397884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:37.397884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:37.397884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:37.397884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:37.397884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:37.397884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:37.397884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:37.397884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:37.397884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:37.397884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:37.397884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:37.397884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:37.397884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:37.397884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:37.397884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:37.399145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:06:37.399145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:06:37.399145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:06:37.399145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:06:37.399145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 626/1278] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:37.403935 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d62fa-1176-4d33-94d9-02acf27b18f0 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:37.503019 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d62fa-1176-4d33-94d9-02acf27b18f0 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:37.536203 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481737ca-d8b4-45d6-8de1-f9588b079390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:37.536865 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481737ca-d8b4-45d6-8de1-f9588b079390 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:37.537148 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481737ca-d8b4-45d6-8de1-f9588b079390 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:37.537423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481737ca-d8b4-45d6-8de1-f9588b079390 None admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:37.538140 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481737ca-d8b4-45d6-8de1-f9588b079390 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:37.538447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481737ca-d8b4-45d6-8de1-f9588b079390 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:37.539814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481737ca-d8b4-45d6-8de1-f9588b079390 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:37.553362 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 653/1279] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:37.559376 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dbd67c-0e1c-49d2-aa32-831178ddbb42 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:37.590638 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:37.658191 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dbd67c-0e1c-49d2-aa32-831178ddbb42 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:37.690620 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96798a68-de07-4af3-bf6e-3f1390024c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:37.691406 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96798a68-de07-4af3-bf6e-3f1390024c07 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:37.691684 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96798a68-de07-4af3-bf6e-3f1390024c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:37.691954 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96798a68-de07-4af3-bf6e-3f1390024c07 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:37.699221 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96798a68-de07-4af3-bf6e-3f1390024c07 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:37.700684 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96798a68-de07-4af3-bf6e-3f1390024c07 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:37.715621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-96798a68-de07-4af3-bf6e-3f1390024c07 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 19:06:37.715621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:37.715621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:37.715621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:37.715621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:37.715621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:37.715621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:37.715621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:37.715621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:37.715621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:37.715621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:37.715621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:37.715621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 19:06:37.715621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 19:06:37.715621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 19:06:37.715621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 19:06:37.717778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:37.717778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:37.717778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 19:06:37.717778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:06:37.717778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 19:06:37.717778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 19:06:37.717778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:37.717778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:37.717778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:37.717778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:37.717778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:37.717778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:37.717778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:37.717778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:37.717778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:37.717778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:37.717778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:37.717778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:37.718747 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:37.718747 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:37.718747 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 19:06:37.718747 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 19:06:37.718747 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 19:06:37.718747 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 19:06:37.718747 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 19:06:37.718747 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 19:06:37.718747 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 19:06:37.718747 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:06:37.718747 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 627/1280] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:06:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:37.723451 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481737ca-d8b4-45d6-8de1-f9588b079390 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:37.727231 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:37.823371 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481737ca-d8b4-45d6-8de1-f9588b079390 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:37.857473 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0200a-de91-449f-96ed-19132891ea1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:37.858065 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0200a-de91-449f-96ed-19132891ea1f None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:37.858342 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0200a-de91-449f-96ed-19132891ea1f None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:37.858613 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0200a-de91-449f-96ed-19132891ea1f None admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:37.859432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0200a-de91-449f-96ed-19132891ea1f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:37.859731 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0200a-de91-449f-96ed-19132891ea1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:37.861267 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0200a-de91-449f-96ed-19132891ea1f None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:37.877870 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 654/1281] 10.222.0.45 () {56 vars in 1143 bytes} [Thu Jun 2 19:06:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:37.883583 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96798a68-de07-4af3-bf6e-3f1390024c07 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:37.974953 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:37.984437 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96798a68-de07-4af3-bf6e-3f1390024c07 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:38.017649 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727352e-57f8-477f-97f3-c2c4410f373d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:38.018287 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727352e-57f8-477f-97f3-c2c4410f373d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:38.018564 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727352e-57f8-477f-97f3-c2c4410f373d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:38.018836 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727352e-57f8-477f-97f3-c2c4410f373d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:38.087595 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727352e-57f8-477f-97f3-c2c4410f373d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:38.089335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727352e-57f8-477f-97f3-c2c4410f373d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:38.176609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:38.186272 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 628/1282] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jun 2 19:06:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 19:06:38.192685 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0200a-de91-449f-96ed-19132891ea1f None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:38.254266 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:38.290983 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0200a-de91-449f-96ed-19132891ea1f None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:38.323378 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bc124-389d-4977-9baa-95df6258a4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:38.325118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bc124-389d-4977-9baa-95df6258a4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:38.325118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bc124-389d-4977-9baa-95df6258a4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:38.325118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bc124-389d-4977-9baa-95df6258a4d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:38.334966 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bc124-389d-4977-9baa-95df6258a4d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:38.336454 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bc124-389d-4977-9baa-95df6258a4d2 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:38.353810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-095bc124-389d-4977-9baa-95df6258a4d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:06:38.353810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:38.353810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:38.353810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:38.353810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:38.353810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:38.353810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:38.353810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:38.353810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:38.353810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:38.353810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:38.353810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:38.353810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 19:06:38.353810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 19:06:38.353810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 19:06:38.359097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 19:06:38.359097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:38.359097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:38.359097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:38.359097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:38.359097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:38.359097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:38.359097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:38.359097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:38.359097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:38.359097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:38.359097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:38.359097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:38.359097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:38.359097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:38.359097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:38.359097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:38.360146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 19:06:38.360146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 19:06:38.360146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 19:06:38.360146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:06:38.360146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 655/1283] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:38.360820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727352e-57f8-477f-97f3-c2c4410f373d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:38.457202 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727352e-57f8-477f-97f3-c2c4410f373d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:38.490331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03391044-61a2-4714-9b75-6d9d3699b486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:38.490986 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03391044-61a2-4714-9b75-6d9d3699b486 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:38.491267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03391044-61a2-4714-9b75-6d9d3699b486 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:38.491538 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03391044-61a2-4714-9b75-6d9d3699b486 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:38.492287 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03391044-61a2-4714-9b75-6d9d3699b486 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:38.492591 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03391044-61a2-4714-9b75-6d9d3699b486 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:38.493950 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03391044-61a2-4714-9b75-6d9d3699b486 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:38.505546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 629/1284] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jun 2 19:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:06:38.511134 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bc124-389d-4977-9baa-95df6258a4d2 None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:38.609486 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bc124-389d-4977-9baa-95df6258a4d2 None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:38.624662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:38.645491 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bf0e2-b805-4308-816a-74145d647abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:38.646279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bf0e2-b805-4308-816a-74145d647abc None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:38.646561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bf0e2-b805-4308-816a-74145d647abc None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:38.646836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bf0e2-b805-4308-816a-74145d647abc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:38.653393 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20bf0e2-b805-4308-816a-74145d647abc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:38.654827 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20bf0e2-b805-4308-816a-74145d647abc None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:38.668817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application [None req-c20bf0e2-b805-4308-816a-74145d647abc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:06:38.668817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:38.668817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:38.668817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:38.668817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:38.668817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:38.668817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:38.668817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:38.668817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:38.668817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:38.668817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:38.668817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:38.668817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 19:06:38.668817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 19:06:38.668817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 19:06:38.669884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 19:06:38.669884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:38.669884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:38.669884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:38.669884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:38.669884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:38.669884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:38.669884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:38.669884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:38.669884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:38.669884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:38.669884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:38.669884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:38.669884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:38.669884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:38.669884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:38.669884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:38.671195 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:06:38.671195 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:06:38.671195 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:06:38.671195 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:06:38.671195 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:06:38.671195 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:06:38.671195 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 19:06:38.671195 dv-cinder-797608-28-smb devstack@keystone.service[80608]: ERROR keystone.server.flask.application Jun 02 19:06:38.671195 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 656/1285] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jun 2 19:06:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:38.676460 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03391044-61a2-4714-9b75-6d9d3699b486 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:38.731303 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:38.779020 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03391044-61a2-4714-9b75-6d9d3699b486 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:38.811215 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d8f2a-997d-4acb-ae92-82e564a3b060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:38.815010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d8f2a-997d-4acb-ae92-82e564a3b060 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:38.815010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d8f2a-997d-4acb-ae92-82e564a3b060 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:38.815010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d8f2a-997d-4acb-ae92-82e564a3b060 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:38.815010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d8f2a-997d-4acb-ae92-82e564a3b060 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:38.815010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d8f2a-997d-4acb-ae92-82e564a3b060 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:38.815639 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d8f2a-997d-4acb-ae92-82e564a3b060 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:38.827771 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 630/1286] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jun 2 19:06:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:38.833830 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bf0e2-b805-4308-816a-74145d647abc None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:38.933095 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bf0e2-b805-4308-816a-74145d647abc None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:38.966387 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5209b3c-861e-4514-a027-1a1cc1fe7263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:38.967042 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5209b3c-861e-4514-a027-1a1cc1fe7263 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:38.967325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5209b3c-861e-4514-a027-1a1cc1fe7263 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:38.967604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5209b3c-861e-4514-a027-1a1cc1fe7263 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:38.968464 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5209b3c-861e-4514-a027-1a1cc1fe7263 None admin] RBAC: Adding query filter params (role.id=4588ca63994f4e2d9ce482d475edbabd, scope.project.id=b11b7e66a993492d8163097bce955c0b, user.id=3ebc95c1b3284c1d8321900cf442a811) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:38.968780 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5209b3c-861e-4514-a027-1a1cc1fe7263 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:38.970718 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5209b3c-861e-4514-a027-1a1cc1fe7263 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:38.976618 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 657/1287] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jun 2 19:06:38 2022] GET /identity/v3/role_assignments?user.id=3ebc95c1b3284c1d8321900cf442a811&scope.project.id=b11b7e66a993492d8163097bce955c0b&role.id=4588ca63994f4e2d9ce482d475edbabd => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:41.223187 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e695e2c-1987-4b84-8536-f79a9e34a9a7 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:41.223744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e695e2c-1987-4b84-8536-f79a9e34a9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:41.223744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e695e2c-1987-4b84-8536-f79a9e34a9a7 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:41.225135 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 631/1288] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:06:41.230698 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e519be6-fa46-4f48-8c68-e8b7ec353179 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:41.231109 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e519be6-fa46-4f48-8c68-e8b7ec353179 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:41.231246 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e519be6-fa46-4f48-8c68-e8b7ec353179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:41.248591 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-9e519be6-fa46-4f48-8c68-e8b7ec353179 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:06:41.249753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-9e519be6-fa46-4f48-8c68-e8b7ec353179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:06:41.279659 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:41.314740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 658/1289] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:06:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:06:41.337482 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e695e2c-1987-4b84-8536-f79a9e34a9a7 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:41.435327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e695e2c-1987-4b84-8536-f79a9e34a9a7 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:41.446178 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:41.469365 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d53d2-c696-43d6-a69b-d5743560e754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:41.470172 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d53d2-c696-43d6-a69b-d5743560e754 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:41.470498 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d53d2-c696-43d6-a69b-d5743560e754 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:41.470874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d53d2-c696-43d6-a69b-d5743560e754 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:41.471502 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d53d2-c696-43d6-a69b-d5743560e754 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:41.472893 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d53d2-c696-43d6-a69b-d5743560e754 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:41.484568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-900d53d2-c696-43d6-a69b-d5743560e754 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 19:06:41.484568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:41.484568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 19:06:41.484568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 19:06:41.484568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 19:06:41.484568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 19:06:41.484568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 19:06:41.484568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:06:41.484568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 19:06:41.484568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:06:41.484568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:06:41.484568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:06:41.484568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:41.484568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:41.484568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:41.484568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:41.484568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:41.486375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:41.486375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:41.486375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:41.486375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:41.486375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:41.486375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:41.486375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 19:06:41.486375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 19:06:41.486375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 19:06:41.486375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 19:06:41.486375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:41.486375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:41.486375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:41.486375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:41.486375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:41.486375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:41.487292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:41.487292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:41.487292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:41.487292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:41.487292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:41.487292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:41.487292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:41.487292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:41.487292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:41.487292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:41.487292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 19:06:41.487292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:06:41.487292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 19:06:41.487292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:06:41.487292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 632/1290] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Jun 2 19:06:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:41.492486 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e519be6-fa46-4f48-8c68-e8b7ec353179 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:41.588836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e519be6-fa46-4f48-8c68-e8b7ec353179 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:41.621670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9c8e6-6317-4014-975a-9ba467ed12f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:41.622322 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9c8e6-6317-4014-975a-9ba467ed12f1 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:41.622604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9c8e6-6317-4014-975a-9ba467ed12f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:41.622888 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9c8e6-6317-4014-975a-9ba467ed12f1 None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:41.623579 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9c8e6-6317-4014-975a-9ba467ed12f1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:41.623879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9c8e6-6317-4014-975a-9ba467ed12f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:41.625269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9c8e6-6317-4014-975a-9ba467ed12f1 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:41.630729 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 659/1291] 10.222.0.45 () {56 vars in 1116 bytes} [Thu Jun 2 19:06:41 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:41.636614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d53d2-c696-43d6-a69b-d5743560e754 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:41.735838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d53d2-c696-43d6-a69b-d5743560e754 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:41.768741 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d2224-792f-4439-9bd1-3f5615a61ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:41.769390 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d2224-792f-4439-9bd1-3f5615a61ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:41.769668 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d2224-792f-4439-9bd1-3f5615a61ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:41.769939 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d2224-792f-4439-9bd1-3f5615a61ac8 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:41.770663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d2224-792f-4439-9bd1-3f5615a61ac8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:41.770968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d2224-792f-4439-9bd1-3f5615a61ac8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:41.772368 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d2224-792f-4439-9bd1-3f5615a61ac8 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:41.776744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 633/1292] 10.222.0.45 () {56 vars in 1116 bytes} [Thu Jun 2 19:06:41 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:44.031668 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bed018-cbb7-4c37-a228-12e6232a0bfe None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:44.032833 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bed018-cbb7-4c37-a228-12e6232a0bfe None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:44.032833 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bed018-cbb7-4c37-a228-12e6232a0bfe None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:44.034140 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 660/1293] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:06:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:06:44.039432 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc3715-6b5e-45c5-97e8-bee667995071 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:44.039806 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc3715-6b5e-45c5-97e8-bee667995071 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:44.039987 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc3715-6b5e-45c5-97e8-bee667995071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:44.057189 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-3cfc3715-6b5e-45c5-97e8-bee667995071 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:06:44.058329 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3cfc3715-6b5e-45c5-97e8-bee667995071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:06:44.089541 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:44.126837 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 634/1294] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:06:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:06:44.150692 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bed018-cbb7-4c37-a228-12e6232a0bfe None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:44.180808 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:44.252650 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bed018-cbb7-4c37-a228-12e6232a0bfe None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:44.285961 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c82007-f3f9-4296-bb99-a12dd67e9571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:44.296476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c82007-f3f9-4296-bb99-a12dd67e9571 None admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:44.296476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c82007-f3f9-4296-bb99-a12dd67e9571 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:44.296476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c82007-f3f9-4296-bb99-a12dd67e9571 None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:44.296476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c82007-f3f9-4296-bb99-a12dd67e9571 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:44.296476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c82007-f3f9-4296-bb99-a12dd67e9571 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:44.388734 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 661/1295] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jun 2 19:06:44 2022] POST /identity/v3/services => generated 246 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:06:46.675209 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e1668-72f9-4c50-8014-4395baf11b83 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:46.675749 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e1668-72f9-4c50-8014-4395baf11b83 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:46.675749 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e1668-72f9-4c50-8014-4395baf11b83 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:46.677181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 635/1296] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:06:46.682410 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab293da9-c1aa-4632-8801-b71ecaab16eb None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:46.682792 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab293da9-c1aa-4632-8801-b71ecaab16eb None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:46.682955 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab293da9-c1aa-4632-8801-b71ecaab16eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:46.699581 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-ab293da9-c1aa-4632-8801-b71ecaab16eb None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:06:46.705564 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-ab293da9-c1aa-4632-8801-b71ecaab16eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:06:46.771667 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 662/1297] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:06:46 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:06:46.795395 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e1668-72f9-4c50-8014-4395baf11b83 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:46.893078 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e1668-72f9-4c50-8014-4395baf11b83 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:46.925900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6bdad-a4a0-448c-8557-d8fa49301fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:46.926619 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6bdad-a4a0-448c-8557-d8fa49301fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:46.926901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6bdad-a4a0-448c-8557-d8fa49301fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:46.927171 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6bdad-a4a0-448c-8557-d8fa49301fc1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:46.927807 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6bdad-a4a0-448c-8557-d8fa49301fc1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:46.929188 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6bdad-a4a0-448c-8557-d8fa49301fc1 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:46.940901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-93e6bdad-a4a0-448c-8557-d8fa49301fc1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 19:06:46.940901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:46.940901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 19:06:46.940901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 19:06:46.940901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 19:06:46.940901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 19:06:46.940901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 19:06:46.940901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:06:46.940901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 19:06:46.940901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:06:46.940901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:06:46.940901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:06:46.940901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:46.940901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:46.940901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:46.940901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:46.940901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:46.941974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:46.941974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:46.941974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:46.941974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:46.941974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:46.941974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:46.941974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 19:06:46.941974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 19:06:46.941974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 19:06:46.941974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 19:06:46.941974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:46.941974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:46.941974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:46.941974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:46.941974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:46.941974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:46.942864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:46.942864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:46.942864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:46.942864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:46.942864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:46.942864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:46.942864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:46.942864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:46.942864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:46.942864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:46.942864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 19:06:46.942864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:06:46.942864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 19:06:46.942864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:06:46.942864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 636/1298] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Jun 2 19:06:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:46.948482 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab293da9-c1aa-4632-8801-b71ecaab16eb None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:46.967343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:47.051494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab293da9-c1aa-4632-8801-b71ecaab16eb None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:47.084012 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e57ce5-5422-4be5-bc27-ba72b8c1a95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:47.084693 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e57ce5-5422-4be5-bc27-ba72b8c1a95c None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:47.084975 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e57ce5-5422-4be5-bc27-ba72b8c1a95c None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:47.085248 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e57ce5-5422-4be5-bc27-ba72b8c1a95c None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:47.085959 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e57ce5-5422-4be5-bc27-ba72b8c1a95c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:47.086263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e57ce5-5422-4be5-bc27-ba72b8c1a95c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:47.087651 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e57ce5-5422-4be5-bc27-ba72b8c1a95c None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:47.093365 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 663/1299] 10.222.0.45 () {56 vars in 1116 bytes} [Thu Jun 2 19:06:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:47.100058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6bdad-a4a0-448c-8557-d8fa49301fc1 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:47.131206 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:47.197841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6bdad-a4a0-448c-8557-d8fa49301fc1 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:47.231499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb43f30-ee92-4168-a843-3654a484d567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:47.232195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb43f30-ee92-4168-a843-3654a484d567 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:47.232516 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb43f30-ee92-4168-a843-3654a484d567 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:47.232798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb43f30-ee92-4168-a843-3654a484d567 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:47.233584 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb43f30-ee92-4168-a843-3654a484d567 None admin] RBAC: Adding query filter params (interface=public, service_id=2dabd9a8d6d346c29d9ce69c19668722, region_id=RegionOne) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:47.233899 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb43f30-ee92-4168-a843-3654a484d567 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:47.235267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb43f30-ee92-4168-a843-3654a484d567 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:47.240311 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 637/1300] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Jun 2 19:06:47 2022] GET /identity/v3/endpoints?service_id=2dabd9a8d6d346c29d9ce69c19668722&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:47.245994 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e57ce5-5422-4be5-bc27-ba72b8c1a95c None admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:47.326772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:47.345635 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e57ce5-5422-4be5-bc27-ba72b8c1a95c None admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:47.381408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab3d02-6a24-4be7-91c2-2d1965f40378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:47.382065 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab3d02-6a24-4be7-91c2-2d1965f40378 None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:47.382347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab3d02-6a24-4be7-91c2-2d1965f40378 None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:47.382626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab3d02-6a24-4be7-91c2-2d1965f40378 None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:47.383337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab3d02-6a24-4be7-91c2-2d1965f40378 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:47.384773 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab3d02-6a24-4be7-91c2-2d1965f40378 None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:47.392131 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 664/1301] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Jun 2 19:06:47 2022] GET /identity/v3/services => generated 2191 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:06:49.620090 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d48a0-721a-4a21-bf54-c3a727e189d7 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:49.620637 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d48a0-721a-4a21-bf54-c3a727e189d7 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:49.620637 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d48a0-721a-4a21-bf54-c3a727e189d7 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:49.622028 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 638/1302] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:06:49.627792 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5442e0c-cf89-41ab-bb95-32232ff9a9d2 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:49.628253 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5442e0c-cf89-41ab-bb95-32232ff9a9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:49.628376 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5442e0c-cf89-41ab-bb95-32232ff9a9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:49.644935 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-e5442e0c-cf89-41ab-bb95-32232ff9a9d2 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:06:49.646092 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-e5442e0c-cf89-41ab-bb95-32232ff9a9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:06:49.712789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 665/1303] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:06:49 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 19:06:49.736529 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d48a0-721a-4a21-bf54-c3a727e189d7 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:49.834614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:49.849255 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d48a0-721a-4a21-bf54-c3a727e189d7 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:49.873450 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec0edd-9ce8-48d2-9102-78cee85ed987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:49.874166 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec0edd-9ce8-48d2-9102-78cee85ed987 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:49.874442 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec0edd-9ce8-48d2-9102-78cee85ed987 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:49.874708 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec0edd-9ce8-48d2-9102-78cee85ed987 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:49.875349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec0edd-9ce8-48d2-9102-78cee85ed987 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:49.877292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec0edd-9ce8-48d2-9102-78cee85ed987 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:49.888725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-bcec0edd-9ce8-48d2-9102-78cee85ed987 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 19:06:49.888725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:49.888725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 19:06:49.888725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 19:06:49.888725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 19:06:49.888725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 19:06:49.888725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 19:06:49.888725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:06:49.888725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 19:06:49.888725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:06:49.888725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 19:06:49.888725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:06:49.888725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:06:49.888725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:06:49.888725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:06:49.888725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:06:49.888725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:06:49.890251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:06:49.890251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:06:49.890251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:06:49.890251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:06:49.890251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:06:49.890251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:06:49.890251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 19:06:49.890251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 19:06:49.890251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 19:06:49.890251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 19:06:49.890251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:06:49.890251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:06:49.890251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:06:49.890251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:06:49.890251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:06:49.890251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:06:49.891268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:06:49.891268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 02 19:06:49.891268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:06:49.891268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:06:49.891268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:06:49.891268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:06:49.891268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:06:49.891268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:06:49.891268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:06:49.891268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:06:49.891268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 19:06:49.891268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 19:06:49.891268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 19:06:49.891268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 02 19:06:49.891268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 639/1304] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Jun 2 19:06:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 19:06:49.896217 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5442e0c-cf89-41ab-bb95-32232ff9a9d2 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:49.970336 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:49.992824 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5442e0c-cf89-41ab-bb95-32232ff9a9d2 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:50.025157 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3334195a-ee3b-44f1-ad44-1b52a11aaadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:50.025814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334195a-ee3b-44f1-ad44-1b52a11aaadd None admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:50.026102 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334195a-ee3b-44f1-ad44-1b52a11aaadd None admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:50.026395 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334195a-ee3b-44f1-ad44-1b52a11aaadd None admin] PATH_INFO: `/v3/services` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:50.027083 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3334195a-ee3b-44f1-ad44-1b52a11aaadd None admin] RBAC: Adding query filter params (name=placement) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:06:50.027447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3334195a-ee3b-44f1-ad44-1b52a11aaadd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:50.028874 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3334195a-ee3b-44f1-ad44-1b52a11aaadd None admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:50.033951 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 666/1305] 10.222.0.45 () {56 vars in 1116 bytes} [Thu Jun 2 19:06:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:06:50.039658 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec0edd-9ce8-48d2-9102-78cee85ed987 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:50.137756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec0edd-9ce8-48d2-9102-78cee85ed987 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:50.171450 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016c481-d7df-4678-9c98-6ad885527cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:50.172139 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016c481-d7df-4678-9c98-6ad885527cb5 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:50.172424 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016c481-d7df-4678-9c98-6ad885527cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:50.173288 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016c481-d7df-4678-9c98-6ad885527cb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:50.174031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016c481-d7df-4678-9c98-6ad885527cb5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:50.175385 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016c481-d7df-4678-9c98-6ad885527cb5 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:50.256613 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 640/1306] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Jun 2 19:06:50 2022] POST /identity/v3/endpoints => generated 331 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:07:00.062762 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=30 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:07:00.251981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:13:58.080076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5cd52-18aa-4b1d-8edb-aeb634c512da None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:13:58.080076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5cd52-18aa-4b1d-8edb-aeb634c512da None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:13:58.080736 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5cd52-18aa-4b1d-8edb-aeb634c512da None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:13:58.082386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 667/1307] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:13:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:13:58.087416 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad87b5-5fe0-413a-8524-0fa116de2fb2 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:13:58.088033 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad87b5-5fe0-413a-8524-0fa116de2fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:13:58.088033 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad87b5-5fe0-413a-8524-0fa116de2fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:13:58.183924 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-06ad87b5-5fe0-413a-8524-0fa116de2fb2 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:13:58.185386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-06ad87b5-5fe0-413a-8524-0fa116de2fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:13:58.332416 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 641/1308] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:13:58.371758 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abebbe8-c27d-4b4f-af5f-3604adccd930 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:13:58.372141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abebbe8-c27d-4b4f-af5f-3604adccd930 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:13:58.372624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abebbe8-c27d-4b4f-af5f-3604adccd930 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:13:58.374455 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 668/1309] 10.222.0.45 () {54 vars in 964 bytes} [Thu Jun 2 19:13:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:13:58.381526 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821fe90-e5e6-436c-8c65-1ba537a26608 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:13:58.382148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821fe90-e5e6-436c-8c65-1ba537a26608 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:13:58.382653 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821fe90-e5e6-436c-8c65-1ba537a26608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:13:58.511606 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-6821fe90-e5e6-436c-8c65-1ba537a26608 None None] MFA Rules not processed for user `2efd679ca9314c8591cabbca15f8c61b`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:13:58.512992 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6821fe90-e5e6-436c-8c65-1ba537a26608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:13:58.571246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:13:58.708541 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 642/1310] 10.222.0.45 () {58 vars in 1061 bytes} [Thu Jun 2 19:13:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:13:58.721135 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abebbe8-c27d-4b4f-af5f-3604adccd930 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:13:58.723224 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-6abebbe8-c27d-4b4f-af5f-3604adccd930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:13:58.890109 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abebbe8-c27d-4b4f-af5f-3604adccd930 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:13:58.978676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04eacd6-0751-46a6-96a8-b0095b73c238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:13:58.979467 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04eacd6-0751-46a6-96a8-b0095b73c238 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:13:58.979956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04eacd6-0751-46a6-96a8-b0095b73c238 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:13:58.980339 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04eacd6-0751-46a6-96a8-b0095b73c238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:13:58.982236 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c04eacd6-0751-46a6-96a8-b0095b73c238 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:13:59.045300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:13:59.113016 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04eacd6-0751-46a6-96a8-b0095b73c238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:13:59.115408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04eacd6-0751-46a6-96a8-b0095b73c238 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:13:59.145394 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 669/1311] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:13:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:14:01.818212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67341156-00cb-4b1d-a257-13a76f510901 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:01.818726 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67341156-00cb-4b1d-a257-13a76f510901 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:01.818832 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67341156-00cb-4b1d-a257-13a76f510901 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:01.820854 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 643/1312] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:14:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:14:01.825840 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a43ec-3a2a-49d1-9e07-3573e63c63c8 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:01.826546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a43ec-3a2a-49d1-9e07-3573e63c63c8 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:01.826546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a43ec-3a2a-49d1-9e07-3573e63c63c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:01.928200 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-773a43ec-3a2a-49d1-9e07-3573e63c63c8 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:14:01.929584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-773a43ec-3a2a-49d1-9e07-3573e63c63c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:02.067273 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 670/1313] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:14:02.115376 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67341156-00cb-4b1d-a257-13a76f510901 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:14:02.117266 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-67341156-00cb-4b1d-a257-13a76f510901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:02.237425 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67341156-00cb-4b1d-a257-13a76f510901 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:14:02.322839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:14:02.325407 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c94482-a8f2-4660-9411-de03c62d6aa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:14:02.326007 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c94482-a8f2-4660-9411-de03c62d6aa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:02.326285 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c94482-a8f2-4660-9411-de03c62d6aa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:02.326561 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c94482-a8f2-4660-9411-de03c62d6aa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:02.328332 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-93c94482-a8f2-4660-9411-de03c62d6aa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:02.451717 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c94482-a8f2-4660-9411-de03c62d6aa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:14:02.453736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c94482-a8f2-4660-9411-de03c62d6aa7 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:14:02.476539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 644/1314] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:14:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:14:05.223826 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee527c-cb73-4265-8c51-2956b54e6c0f None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:05.224410 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee527c-cb73-4265-8c51-2956b54e6c0f None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:05.224521 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee527c-cb73-4265-8c51-2956b54e6c0f None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:05.225879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 671/1315] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:14:05.231263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a44c6-3d03-4251-acad-a4b684fb3e81 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:05.231674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a44c6-3d03-4251-acad-a4b684fb3e81 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:05.231801 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a44c6-3d03-4251-acad-a4b684fb3e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:05.295670 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-8a9a44c6-3d03-4251-acad-a4b684fb3e81 None None] MFA Rules not processed for user `072cdde6467a48fa9636648d08d9c3b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:14:05.297486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8a9a44c6-3d03-4251-acad-a4b684fb3e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:05.351106 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:14:05.398167 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 645/1316] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:14:05 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:14:05.437574 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee527c-cb73-4265-8c51-2956b54e6c0f None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:14:05.439117 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-3bee527c-cb73-4265-8c51-2956b54e6c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:05.448824 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:14:05.543376 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee527c-cb73-4265-8c51-2956b54e6c0f None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:14:05.617122 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c71862-58e2-43ff-aeba-1231bb32fa49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:14:05.617774 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c71862-58e2-43ff-aeba-1231bb32fa49 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:05.618055 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c71862-58e2-43ff-aeba-1231bb32fa49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:05.618327 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c71862-58e2-43ff-aeba-1231bb32fa49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:05.619980 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-f6c71862-58e2-43ff-aeba-1231bb32fa49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:05.686892 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:14:05.734962 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c71862-58e2-43ff-aeba-1231bb32fa49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:14:05.736450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c71862-58e2-43ff-aeba-1231bb32fa49 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:14:05.755425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 672/1317] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:14:05 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:14:08.834793 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa9434-2005-4fd8-9c67-7cfc50d7047a None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:08.835314 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa9434-2005-4fd8-9c67-7cfc50d7047a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:08.835314 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa9434-2005-4fd8-9c67-7cfc50d7047a None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:08.836736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 646/1318] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:14:08.842071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3483828-34d9-465a-b86a-fb2c221ee155 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:08.842492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3483828-34d9-465a-b86a-fb2c221ee155 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:08.842626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3483828-34d9-465a-b86a-fb2c221ee155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:08.907173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-a3483828-34d9-465a-b86a-fb2c221ee155 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:14:08.908450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-a3483828-34d9-465a-b86a-fb2c221ee155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:09.006046 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 673/1319] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:14:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:14:09.044194 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa9434-2005-4fd8-9c67-7cfc50d7047a None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:14:09.045722 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2afa9434-2005-4fd8-9c67-7cfc50d7047a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:09.150770 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa9434-2005-4fd8-9c67-7cfc50d7047a None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:14:09.224162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cde31-184a-4efa-93ab-1b23859f9750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:14:09.224808 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cde31-184a-4efa-93ab-1b23859f9750 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:09.225087 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cde31-184a-4efa-93ab-1b23859f9750 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:09.225390 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cde31-184a-4efa-93ab-1b23859f9750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:09.226989 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8b6cde31-184a-4efa-93ab-1b23859f9750 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:09.235006 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:14:09.337751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cde31-184a-4efa-93ab-1b23859f9750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:14:09.339191 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cde31-184a-4efa-93ab-1b23859f9750 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:14:09.357881 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 647/1320] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:14:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:14:12.703874 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a4e39-67ea-4c1f-8168-7c9ffe40e408 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:12.704424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a4e39-67ea-4c1f-8168-7c9ffe40e408 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:12.704518 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a4e39-67ea-4c1f-8168-7c9ffe40e408 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:12.705866 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 674/1321] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:14:12.711747 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3666af5-32c1-4b5e-918c-fd9160a63033 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:12.712190 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3666af5-32c1-4b5e-918c-fd9160a63033 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:12.712477 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3666af5-32c1-4b5e-918c-fd9160a63033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:12.779104 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-c3666af5-32c1-4b5e-918c-fd9160a63033 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:14:12.780415 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c3666af5-32c1-4b5e-918c-fd9160a63033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:12.839949 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:14:12.879844 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 648/1322] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:14:12.916664 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a4e39-67ea-4c1f-8168-7c9ffe40e408 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:14:12.918144 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-471a4e39-67ea-4c1f-8168-7c9ffe40e408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:12.937491 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:14:13.023974 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a4e39-67ea-4c1f-8168-7c9ffe40e408 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:14:13.106434 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a4a87-2f73-4097-aaa0-ced79e316039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:14:13.107082 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a4a87-2f73-4097-aaa0-ced79e316039 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:13.107363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a4a87-2f73-4097-aaa0-ced79e316039 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:13.107633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a4a87-2f73-4097-aaa0-ced79e316039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:13.109871 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-077a4a87-2f73-4097-aaa0-ced79e316039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:13.182358 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:14:13.222278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a4a87-2f73-4097-aaa0-ced79e316039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:14:13.223735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a4a87-2f73-4097-aaa0-ced79e316039 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:14:13.243218 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 675/1323] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:14:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:14:15.598573 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b0e67-60a2-432c-bb1e-33d817a4f924 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:15.599133 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b0e67-60a2-432c-bb1e-33d817a4f924 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:15.599133 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b0e67-60a2-432c-bb1e-33d817a4f924 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:15.600705 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 649/1324] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:14:15.606630 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede8bcf-2834-46ee-a639-451bf461221d None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:15.607173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede8bcf-2834-46ee-a639-451bf461221d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:15.607173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede8bcf-2834-46ee-a639-451bf461221d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:15.679431 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-4ede8bcf-2834-46ee-a639-451bf461221d None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:14:15.680679 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-4ede8bcf-2834-46ee-a639-451bf461221d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:15.781340 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 676/1325] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:14:15.817237 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b0e67-60a2-432c-bb1e-33d817a4f924 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:14:15.818776 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7b0b0e67-60a2-432c-bb1e-33d817a4f924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:15.925104 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b0e67-60a2-432c-bb1e-33d817a4f924 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:14:16.002100 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccfcbb-deab-40f1-9bf1-ee4aca1d554b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:14:16.002757 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccfcbb-deab-40f1-9bf1-ee4aca1d554b service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:16.003030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccfcbb-deab-40f1-9bf1-ee4aca1d554b service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:16.003306 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccfcbb-deab-40f1-9bf1-ee4aca1d554b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:16.004983 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d9ccfcbb-deab-40f1-9bf1-ee4aca1d554b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:16.021611 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:14:16.121474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccfcbb-deab-40f1-9bf1-ee4aca1d554b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:14:16.122957 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccfcbb-deab-40f1-9bf1-ee4aca1d554b service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:14:16.142313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 650/1326] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:14:18.516813 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e010fe-69f2-4274-afb8-d159744ddc03 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:18.517415 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e010fe-69f2-4274-afb8-d159744ddc03 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:18.517415 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e010fe-69f2-4274-afb8-d159744ddc03 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:18.518741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 677/1327] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:14:18.524419 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc211d6b-8c24-430c-aa40-d67dccbb4750 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:18.524916 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc211d6b-8c24-430c-aa40-d67dccbb4750 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:18.525004 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc211d6b-8c24-430c-aa40-d67dccbb4750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:18.593498 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-dc211d6b-8c24-430c-aa40-d67dccbb4750 None None] MFA Rules not processed for user `072cdde6467a48fa9636648d08d9c3b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:14:18.594712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-dc211d6b-8c24-430c-aa40-d67dccbb4750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:18.662541 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:14:18.696146 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 651/1328] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:14:18 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:14:18.750191 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b026e-59dd-43dc-bad2-af6b1ad360e4 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:18.750629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b026e-59dd-43dc-bad2-af6b1ad360e4 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:18.750931 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b026e-59dd-43dc-bad2-af6b1ad360e4 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:18.752405 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 678/1329] 10.222.0.45 () {54 vars in 964 bytes} [Thu Jun 2 19:14:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:14:18.759317 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705e3ee-c37c-4c4f-a134-d7cda21af025 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:18.759639 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705e3ee-c37c-4c4f-a134-d7cda21af025 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:18.759914 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705e3ee-c37c-4c4f-a134-d7cda21af025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:18.842680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-b705e3ee-c37c-4c4f-a134-d7cda21af025 None None] MFA Rules not processed for user `2efd679ca9314c8591cabbca15f8c61b`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:14:18.844432 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b705e3ee-c37c-4c4f-a134-d7cda21af025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:18.930998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 652/1330] 10.222.0.45 () {58 vars in 1061 bytes} [Thu Jun 2 19:14:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:14:18.940440 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b026e-59dd-43dc-bad2-af6b1ad360e4 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:14:18.942012 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-4c7b026e-59dd-43dc-bad2-af6b1ad360e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:18.978581 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:14:19.060089 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b026e-59dd-43dc-bad2-af6b1ad360e4 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:14:19.139535 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3877f-aa1a-439a-9e2a-5f2b2fbbd345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:14:19.140803 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3877f-aa1a-439a-9e2a-5f2b2fbbd345 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:19.141080 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3877f-aa1a-439a-9e2a-5f2b2fbbd345 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:19.141348 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3877f-aa1a-439a-9e2a-5f2b2fbbd345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:19.142986 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-98a3877f-aa1a-439a-9e2a-5f2b2fbbd345 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:19.223081 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:14:19.256256 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3877f-aa1a-439a-9e2a-5f2b2fbbd345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:14:19.257704 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3877f-aa1a-439a-9e2a-5f2b2fbbd345 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:14:19.276218 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 679/1331] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:14:18 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:14:22.409999 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a43bb4-c8da-4d21-8872-c92083785319 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:22.410541 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a43bb4-c8da-4d21-8872-c92083785319 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:22.410640 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a43bb4-c8da-4d21-8872-c92083785319 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:22.412381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 653/1332] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:14:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:14:22.418852 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c7432-d5e8-43a3-b448-9840c3d6ef72 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:22.419383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c7432-d5e8-43a3-b448-9840c3d6ef72 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:22.419515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c7432-d5e8-43a3-b448-9840c3d6ef72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:22.493706 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-0f9c7432-d5e8-43a3-b448-9840c3d6ef72 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:14:22.494671 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-0f9c7432-d5e8-43a3-b448-9840c3d6ef72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:22.605575 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 680/1333] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:14:22.642617 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a43bb4-c8da-4d21-8872-c92083785319 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:14:22.644188 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f7a43bb4-c8da-4d21-8872-c92083785319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:22.725880 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:14:22.760639 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a43bb4-c8da-4d21-8872-c92083785319 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:14:22.843785 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1de15b-a14c-4a57-8799-1a7c832edf87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:14:22.844474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1de15b-a14c-4a57-8799-1a7c832edf87 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:22.844760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1de15b-a14c-4a57-8799-1a7c832edf87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:22.845040 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1de15b-a14c-4a57-8799-1a7c832edf87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:22.846720 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0a1de15b-a14c-4a57-8799-1a7c832edf87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:22.965799 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1de15b-a14c-4a57-8799-1a7c832edf87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:14:22.967242 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1de15b-a14c-4a57-8799-1a7c832edf87 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:14:22.979632 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:14:22.988451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 654/1334] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:14:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:14:25.319180 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804d563-0a28-4b26-9eca-8d55e9b1f7e6 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:25.319726 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804d563-0a28-4b26-9eca-8d55e9b1f7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:25.319726 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804d563-0a28-4b26-9eca-8d55e9b1f7e6 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:25.321182 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 681/1335] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:14:25.326478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c692e-6530-4309-8049-f7ac65573bd4 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:25.326926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c692e-6530-4309-8049-f7ac65573bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:25.327024 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c692e-6530-4309-8049-f7ac65573bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:25.392208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-915c692e-6530-4309-8049-f7ac65573bd4 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:14:25.393427 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-915c692e-6530-4309-8049-f7ac65573bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:25.490923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 655/1336] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:14:25.529696 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804d563-0a28-4b26-9eca-8d55e9b1f7e6 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:14:25.531785 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-f804d563-0a28-4b26-9eca-8d55e9b1f7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:25.572586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:14:25.637041 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804d563-0a28-4b26-9eca-8d55e9b1f7e6 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:14:25.715279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799c72b-0ab9-455f-9d07-1876bae78897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:14:25.715932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799c72b-0ab9-455f-9d07-1876bae78897 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:25.716238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799c72b-0ab9-455f-9d07-1876bae78897 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:25.716508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799c72b-0ab9-455f-9d07-1876bae78897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:25.718914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c799c72b-0ab9-455f-9d07-1876bae78897 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:25.803983 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:14:25.831144 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799c72b-0ab9-455f-9d07-1876bae78897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:14:25.832891 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799c72b-0ab9-455f-9d07-1876bae78897 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:14:25.851335 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 682/1337] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:14:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:14:28.844735 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e81ebd-99d9-4217-9d86-b8eab2d03634 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:28.845296 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e81ebd-99d9-4217-9d86-b8eab2d03634 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:28.845296 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e81ebd-99d9-4217-9d86-b8eab2d03634 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:28.846695 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 656/1338] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:14:28.852172 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa7cc7-ce88-4377-8e48-ceadaf8c66e6 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:28.852650 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa7cc7-ce88-4377-8e48-ceadaf8c66e6 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:28.852748 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa7cc7-ce88-4377-8e48-ceadaf8c66e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:28.923044 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-c1aa7cc7-ce88-4377-8e48-ceadaf8c66e6 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:14:28.924388 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c1aa7cc7-ce88-4377-8e48-ceadaf8c66e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:29.032910 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 683/1339] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:14:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:14:29.068918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e81ebd-99d9-4217-9d86-b8eab2d03634 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:14:29.071154 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-91e81ebd-99d9-4217-9d86-b8eab2d03634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:29.161724 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:14:29.176932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e81ebd-99d9-4217-9d86-b8eab2d03634 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:14:29.180454 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8f1a0-020e-49d0-ac6b-f550529ca097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:14:29.181103 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8f1a0-020e-49d0-ac6b-f550529ca097 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:29.181408 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8f1a0-020e-49d0-ac6b-f550529ca097 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:29.181649 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8f1a0-020e-49d0-ac6b-f550529ca097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:29.190547 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8f1a0-020e-49d0-ac6b-f550529ca097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:14:29.191967 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8f1a0-020e-49d0-ac6b-f550529ca097 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:14:29.201326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 657/1340] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:14:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:14:33.846308 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406d62e-145c-45f0-92ae-41be51dfb8bd None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:33.847085 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406d62e-145c-45f0-92ae-41be51dfb8bd None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:33.847402 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406d62e-145c-45f0-92ae-41be51dfb8bd None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:33.849075 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 684/1341] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:14:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:14:33.855262 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfef22-43d9-4747-bfd0-4ae9c46d6767 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:33.859048 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfef22-43d9-4747-bfd0-4ae9c46d6767 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:33.859048 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfef22-43d9-4747-bfd0-4ae9c46d6767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:33.886600 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-e1cfef22-43d9-4747-bfd0-4ae9c46d6767 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:14:33.887793 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e1cfef22-43d9-4747-bfd0-4ae9c46d6767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:33.991295 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 658/1342] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:14:34.031360 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406d62e-145c-45f0-92ae-41be51dfb8bd None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:14:34.042041 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406d62e-145c-45f0-92ae-41be51dfb8bd None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:14:34.046187 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c6142-4e03-48f6-8bbd-b7da3ff7bba0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:14:34.046825 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c6142-4e03-48f6-8bbd-b7da3ff7bba0 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:34.047158 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c6142-4e03-48f6-8bbd-b7da3ff7bba0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:34.047383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c6142-4e03-48f6-8bbd-b7da3ff7bba0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:34.056897 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c6142-4e03-48f6-8bbd-b7da3ff7bba0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:14:34.058317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c6142-4e03-48f6-8bbd-b7da3ff7bba0 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:14:34.068597 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 685/1343] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:14:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:14:37.391076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34e740-3b24-4da4-988c-c11a29106919 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:37.391639 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34e740-3b24-4da4-988c-c11a29106919 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:37.391639 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34e740-3b24-4da4-988c-c11a29106919 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:37.393029 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 659/1344] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:14:37.398572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37f638-c658-46fe-8abb-28e99924a614 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:37.398988 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37f638-c658-46fe-8abb-28e99924a614 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:37.399120 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37f638-c658-46fe-8abb-28e99924a614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:37.417735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-3c37f638-c658-46fe-8abb-28e99924a614 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:14:37.419021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-3c37f638-c658-46fe-8abb-28e99924a614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:37.427503 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 686/1345] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:14:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:14:37.465464 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34e740-3b24-4da4-988c-c11a29106919 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:14:37.477050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34e740-3b24-4da4-988c-c11a29106919 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:14:37.480805 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e67be-ec4d-4c1c-8b31-94f7c9ff7f9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:14:37.481442 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e67be-ec4d-4c1c-8b31-94f7c9ff7f9d service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:37.481727 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e67be-ec4d-4c1c-8b31-94f7c9ff7f9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:37.482006 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e67be-ec4d-4c1c-8b31-94f7c9ff7f9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:37.492488 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e67be-ec4d-4c1c-8b31-94f7c9ff7f9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:14:37.493773 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e67be-ec4d-4c1c-8b31-94f7c9ff7f9d service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:14:37.504124 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 660/1346] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:14:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:14:41.944734 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b07f9-163a-4649-a118-935bb65c780d None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:41.945310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b07f9-163a-4649-a118-935bb65c780d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:41.945310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b07f9-163a-4649-a118-935bb65c780d None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:41.946682 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 687/1347] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:14:41.952482 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748814b-61c5-43e0-a7b8-7bcece438524 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:41.953033 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748814b-61c5-43e0-a7b8-7bcece438524 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:41.953033 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748814b-61c5-43e0-a7b8-7bcece438524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:41.971614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-6748814b-61c5-43e0-a7b8-7bcece438524 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:14:41.972836 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6748814b-61c5-43e0-a7b8-7bcece438524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:41.980675 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 661/1348] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:14:42.018457 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b07f9-163a-4649-a118-935bb65c780d None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:14:42.020243 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-cd1b07f9-163a-4649-a118-935bb65c780d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:42.033789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b07f9-163a-4649-a118-935bb65c780d None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:14:42.037371 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28da8e-7457-4c0d-a4ff-143f898da8d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:14:42.038014 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28da8e-7457-4c0d-a4ff-143f898da8d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:42.038299 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28da8e-7457-4c0d-a4ff-143f898da8d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:42.038580 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28da8e-7457-4c0d-a4ff-143f898da8d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:42.048541 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c28da8e-7457-4c0d-a4ff-143f898da8d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:14:42.049990 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c28da8e-7457-4c0d-a4ff-143f898da8d0 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:14:42.059687 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 688/1349] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:14:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:14:47.544650 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73616db7-6170-4fa6-85aa-4fcaef9f75d1 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:47.545129 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73616db7-6170-4fa6-85aa-4fcaef9f75d1 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:47.545129 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73616db7-6170-4fa6-85aa-4fcaef9f75d1 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:47.547022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 662/1350] 10.222.0.45 () {54 vars in 921 bytes} [Thu Jun 2 19:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:14:47.552820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c0cc1-4950-47d4-854e-3f6a537fbf5d None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:47.553228 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c0cc1-4950-47d4-854e-3f6a537fbf5d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:47.553369 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c0cc1-4950-47d4-854e-3f6a537fbf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:47.569197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:14:47.633680 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-af3c0cc1-4950-47d4-854e-3f6a537fbf5d None None] MFA Rules not processed for user `3ebc95c1b3284c1d8321900cf442a811`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:14:47.635796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-af3c0cc1-4950-47d4-854e-3f6a537fbf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:47.733538 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 689/1351] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jun 2 19:14:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:14:51.965678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=57 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:14:52.255766 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99a7b4-9a97-493e-89b9-70ab1411b3ec None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:52.255944 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99a7b4-9a97-493e-89b9-70ab1411b3ec None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:52.256371 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99a7b4-9a97-493e-89b9-70ab1411b3ec None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:52.257688 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 663/1352] 10.222.0.45 () {54 vars in 921 bytes} [Thu Jun 2 19:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:14:52.263365 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b8d06-aa57-45b5-a7f5-027fd58babf8 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:52.263986 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b8d06-aa57-45b5-a7f5-027fd58babf8 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:52.263986 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b8d06-aa57-45b5-a7f5-027fd58babf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:52.287477 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-922b8d06-aa57-45b5-a7f5-027fd58babf8 None None] MFA Rules not processed for user `3ebc95c1b3284c1d8321900cf442a811`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:14:52.288741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-922b8d06-aa57-45b5-a7f5-027fd58babf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:52.298677 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 690/1353] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jun 2 19:14:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:14:53.628490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5e991-3738-45bd-b31c-e22c9bca805d None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:53.629026 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5e991-3738-45bd-b31c-e22c9bca805d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:53.629026 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5e991-3738-45bd-b31c-e22c9bca805d None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:53.630515 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 664/1354] 10.222.0.45 () {54 vars in 921 bytes} [Thu Jun 2 19:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:14:53.635608 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83629bf2-04f8-442e-b151-cc56c1cdc124 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:53.636081 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83629bf2-04f8-442e-b151-cc56c1cdc124 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:53.636200 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83629bf2-04f8-442e-b151-cc56c1cdc124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:53.654660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-83629bf2-04f8-442e-b151-cc56c1cdc124 None None] MFA Rules not processed for user `3ebc95c1b3284c1d8321900cf442a811`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:14:53.655336 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-83629bf2-04f8-442e-b151-cc56c1cdc124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:53.663837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 691/1355] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jun 2 19:14:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:14:57.661763 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be1e63-174a-4de0-a2ab-a602424df798 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:57.662319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be1e63-174a-4de0-a2ab-a602424df798 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:57.662525 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be1e63-174a-4de0-a2ab-a602424df798 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:57.664062 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 665/1356] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:14:57.669309 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ef67c-9adb-4dbf-a8fb-90c4230954a5 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:57.669733 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ef67c-9adb-4dbf-a8fb-90c4230954a5 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:57.669870 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ef67c-9adb-4dbf-a8fb-90c4230954a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:57.688800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-4d6ef67c-9adb-4dbf-a8fb-90c4230954a5 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:14:57.690004 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-4d6ef67c-9adb-4dbf-a8fb-90c4230954a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:57.697971 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 692/1357] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:14:57.756246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146e311-b0e9-473b-9e2c-aa408f949415 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:57.757506 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146e311-b0e9-473b-9e2c-aa408f949415 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:57.758011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146e311-b0e9-473b-9e2c-aa408f949415 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:57.759587 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 666/1358] 10.222.0.45 () {54 vars in 961 bytes} [Thu Jun 2 19:14:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:14:57.769354 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062820f-8eb1-420a-be6e-24f80cc7de10 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:57.769948 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062820f-8eb1-420a-be6e-24f80cc7de10 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:57.770488 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062820f-8eb1-420a-be6e-24f80cc7de10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:57.830608 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-3062820f-8eb1-420a-be6e-24f80cc7de10 None None] MFA Rules not processed for user `575f61ef70314f86b5d9dad3ba1b3aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:14:57.832222 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-3062820f-8eb1-420a-be6e-24f80cc7de10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:14:57.902372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:14:57.936585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 693/1359] 10.222.0.45 () {58 vars in 1058 bytes} [Thu Jun 2 19:14:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:14:57.937766 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146e311-b0e9-473b-9e2c-aa408f949415 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:14:57.962155 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146e311-b0e9-473b-9e2c-aa408f949415 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:14:57.974614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c689d-ab1f-4ecd-a33c-71945abb935f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:14:57.975533 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c689d-ab1f-4ecd-a33c-71945abb935f service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:14:57.975894 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c689d-ab1f-4ecd-a33c-71945abb935f service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:14:57.976531 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c689d-ab1f-4ecd-a33c-71945abb935f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:14:57.986748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c689d-ab1f-4ecd-a33c-71945abb935f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:14:57.990151 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c689d-ab1f-4ecd-a33c-71945abb935f service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:14:58.002708 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 667/1360] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:14:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:15:00.502882 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3d22f-3ed5-4d0c-8796-0dabaa652cd0 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:00.502882 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3d22f-3ed5-4d0c-8796-0dabaa652cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:00.503374 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3d22f-3ed5-4d0c-8796-0dabaa652cd0 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:00.504590 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 694/1361] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:15:00.510619 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ba255-48f0-470b-9395-6360ec9ffb48 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:00.511172 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ba255-48f0-470b-9395-6360ec9ffb48 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:00.511172 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ba255-48f0-470b-9395-6360ec9ffb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:00.530994 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f84ba255-48f0-470b-9395-6360ec9ffb48 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:00.532217 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f84ba255-48f0-470b-9395-6360ec9ffb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:00.540379 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 668/1362] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:15:00.585785 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3d22f-3ed5-4d0c-8796-0dabaa652cd0 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:15:00.601164 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3d22f-3ed5-4d0c-8796-0dabaa652cd0 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:15:00.606843 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac66bb5-27c5-4d43-b85e-3326b883e154 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:15:00.608232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac66bb5-27c5-4d43-b85e-3326b883e154 service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:00.608593 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac66bb5-27c5-4d43-b85e-3326b883e154 service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:00.608937 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac66bb5-27c5-4d43-b85e-3326b883e154 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:00.617940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac66bb5-27c5-4d43-b85e-3326b883e154 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:15:00.619635 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac66bb5-27c5-4d43-b85e-3326b883e154 service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:15:00.630301 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 695/1363] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:15:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:15:03.414553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514662e-b399-414e-82a9-25d9c99d9f35 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:03.415131 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514662e-b399-414e-82a9-25d9c99d9f35 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:03.415131 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514662e-b399-414e-82a9-25d9c99d9f35 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:03.416541 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 669/1364] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:15:03.421868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645db057-6ea4-47a7-baf9-7d0676aa673c None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:03.422475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645db057-6ea4-47a7-baf9-7d0676aa673c None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:03.422475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645db057-6ea4-47a7-baf9-7d0676aa673c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:03.440765 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-645db057-6ea4-47a7-baf9-7d0676aa673c None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:03.441498 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-645db057-6ea4-47a7-baf9-7d0676aa673c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:03.449559 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 696/1365] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:15:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:15:03.496706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac88f8-3805-4eb4-b482-668bfce78058 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:03.496996 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac88f8-3805-4eb4-b482-668bfce78058 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:03.497301 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac88f8-3805-4eb4-b482-668bfce78058 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:03.499190 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 670/1366] 10.222.0.45 () {54 vars in 961 bytes} [Thu Jun 2 19:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:15:03.504686 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ecfed-7662-4c5b-b78c-fe9313a1af51 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:03.505000 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ecfed-7662-4c5b-b78c-fe9313a1af51 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:03.505312 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ecfed-7662-4c5b-b78c-fe9313a1af51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:03.524386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-193ecfed-7662-4c5b-b78c-fe9313a1af51 None None] MFA Rules not processed for user `575f61ef70314f86b5d9dad3ba1b3aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:03.525597 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-193ecfed-7662-4c5b-b78c-fe9313a1af51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:03.540424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 697/1367] 10.222.0.45 () {58 vars in 1058 bytes} [Thu Jun 2 19:15:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:15:03.548409 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac88f8-3805-4eb4-b482-668bfce78058 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:15:03.564082 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac88f8-3805-4eb4-b482-668bfce78058 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:15:03.569519 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1343b5e-9c85-4042-a452-1eb06f5b88a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:15:03.570206 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1343b5e-9c85-4042-a452-1eb06f5b88a1 service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:03.570455 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1343b5e-9c85-4042-a452-1eb06f5b88a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:03.570730 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1343b5e-9c85-4042-a452-1eb06f5b88a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:03.580147 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1343b5e-9c85-4042-a452-1eb06f5b88a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:15:03.582020 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1343b5e-9c85-4042-a452-1eb06f5b88a1 service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:15:03.591955 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 671/1368] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:15:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:15:06.088825 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626a72d-35f7-45a5-821b-a363d5dfb885 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:06.089599 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626a72d-35f7-45a5-821b-a363d5dfb885 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:06.089599 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626a72d-35f7-45a5-821b-a363d5dfb885 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:06.090773 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 698/1369] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:15:06.096921 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12bd34-bf4c-432d-80e5-4422e37a0dea None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:06.097466 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12bd34-bf4c-432d-80e5-4422e37a0dea None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:06.097466 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12bd34-bf4c-432d-80e5-4422e37a0dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:06.100530 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddf271-24e8-45d1-9314-a8b9dec1a308 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:06.100818 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddf271-24e8-45d1-9314-a8b9dec1a308 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:06.101095 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddf271-24e8-45d1-9314-a8b9dec1a308 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:06.102655 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 699/1370] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:15:06.109133 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f5cc4-d7aa-456f-a295-0fd4c3ba8ebd None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:06.109471 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f5cc4-d7aa-456f-a295-0fd4c3ba8ebd None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:06.109689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f5cc4-d7aa-456f-a295-0fd4c3ba8ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:06.116880 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-dd12bd34-bf4c-432d-80e5-4422e37a0dea None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:06.118121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-dd12bd34-bf4c-432d-80e5-4422e37a0dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:06.127022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 672/1371] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:15:06.133102 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-200f5cc4-d7aa-456f-a295-0fd4c3ba8ebd None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:06.134473 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-200f5cc4-d7aa-456f-a295-0fd4c3ba8ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:06.142906 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 700/1372] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:15:06.192827 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12bd34-bf4c-432d-80e5-4422e37a0dea None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:15:06.208112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12bd34-bf4c-432d-80e5-4422e37a0dea None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:15:06.215622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed9fb0-5dc4-4514-8f45-4b00e80b77c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:15:06.216324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed9fb0-5dc4-4514-8f45-4b00e80b77c5 service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:06.216823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed9fb0-5dc4-4514-8f45-4b00e80b77c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:06.217014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed9fb0-5dc4-4514-8f45-4b00e80b77c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:06.226558 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed9fb0-5dc4-4514-8f45-4b00e80b77c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:15:06.228278 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed9fb0-5dc4-4514-8f45-4b00e80b77c5 service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:15:06.251054 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 673/1373] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:15:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:15:06.454925 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f25233-1f19-49f8-ace9-96a123c9fb34 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:06.454925 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f25233-1f19-49f8-ace9-96a123c9fb34 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:06.454925 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f25233-1f19-49f8-ace9-96a123c9fb34 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:06.457775 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 701/1374] 10.222.0.45 () {54 vars in 963 bytes} [Thu Jun 2 19:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:15:06.464142 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb84814-0caa-4689-8733-3cb0d9d3d0b2 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:06.464595 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb84814-0caa-4689-8733-3cb0d9d3d0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:06.464991 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb84814-0caa-4689-8733-3cb0d9d3d0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:06.532199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-8cb84814-0caa-4689-8733-3cb0d9d3d0b2 None None] MFA Rules not processed for user `abb1dec309904b009271f36cd9157511`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:06.533532 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8cb84814-0caa-4689-8733-3cb0d9d3d0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:06.608178 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 674/1375] 10.222.0.45 () {58 vars in 1060 bytes} [Thu Jun 2 19:15:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:15:06.615865 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f25233-1f19-49f8-ace9-96a123c9fb34 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:15:06.628749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f25233-1f19-49f8-ace9-96a123c9fb34 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:15:06.635276 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb895c-3467-475a-9bd3-c41fb2e05ac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:15:06.637262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb895c-3467-475a-9bd3-c41fb2e05ac5 service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:06.637689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb895c-3467-475a-9bd3-c41fb2e05ac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:06.638283 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb895c-3467-475a-9bd3-c41fb2e05ac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:06.649216 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb895c-3467-475a-9bd3-c41fb2e05ac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:15:06.651128 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb895c-3467-475a-9bd3-c41fb2e05ac5 service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:15:06.664327 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 702/1376] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:15:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:15:08.750926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7943a-926d-4f9a-9f49-02dad7f41afb None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:08.751460 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7943a-926d-4f9a-9f49-02dad7f41afb None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:08.751460 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7943a-926d-4f9a-9f49-02dad7f41afb None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:08.752883 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 675/1377] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:15:08.759163 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a162f-8cc2-4408-a9b2-e3ca17664542 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:08.759861 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a162f-8cc2-4408-a9b2-e3ca17664542 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:08.759861 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a162f-8cc2-4408-a9b2-e3ca17664542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:08.779316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-a24a162f-8cc2-4408-a9b2-e3ca17664542 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:08.780490 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-a24a162f-8cc2-4408-a9b2-e3ca17664542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:08.788913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 703/1378] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:15:08.843088 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7943a-926d-4f9a-9f49-02dad7f41afb None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:15:08.859723 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7943a-926d-4f9a-9f49-02dad7f41afb None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:15:08.865771 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843ade9-c7a9-47de-9c92-8c8316d8a03a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:15:08.866771 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843ade9-c7a9-47de-9c92-8c8316d8a03a service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:08.867175 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843ade9-c7a9-47de-9c92-8c8316d8a03a service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:08.867635 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843ade9-c7a9-47de-9c92-8c8316d8a03a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:08.879741 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843ade9-c7a9-47de-9c92-8c8316d8a03a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:15:08.881433 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843ade9-c7a9-47de-9c92-8c8316d8a03a service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:15:08.892758 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 676/1379] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:15:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:15:11.375235 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a376efd-fc8b-4488-8e7b-3f845b3a26ac None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:11.375774 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a376efd-fc8b-4488-8e7b-3f845b3a26ac None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:11.375774 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a376efd-fc8b-4488-8e7b-3f845b3a26ac None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:11.377460 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 704/1380] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:15:11.383179 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83058ce4-5be5-4c5d-b4b2-206176d58cb6 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:11.383663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83058ce4-5be5-4c5d-b4b2-206176d58cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:11.383744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83058ce4-5be5-4c5d-b4b2-206176d58cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:11.401984 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-83058ce4-5be5-4c5d-b4b2-206176d58cb6 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:11.403276 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-83058ce4-5be5-4c5d-b4b2-206176d58cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:11.416037 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 677/1381] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:15:11.458366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a376efd-fc8b-4488-8e7b-3f845b3a26ac None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:15:11.475076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a376efd-fc8b-4488-8e7b-3f845b3a26ac None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:15:11.481541 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23fe69-60a0-4493-8eb7-7d0848c7a8d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:15:11.482879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23fe69-60a0-4493-8eb7-7d0848c7a8d5 service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:11.483173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23fe69-60a0-4493-8eb7-7d0848c7a8d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:11.483673 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23fe69-60a0-4493-8eb7-7d0848c7a8d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:11.496247 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23fe69-60a0-4493-8eb7-7d0848c7a8d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:15:11.500084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23fe69-60a0-4493-8eb7-7d0848c7a8d5 service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:15:11.514095 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 705/1382] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:15:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:15:14.096461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edf08a-a91d-4c49-be72-7a2dedf4c2a3 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:14.096461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edf08a-a91d-4c49-be72-7a2dedf4c2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:14.096461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edf08a-a91d-4c49-be72-7a2dedf4c2a3 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:14.096461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 678/1383] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:15:14.098091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734935a-31d3-49bd-8f7f-ef6fe194afee None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:14.098091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734935a-31d3-49bd-8f7f-ef6fe194afee None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:14.098091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734935a-31d3-49bd-8f7f-ef6fe194afee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:14.098091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-c734935a-31d3-49bd-8f7f-ef6fe194afee None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:14.098091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c734935a-31d3-49bd-8f7f-ef6fe194afee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:14.098091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 706/1384] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:15:14.099232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6edf08a-a91d-4c49-be72-7a2dedf4c2a3 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:15:14.099232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6edf08a-a91d-4c49-be72-7a2dedf4c2a3 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:15:14.099232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb9786-db79-4ecc-bfcc-7fe4acd88c4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:15:14.099232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb9786-db79-4ecc-bfcc-7fe4acd88c4d service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:14.099560 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb9786-db79-4ecc-bfcc-7fe4acd88c4d service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:14.099560 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb9786-db79-4ecc-bfcc-7fe4acd88c4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:14.099560 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb9786-db79-4ecc-bfcc-7fe4acd88c4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:15:14.099560 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb9786-db79-4ecc-bfcc-7fe4acd88c4d service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:15:14.099560 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 679/1385] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:15:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:15:17.109085 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1d58a-d2fc-449a-af03-db9fbfefbd13 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:17.109665 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1d58a-d2fc-449a-af03-db9fbfefbd13 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:17.109798 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1d58a-d2fc-449a-af03-db9fbfefbd13 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:17.111519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 707/1386] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:15:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:15:17.118679 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0028e8f-e66d-4c9e-9327-ca38dfd8712f None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:17.119232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0028e8f-e66d-4c9e-9327-ca38dfd8712f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:17.119349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0028e8f-e66d-4c9e-9327-ca38dfd8712f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:17.142596 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-a0028e8f-e66d-4c9e-9327-ca38dfd8712f None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:17.144238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a0028e8f-e66d-4c9e-9327-ca38dfd8712f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:17.154573 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 680/1387] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:15:17.212523 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1d58a-d2fc-449a-af03-db9fbfefbd13 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:15:17.228412 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1d58a-d2fc-449a-af03-db9fbfefbd13 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:15:17.234390 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065452d8-c604-4043-9180-335517f5e856 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:15:17.235068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065452d8-c604-4043-9180-335517f5e856 service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:17.235333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065452d8-c604-4043-9180-335517f5e856 service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:17.235634 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065452d8-c604-4043-9180-335517f5e856 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:17.246007 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065452d8-c604-4043-9180-335517f5e856 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:15:17.248264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065452d8-c604-4043-9180-335517f5e856 service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:15:17.259449 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 708/1388] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:15:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:15:19.847308 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a48a2-427f-41bb-952e-184bf36bf34e None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:19.847948 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a48a2-427f-41bb-952e-184bf36bf34e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:19.848409 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a48a2-427f-41bb-952e-184bf36bf34e None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:19.851200 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 681/1389] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:15:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:15:19.857074 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbab14f-6883-4da7-bafa-13af859a9c1d None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:19.857610 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbab14f-6883-4da7-bafa-13af859a9c1d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:19.857700 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbab14f-6883-4da7-bafa-13af859a9c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:19.875750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-2dbab14f-6883-4da7-bafa-13af859a9c1d None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:19.877538 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-2dbab14f-6883-4da7-bafa-13af859a9c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:19.886184 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 709/1390] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:15:19.933870 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a48a2-427f-41bb-952e-184bf36bf34e None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:15:19.952336 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a48a2-427f-41bb-952e-184bf36bf34e None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:15:19.959964 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a498a3a-eaf5-40a9-9d0b-7b16f6ff544a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:15:19.960783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a498a3a-eaf5-40a9-9d0b-7b16f6ff544a service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:19.961146 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a498a3a-eaf5-40a9-9d0b-7b16f6ff544a service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:19.961501 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a498a3a-eaf5-40a9-9d0b-7b16f6ff544a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:19.973515 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a498a3a-eaf5-40a9-9d0b-7b16f6ff544a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:15:19.975611 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a498a3a-eaf5-40a9-9d0b-7b16f6ff544a service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:15:19.989246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 682/1391] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:15:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:15:22.674872 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a09916-a87a-40e1-bcbc-8ad8477d7232 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:22.675509 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a09916-a87a-40e1-bcbc-8ad8477d7232 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:22.675509 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a09916-a87a-40e1-bcbc-8ad8477d7232 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:22.676947 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 710/1392] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:15:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:15:22.682783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01086547-694f-418a-b4fb-b0e7a201412d None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:22.683326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01086547-694f-418a-b4fb-b0e7a201412d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:22.683499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01086547-694f-418a-b4fb-b0e7a201412d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:22.692470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=87 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:15:22.710118 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-01086547-694f-418a-b4fb-b0e7a201412d None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:22.711357 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-01086547-694f-418a-b4fb-b0e7a201412d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:22.726085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 683/1393] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:15:22.772477 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a09916-a87a-40e1-bcbc-8ad8477d7232 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:15:22.787000 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a09916-a87a-40e1-bcbc-8ad8477d7232 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:15:22.792985 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f88d5-9ffb-40fb-a195-25ed286dbc51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:15:22.793642 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f88d5-9ffb-40fb-a195-25ed286dbc51 service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:22.793922 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f88d5-9ffb-40fb-a195-25ed286dbc51 service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:22.794194 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f88d5-9ffb-40fb-a195-25ed286dbc51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:22.804104 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f88d5-9ffb-40fb-a195-25ed286dbc51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:15:22.805702 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f88d5-9ffb-40fb-a195-25ed286dbc51 service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:15:22.816959 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 711/1394] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:15:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:15:23.166419 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a1237-6d14-496e-8519-ed212c2378ff None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:23.166731 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a1237-6d14-496e-8519-ed212c2378ff None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:23.167007 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a1237-6d14-496e-8519-ed212c2378ff None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:23.168628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 684/1395] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:15:23.175053 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72996e7a-84bb-4bad-a25d-8e3fca58bbad None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:23.175368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72996e7a-84bb-4bad-a25d-8e3fca58bbad None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:23.175652 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72996e7a-84bb-4bad-a25d-8e3fca58bbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:23.195214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-72996e7a-84bb-4bad-a25d-8e3fca58bbad None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:23.196484 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-72996e7a-84bb-4bad-a25d-8e3fca58bbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:23.205426 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 712/1396] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:15:23.263908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78dad4-3c87-4556-aa35-227e67264241 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:23.264670 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78dad4-3c87-4556-aa35-227e67264241 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:23.265236 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78dad4-3c87-4556-aa35-227e67264241 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:23.267302 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 685/1397] 10.222.0.45 () {54 vars in 962 bytes} [Thu Jun 2 19:15:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:15:23.273196 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3431252-43d2-40eb-8d90-41701a808634 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:23.273561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3431252-43d2-40eb-8d90-41701a808634 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:23.273906 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3431252-43d2-40eb-8d90-41701a808634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:23.328982 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-a3431252-43d2-40eb-8d90-41701a808634 None None] MFA Rules not processed for user `226743f4f93c44c5aef5919a7813bd3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:23.330288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-a3431252-43d2-40eb-8d90-41701a808634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:23.409515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 713/1398] 10.222.0.45 () {58 vars in 1059 bytes} [Thu Jun 2 19:15:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:15:23.418806 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78dad4-3c87-4556-aa35-227e67264241 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:15:23.430047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78dad4-3c87-4556-aa35-227e67264241 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:15:23.434304 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92b9ed-9f6b-4c1b-afd0-97a5f40342ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '226743f4f93c44c5aef5919a7813bd3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:15:23.435090 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92b9ed-9f6b-4c1b-afd0-97a5f40342ab service glance] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:23.435389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92b9ed-9f6b-4c1b-afd0-97a5f40342ab service glance] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:23.435666 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92b9ed-9f6b-4c1b-afd0-97a5f40342ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:23.445739 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92b9ed-9f6b-4c1b-afd0-97a5f40342ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:15:23.447178 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92b9ed-9f6b-4c1b-afd0-97a5f40342ab service glance] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:15:23.459072 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 686/1399] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:15:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:15:24.165277 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97ad57-c470-4209-a401-c90ae873228b None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:24.165758 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97ad57-c470-4209-a401-c90ae873228b None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:24.166328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97ad57-c470-4209-a401-c90ae873228b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:24.195289 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:15:24.228087 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-1f97ad57-c470-4209-a401-c90ae873228b None None] MFA Rules not processed for user `235042beafd246c5b227b3926098c8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:24.229366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-1f97ad57-c470-4209-a401-c90ae873228b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:24.304983 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 714/1400] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jun 2 19:15:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:15:24.354932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3687774-5f29-4d48-850c-194d5518dbe5 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:24.355487 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3687774-5f29-4d48-850c-194d5518dbe5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:24.355487 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3687774-5f29-4d48-850c-194d5518dbe5 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:24.357212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 687/1401] 10.222.0.45 () {54 vars in 942 bytes} [Thu Jun 2 19:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:15:24.365172 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d2a2e-038c-4302-9ff1-45a5b750b01d None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:24.365469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d2a2e-038c-4302-9ff1-45a5b750b01d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:24.365749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d2a2e-038c-4302-9ff1-45a5b750b01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:24.423253 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-bb4d2a2e-038c-4302-9ff1-45a5b750b01d None None] MFA Rules not processed for user `87ba0ab9510d49c4ab4c634e82790efb`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:24.424173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-bb4d2a2e-038c-4302-9ff1-45a5b750b01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:24.515542 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 715/1402] 10.222.0.45 () {58 vars in 1039 bytes} [Thu Jun 2 19:15:24 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:15:24.525400 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3687774-5f29-4d48-850c-194d5518dbe5 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:15:24.544295 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3687774-5f29-4d48-850c-194d5518dbe5 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:15:24.550466 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd01ef1-36ff-41c1-8c6f-3ed7c5d0879f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ba0ab9510d49c4ab4c634e82790efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:15:24.551121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd01ef1-36ff-41c1-8c6f-3ed7c5d0879f service swift] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:24.551400 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd01ef1-36ff-41c1-8c6f-3ed7c5d0879f service swift] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:24.552423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd01ef1-36ff-41c1-8c6f-3ed7c5d0879f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:24.562349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd01ef1-36ff-41c1-8c6f-3ed7c5d0879f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:15:24.563969 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd01ef1-36ff-41c1-8c6f-3ed7c5d0879f service swift] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:15:24.573391 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 688/1403] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jun 2 19:15:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 19:15:25.260571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aede30-3ab7-4fe6-bc33-ac7f87c2f553 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:25.261099 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aede30-3ab7-4fe6-bc33-ac7f87c2f553 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:25.261099 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aede30-3ab7-4fe6-bc33-ac7f87c2f553 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:25.266543 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 716/1404] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:15:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:15:25.268396 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e4ad0-aec8-4f64-b044-6ffd3a947aa1 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:25.269103 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e4ad0-aec8-4f64-b044-6ffd3a947aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:25.269385 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e4ad0-aec8-4f64-b044-6ffd3a947aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:25.289053 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-371e4ad0-aec8-4f64-b044-6ffd3a947aa1 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:25.290540 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-371e4ad0-aec8-4f64-b044-6ffd3a947aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:25.299392 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 689/1405] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:15:25.343675 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aede30-3ab7-4fe6-bc33-ac7f87c2f553 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:15:25.359497 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aede30-3ab7-4fe6-bc33-ac7f87c2f553 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:15:25.365264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f462a3-8f37-4433-8264-bf698b1bd68c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:15:25.365968 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f462a3-8f37-4433-8264-bf698b1bd68c service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:25.366339 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f462a3-8f37-4433-8264-bf698b1bd68c service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:25.366626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f462a3-8f37-4433-8264-bf698b1bd68c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:25.377946 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f462a3-8f37-4433-8264-bf698b1bd68c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:15:25.380010 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f462a3-8f37-4433-8264-bf698b1bd68c service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:15:25.390542 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 717/1406] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:15:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:15:27.853383 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971d663-4529-4530-be20-fe54fdedd15a None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:27.853976 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971d663-4529-4530-be20-fe54fdedd15a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:27.853976 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971d663-4529-4530-be20-fe54fdedd15a None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:27.860563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 690/1407] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:15:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:15:27.862560 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8963af-b65e-4f03-87fe-90de5f1f0125 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:27.863057 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8963af-b65e-4f03-87fe-90de5f1f0125 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:27.863158 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8963af-b65e-4f03-87fe-90de5f1f0125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:27.882090 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-8c8963af-b65e-4f03-87fe-90de5f1f0125 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:27.883290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-8c8963af-b65e-4f03-87fe-90de5f1f0125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:27.894947 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 718/1408] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:15:27.940457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971d663-4529-4530-be20-fe54fdedd15a None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:15:27.956867 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971d663-4529-4530-be20-fe54fdedd15a None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:15:27.969075 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3516b4-433a-4e12-bbb3-e2ab22a7198b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:15:27.969075 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3516b4-433a-4e12-bbb3-e2ab22a7198b service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:27.969075 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3516b4-433a-4e12-bbb3-e2ab22a7198b service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:27.969075 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3516b4-433a-4e12-bbb3-e2ab22a7198b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:27.979031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3516b4-433a-4e12-bbb3-e2ab22a7198b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:15:27.983151 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3516b4-433a-4e12-bbb3-e2ab22a7198b service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:15:28.002129 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 691/1409] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:15:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:15:37.876554 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=87 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:15:37.989567 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=23 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:15:48.756558 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f160b7-7b35-446e-9275-0f7aa5eb9f9b None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:48.757155 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f160b7-7b35-446e-9275-0f7aa5eb9f9b None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:48.757155 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f160b7-7b35-446e-9275-0f7aa5eb9f9b None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:48.758520 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 719/1410] 10.222.0.45 () {54 vars in 918 bytes} [Thu Jun 2 19:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:15:48.764465 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad46bfe-7174-401a-bb9a-6f09105bbbab None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:48.765016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad46bfe-7174-401a-bb9a-6f09105bbbab None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:48.765016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad46bfe-7174-401a-bb9a-6f09105bbbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:48.783567 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-6ad46bfe-7174-401a-bb9a-6f09105bbbab None None] MFA Rules not processed for user `3ebc95c1b3284c1d8321900cf442a811`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:48.784811 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6ad46bfe-7174-401a-bb9a-6f09105bbbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:48.793346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 692/1411] 10.222.0.45 () {58 vars in 1015 bytes} [Thu Jun 2 19:15:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:15:48.808234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bcda8-3639-4e71-9587-b01194ca847b None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:48.808524 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bcda8-3639-4e71-9587-b01194ca847b None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:48.808805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bcda8-3639-4e71-9587-b01194ca847b None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:48.810178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 720/1412] 10.222.0.45 () {54 vars in 918 bytes} [Thu Jun 2 19:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:15:48.815124 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f59380-0eb1-4960-816b-0b09611c24bd None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:48.815415 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f59380-0eb1-4960-816b-0b09611c24bd None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:48.815693 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f59380-0eb1-4960-816b-0b09611c24bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:48.833699 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-12f59380-0eb1-4960-816b-0b09611c24bd None None] MFA Rules not processed for user `575f61ef70314f86b5d9dad3ba1b3aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:48.834886 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-12f59380-0eb1-4960-816b-0b09611c24bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:48.844459 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 693/1413] 10.222.0.45 () {58 vars in 1015 bytes} [Thu Jun 2 19:15:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:15:51.581909 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02635d-9aab-40bd-a533-7f8053279523 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:51.582476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02635d-9aab-40bd-a533-7f8053279523 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:51.582476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02635d-9aab-40bd-a533-7f8053279523 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:51.583843 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 721/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 19:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:15:51.589265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b4faf-6cd1-4047-9732-5661f67457c5 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:51.589714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b4faf-6cd1-4047-9732-5661f67457c5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:51.589821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b4faf-6cd1-4047-9732-5661f67457c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:51.608748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-c43b4faf-6cd1-4047-9732-5661f67457c5 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:51.609931 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c43b4faf-6cd1-4047-9732-5661f67457c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:51.617948 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 694/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 19:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:15:51.661290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02635d-9aab-40bd-a533-7f8053279523 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:15:51.675749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02635d-9aab-40bd-a533-7f8053279523 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:15:51.681162 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff40182-c71b-4e4a-9800-e62a4c0cb307 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:15:51.681795 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff40182-c71b-4e4a-9800-e62a4c0cb307 service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:51.682079 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff40182-c71b-4e4a-9800-e62a4c0cb307 service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:51.682350 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff40182-c71b-4e4a-9800-e62a4c0cb307 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:51.690666 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff40182-c71b-4e4a-9800-e62a4c0cb307 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:15:51.692274 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff40182-c71b-4e4a-9800-e62a4c0cb307 service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:15:51.701592 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 722/1416] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:15:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:15:52.691748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f443d88-9467-44ff-9320-cc2f1c57af01 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:52.692351 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f443d88-9467-44ff-9320-cc2f1c57af01 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:52.692351 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f443d88-9467-44ff-9320-cc2f1c57af01 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:52.693735 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 695/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 19:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:15:52.698817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc3e02-3028-44eb-a640-86b9467f082f None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:52.699222 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc3e02-3028-44eb-a640-86b9467f082f None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:52.699360 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc3e02-3028-44eb-a640-86b9467f082f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:52.717435 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-d6fc3e02-3028-44eb-a640-86b9467f082f None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:52.718625 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-d6fc3e02-3028-44eb-a640-86b9467f082f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:52.727045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 723/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 19:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:15:52.889150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f443d88-9467-44ff-9320-cc2f1c57af01 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:15:52.904078 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f443d88-9467-44ff-9320-cc2f1c57af01 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:15:52.909487 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c725146-8176-4a09-801c-09c4eca1e0ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:15:52.910144 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c725146-8176-4a09-801c-09c4eca1e0ac service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:52.910423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c725146-8176-4a09-801c-09c4eca1e0ac service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:52.910691 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c725146-8176-4a09-801c-09c4eca1e0ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:52.919601 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c725146-8176-4a09-801c-09c4eca1e0ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:15:52.921190 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c725146-8176-4a09-801c-09c4eca1e0ac service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:15:52.930481 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 696/1419] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:15:53.861526 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597004b7-f24b-4a47-9b31-528f1170f446 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:53.862063 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597004b7-f24b-4a47-9b31-528f1170f446 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:53.862063 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597004b7-f24b-4a47-9b31-528f1170f446 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:53.863597 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 724/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 19:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:15:53.868378 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38233075-1c02-45d0-a259-1ee3ae2cfa21 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:53.868808 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38233075-1c02-45d0-a259-1ee3ae2cfa21 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:53.868952 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38233075-1c02-45d0-a259-1ee3ae2cfa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:53.888123 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-38233075-1c02-45d0-a259-1ee3ae2cfa21 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:53.889344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-38233075-1c02-45d0-a259-1ee3ae2cfa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:53.897292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 697/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 19:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:15:54.046157 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597004b7-f24b-4a47-9b31-528f1170f446 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:15:54.061166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597004b7-f24b-4a47-9b31-528f1170f446 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:15:54.066612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2287c24-997a-493c-b3ac-d361d0d3ad9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:15:54.067257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2287c24-997a-493c-b3ac-d361d0d3ad9e service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:54.067542 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2287c24-997a-493c-b3ac-d361d0d3ad9e service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:54.067822 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2287c24-997a-493c-b3ac-d361d0d3ad9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:54.077195 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2287c24-997a-493c-b3ac-d361d0d3ad9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:15:54.078789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2287c24-997a-493c-b3ac-d361d0d3ad9e service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:15:54.089281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 725/1422] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:15:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:15:54.997957 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f07ce-7920-4597-ad51-7ffd68edb7ff None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:54.998486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f07ce-7920-4597-ad51-7ffd68edb7ff None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:54.998486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f07ce-7920-4597-ad51-7ffd68edb7ff None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:54.999822 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 698/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 19:15:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:15:55.005084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f3b87-c2c3-48fe-989e-60a4056df046 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:55.005500 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f3b87-c2c3-48fe-989e-60a4056df046 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:55.005643 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f3b87-c2c3-48fe-989e-60a4056df046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:55.024266 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-558f3b87-c2c3-48fe-989e-60a4056df046 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:55.025461 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-558f3b87-c2c3-48fe-989e-60a4056df046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:55.033266 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 726/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 19:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:15:55.189911 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f07ce-7920-4597-ad51-7ffd68edb7ff None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:15:55.205077 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f07ce-7920-4597-ad51-7ffd68edb7ff None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:15:55.210958 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b547667-2d83-462e-9f0d-2164823620c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:15:55.211599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b547667-2d83-462e-9f0d-2164823620c6 service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:55.211882 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b547667-2d83-462e-9f0d-2164823620c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:55.212187 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b547667-2d83-462e-9f0d-2164823620c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:55.221285 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b547667-2d83-462e-9f0d-2164823620c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:15:55.222851 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b547667-2d83-462e-9f0d-2164823620c6 service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:15:55.233044 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 699/1425] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:15:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:15:56.149155 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443005e5-736d-498c-85d5-973ce49a2ba4 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:56.149742 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443005e5-736d-498c-85d5-973ce49a2ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:56.149742 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443005e5-736d-498c-85d5-973ce49a2ba4 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:56.151109 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 727/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 19:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:15:56.156531 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618766f6-62be-4c2a-9a41-a1ae5d0c7554 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:56.156995 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618766f6-62be-4c2a-9a41-a1ae5d0c7554 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:56.157102 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618766f6-62be-4c2a-9a41-a1ae5d0c7554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:56.174709 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-618766f6-62be-4c2a-9a41-a1ae5d0c7554 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:56.175975 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-618766f6-62be-4c2a-9a41-a1ae5d0c7554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:56.183924 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 700/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 19:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:15:56.333429 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443005e5-736d-498c-85d5-973ce49a2ba4 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:15:56.347619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443005e5-736d-498c-85d5-973ce49a2ba4 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:15:56.352993 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c5bc5-c8a1-46ff-b2bb-7c79250c1d24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:15:56.353628 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c5bc5-c8a1-46ff-b2bb-7c79250c1d24 service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:56.353915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c5bc5-c8a1-46ff-b2bb-7c79250c1d24 service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:56.354192 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c5bc5-c8a1-46ff-b2bb-7c79250c1d24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:56.362930 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c5bc5-c8a1-46ff-b2bb-7c79250c1d24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:15:56.364631 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c5bc5-c8a1-46ff-b2bb-7c79250c1d24 service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:15:56.374557 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 728/1428] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:15:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:15:57.285614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e46e9c-98cc-490b-8582-9b9313e9bf37 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:57.286171 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e46e9c-98cc-490b-8582-9b9313e9bf37 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:57.286171 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e46e9c-98cc-490b-8582-9b9313e9bf37 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:57.287521 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 701/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 19:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:15:57.292618 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fec522-42c2-4eff-8425-e74d25766c1a None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:57.293035 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fec522-42c2-4eff-8425-e74d25766c1a None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:57.293171 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fec522-42c2-4eff-8425-e74d25766c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:57.310794 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-e0fec522-42c2-4eff-8425-e74d25766c1a None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:57.312017 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-e0fec522-42c2-4eff-8425-e74d25766c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:57.319871 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 729/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 19:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:15:57.484603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e46e9c-98cc-490b-8582-9b9313e9bf37 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:15:57.499274 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e46e9c-98cc-490b-8582-9b9313e9bf37 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:15:57.504731 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26e1d7-4cd6-4d5c-8990-ed2354e4fe0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:15:57.505361 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26e1d7-4cd6-4d5c-8990-ed2354e4fe0b service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:57.505644 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26e1d7-4cd6-4d5c-8990-ed2354e4fe0b service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:57.505952 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26e1d7-4cd6-4d5c-8990-ed2354e4fe0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:57.514944 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26e1d7-4cd6-4d5c-8990-ed2354e4fe0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:15:57.516623 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26e1d7-4cd6-4d5c-8990-ed2354e4fe0b service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:15:57.525983 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 702/1431] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:15:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:15:58.422754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6db40-8051-4954-9738-8c106a15a1e0 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:58.423459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6db40-8051-4954-9738-8c106a15a1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:58.423459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6db40-8051-4954-9738-8c106a15a1e0 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:58.424761 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 730/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 19:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:15:58.429768 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f46518-76e5-4b46-87bf-2f04d6707a46 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:58.430208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f46518-76e5-4b46-87bf-2f04d6707a46 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:58.430348 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f46518-76e5-4b46-87bf-2f04d6707a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:58.448856 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-d2f46518-76e5-4b46-87bf-2f04d6707a46 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:58.450664 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d2f46518-76e5-4b46-87bf-2f04d6707a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:58.459479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 703/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 19:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:15:58.609829 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6db40-8051-4954-9738-8c106a15a1e0 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:15:58.630840 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6db40-8051-4954-9738-8c106a15a1e0 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:15:58.636671 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e725a-157a-4eb5-8fe2-68635c85087d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:15:58.637336 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e725a-157a-4eb5-8fe2-68635c85087d service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:58.637612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e725a-157a-4eb5-8fe2-68635c85087d service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:58.637884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e725a-157a-4eb5-8fe2-68635c85087d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:58.647240 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e725a-157a-4eb5-8fe2-68635c85087d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:15:58.648930 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e725a-157a-4eb5-8fe2-68635c85087d service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:15:58.659578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 731/1434] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:15:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:15:59.625589 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdb40d-5690-4f3f-bd7d-43686518b6ef None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:59.626191 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdb40d-5690-4f3f-bd7d-43686518b6ef None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:59.626191 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdb40d-5690-4f3f-bd7d-43686518b6ef None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:59.627601 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 704/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 19:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:15:59.633233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598b3a2-4d45-4088-a164-5dc40a1c2a40 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:59.633748 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598b3a2-4d45-4088-a164-5dc40a1c2a40 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:59.633869 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598b3a2-4d45-4088-a164-5dc40a1c2a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:59.654212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-c598b3a2-4d45-4088-a164-5dc40a1c2a40 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:15:59.655450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c598b3a2-4d45-4088-a164-5dc40a1c2a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:59.663495 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 732/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 19:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:15:59.818180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdb40d-5690-4f3f-bd7d-43686518b6ef None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:15:59.833426 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdb40d-5690-4f3f-bd7d-43686518b6ef None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:15:59.838677 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94ebf5-746b-4f2a-ace3-f9af96a2f564 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:15:59.839316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94ebf5-746b-4f2a-ace3-f9af96a2f564 service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:59.839592 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94ebf5-746b-4f2a-ace3-f9af96a2f564 service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:59.839865 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94ebf5-746b-4f2a-ace3-f9af96a2f564 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:59.848829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94ebf5-746b-4f2a-ace3-f9af96a2f564 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:15:59.850388 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94ebf5-746b-4f2a-ace3-f9af96a2f564 service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:15:59.860318 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 705/1437] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:15:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:16:00.824995 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd0851-7aff-42b4-83d8-66b293541199 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:00.825497 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd0851-7aff-42b4-83d8-66b293541199 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:00.825583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd0851-7aff-42b4-83d8-66b293541199 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:00.826987 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 733/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 19:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:16:00.832492 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03123e78-05ef-4201-bf7a-0c608bcc55b3 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:00.832886 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03123e78-05ef-4201-bf7a-0c608bcc55b3 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:00.833055 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03123e78-05ef-4201-bf7a-0c608bcc55b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:00.851340 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-03123e78-05ef-4201-bf7a-0c608bcc55b3 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:16:00.852576 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-03123e78-05ef-4201-bf7a-0c608bcc55b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:16:00.861068 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 706/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 19:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:16:01.011103 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd0851-7aff-42b4-83d8-66b293541199 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:16:01.025936 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd0851-7aff-42b4-83d8-66b293541199 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:16:01.032261 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14170897-3e29-4b73-afe9-d436ed853661 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:16:01.032906 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14170897-3e29-4b73-afe9-d436ed853661 service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:01.033192 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14170897-3e29-4b73-afe9-d436ed853661 service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:01.033471 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14170897-3e29-4b73-afe9-d436ed853661 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:01.041930 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14170897-3e29-4b73-afe9-d436ed853661 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:16:01.043555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14170897-3e29-4b73-afe9-d436ed853661 service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:16:01.052960 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 734/1440] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:16:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:16:03.178727 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3b6c1-0478-46d9-bb62-52520aea71f9 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:03.179298 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3b6c1-0478-46d9-bb62-52520aea71f9 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:03.179298 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3b6c1-0478-46d9-bb62-52520aea71f9 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:03.180699 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 707/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 19:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:16:03.186072 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a3670-3790-4534-b057-b333a9f55a4b None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:03.186542 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a3670-3790-4534-b057-b333a9f55a4b None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:03.186674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a3670-3790-4534-b057-b333a9f55a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:03.204751 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-4f9a3670-3790-4534-b057-b333a9f55a4b None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:16:03.206213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-4f9a3670-3790-4534-b057-b333a9f55a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:16:03.214125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 735/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 19:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:16:03.253373 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3b6c1-0478-46d9-bb62-52520aea71f9 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:16:03.265060 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3b6c1-0478-46d9-bb62-52520aea71f9 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:16:03.268899 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595554bf-b9ad-47cd-8be4-5d146b538e93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:16:03.269559 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595554bf-b9ad-47cd-8be4-5d146b538e93 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:03.269847 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595554bf-b9ad-47cd-8be4-5d146b538e93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:03.270126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595554bf-b9ad-47cd-8be4-5d146b538e93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:03.280756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595554bf-b9ad-47cd-8be4-5d146b538e93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:16:03.282243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595554bf-b9ad-47cd-8be4-5d146b538e93 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:16:03.294003 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 708/1443] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:16:05.691159 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db36e32-4d6f-4258-8723-72b288c122bb None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:05.691745 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db36e32-4d6f-4258-8723-72b288c122bb None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:05.691745 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db36e32-4d6f-4258-8723-72b288c122bb None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:05.693113 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 736/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 19:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:16:05.698515 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bc6d3-bc0f-40eb-b992-3bd3a7e81260 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:05.698977 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bc6d3-bc0f-40eb-b992-3bd3a7e81260 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:05.699096 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bc6d3-bc0f-40eb-b992-3bd3a7e81260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:05.717736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-1b4bc6d3-bc0f-40eb-b992-3bd3a7e81260 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:16:05.718937 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1b4bc6d3-bc0f-40eb-b992-3bd3a7e81260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:16:05.727116 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 709/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 19:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:16:05.765039 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db36e32-4d6f-4258-8723-72b288c122bb None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:16:05.775710 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db36e32-4d6f-4258-8723-72b288c122bb None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:16:05.779766 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6fbfa-dad0-4302-8231-9ab2d20c03b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:16:05.780445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6fbfa-dad0-4302-8231-9ab2d20c03b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:05.780728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6fbfa-dad0-4302-8231-9ab2d20c03b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:05.781005 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6fbfa-dad0-4302-8231-9ab2d20c03b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:05.790101 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6fbfa-dad0-4302-8231-9ab2d20c03b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:16:05.791717 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6fbfa-dad0-4302-8231-9ab2d20c03b6 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:16:05.803021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 737/1446] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:16:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:16:08.448587 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd37851-8fb2-431c-ae7c-3d5e8f347c80 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:08.449259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd37851-8fb2-431c-ae7c-3d5e8f347c80 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:08.449259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd37851-8fb2-431c-ae7c-3d5e8f347c80 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:08.451040 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 710/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 19:16:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:16:08.456877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e328f2c-39e0-4b26-a891-026959431fd4 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:08.457359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e328f2c-39e0-4b26-a891-026959431fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:08.457463 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e328f2c-39e0-4b26-a891-026959431fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:08.475601 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-0e328f2c-39e0-4b26-a891-026959431fd4 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:16:08.476841 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-0e328f2c-39e0-4b26-a891-026959431fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:16:08.484649 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 738/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 19:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:16:08.523328 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd37851-8fb2-431c-ae7c-3d5e8f347c80 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:16:08.534710 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd37851-8fb2-431c-ae7c-3d5e8f347c80 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:16:08.538189 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de91c7b-946f-44dd-92da-6e6c93b81557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:16:08.538822 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de91c7b-946f-44dd-92da-6e6c93b81557 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:08.539101 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de91c7b-946f-44dd-92da-6e6c93b81557 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:08.539373 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de91c7b-946f-44dd-92da-6e6c93b81557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:08.548370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de91c7b-946f-44dd-92da-6e6c93b81557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:16:08.549825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de91c7b-946f-44dd-92da-6e6c93b81557 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:16:08.559276 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 711/1449] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:16:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:16:11.040442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1ac30-6880-4693-bc59-bc79a0c0714d None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:11.041080 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1ac30-6880-4693-bc59-bc79a0c0714d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:11.041080 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1ac30-6880-4693-bc59-bc79a0c0714d None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:11.042301 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 739/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 19:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:16:11.047731 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb4f27-ad40-41b5-82ff-c5eb320d6c67 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:11.048304 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb4f27-ad40-41b5-82ff-c5eb320d6c67 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:11.048304 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb4f27-ad40-41b5-82ff-c5eb320d6c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:11.066337 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-87eb4f27-ad40-41b5-82ff-c5eb320d6c67 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:16:11.067560 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-87eb4f27-ad40-41b5-82ff-c5eb320d6c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:16:11.076593 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 712/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 19:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:16:11.114386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1ac30-6880-4693-bc59-bc79a0c0714d None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:16:11.125525 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1ac30-6880-4693-bc59-bc79a0c0714d None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:16:11.129029 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862f4fc-c982-47b2-9b4f-4b392d3c9f52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:16:11.129661 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862f4fc-c982-47b2-9b4f-4b392d3c9f52 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:11.129945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862f4fc-c982-47b2-9b4f-4b392d3c9f52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:11.130221 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862f4fc-c982-47b2-9b4f-4b392d3c9f52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:11.139793 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862f4fc-c982-47b2-9b4f-4b392d3c9f52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:16:11.141282 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862f4fc-c982-47b2-9b4f-4b392d3c9f52 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:16:11.150573 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 740/1452] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:16:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:16:13.445550 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08a4c5-7856-4af6-ac4f-d74493354dae None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:13.446137 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08a4c5-7856-4af6-ac4f-d74493354dae None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:13.446137 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08a4c5-7856-4af6-ac4f-d74493354dae None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:13.447509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 713/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 19:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:16:13.453690 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6f135-3930-455b-ae3d-4a86580d69e3 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:13.454159 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6f135-3930-455b-ae3d-4a86580d69e3 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:13.454263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6f135-3930-455b-ae3d-4a86580d69e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:13.472125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-cca6f135-3930-455b-ae3d-4a86580d69e3 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:16:13.473429 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-cca6f135-3930-455b-ae3d-4a86580d69e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:16:13.481388 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 741/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 19:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:16:13.519840 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08a4c5-7856-4af6-ac4f-d74493354dae None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:16:13.530614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08a4c5-7856-4af6-ac4f-d74493354dae None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:16:13.534169 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b7a3f-a432-44b5-85e0-f8e9fe433b2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:16:13.534811 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b7a3f-a432-44b5-85e0-f8e9fe433b2b service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:13.535093 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b7a3f-a432-44b5-85e0-f8e9fe433b2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:13.535369 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b7a3f-a432-44b5-85e0-f8e9fe433b2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:13.544666 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b7a3f-a432-44b5-85e0-f8e9fe433b2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:16:13.546086 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b7a3f-a432-44b5-85e0-f8e9fe433b2b service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:16:13.555798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 714/1455] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:16:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:16:15.850592 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c2315-0ce5-4451-b024-842d07a54d86 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:15.851159 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c2315-0ce5-4451-b024-842d07a54d86 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:15.851159 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c2315-0ce5-4451-b024-842d07a54d86 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:15.852551 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 742/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 19:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:16:15.858550 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7629c1e-ac20-4c85-bf79-377de9f55b93 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:15.858959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7629c1e-ac20-4c85-bf79-377de9f55b93 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:15.859111 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7629c1e-ac20-4c85-bf79-377de9f55b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:15.876591 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f7629c1e-ac20-4c85-bf79-377de9f55b93 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:16:15.877785 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f7629c1e-ac20-4c85-bf79-377de9f55b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:16:15.885640 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 715/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 19:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:16:15.923940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c2315-0ce5-4451-b024-842d07a54d86 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:16:15.934516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c2315-0ce5-4451-b024-842d07a54d86 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:16:15.938116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177f807-68e8-4dfb-80fc-3873c42393b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:16:15.938740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177f807-68e8-4dfb-80fc-3873c42393b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:15.939019 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177f807-68e8-4dfb-80fc-3873c42393b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:15.939298 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177f807-68e8-4dfb-80fc-3873c42393b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:15.948186 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177f807-68e8-4dfb-80fc-3873c42393b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:16:15.950125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177f807-68e8-4dfb-80fc-3873c42393b2 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:16:15.959760 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 743/1458] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:16:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:16:18.281007 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d7bdb-7b15-4a47-a9db-a308edb573ea None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:18.281573 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d7bdb-7b15-4a47-a9db-a308edb573ea None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:18.281573 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d7bdb-7b15-4a47-a9db-a308edb573ea None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:18.282944 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 716/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 19:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:16:18.288574 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e385c77-4e70-4325-bd3d-4a0456b4e232 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:18.288988 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e385c77-4e70-4325-bd3d-4a0456b4e232 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:18.289130 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e385c77-4e70-4325-bd3d-4a0456b4e232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:18.295682 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=70 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:16:18.307726 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-7e385c77-4e70-4325-bd3d-4a0456b4e232 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:16:18.309570 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-7e385c77-4e70-4325-bd3d-4a0456b4e232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:16:18.317667 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 744/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 19:16:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:16:18.354566 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d7bdb-7b15-4a47-a9db-a308edb573ea None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:16:18.360446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=73 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:16:18.366179 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d7bdb-7b15-4a47-a9db-a308edb573ea None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:16:18.369805 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d239a64-b999-4645-b7a8-3623b769cc77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:16:18.370441 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d239a64-b999-4645-b7a8-3623b769cc77 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:18.370727 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d239a64-b999-4645-b7a8-3623b769cc77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:18.371006 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d239a64-b999-4645-b7a8-3623b769cc77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:18.380749 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d239a64-b999-4645-b7a8-3623b769cc77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:16:18.382187 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d239a64-b999-4645-b7a8-3623b769cc77 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:16:18.392449 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 717/1461] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:16:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:16:20.666438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ea7bc-d7a7-4b4c-a567-82e60e9422c2 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:20.667019 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ea7bc-d7a7-4b4c-a567-82e60e9422c2 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:20.667019 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ea7bc-d7a7-4b4c-a567-82e60e9422c2 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:20.668580 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 745/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 19:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:16:20.673646 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea54962-0742-4e3e-b170-c2ca766972d3 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:20.674096 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea54962-0742-4e3e-b170-c2ca766972d3 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:20.674212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea54962-0742-4e3e-b170-c2ca766972d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:20.692412 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-cea54962-0742-4e3e-b170-c2ca766972d3 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:16:20.693607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-cea54962-0742-4e3e-b170-c2ca766972d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:16:20.702327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 718/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 19:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:16:20.739949 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ea7bc-d7a7-4b4c-a567-82e60e9422c2 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:16:20.751251 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ea7bc-d7a7-4b4c-a567-82e60e9422c2 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:16:20.754775 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606da41-8d14-4368-a92a-6a8159a220bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:16:20.755412 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606da41-8d14-4368-a92a-6a8159a220bc service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:20.755696 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606da41-8d14-4368-a92a-6a8159a220bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:20.755970 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606da41-8d14-4368-a92a-6a8159a220bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:20.765517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606da41-8d14-4368-a92a-6a8159a220bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:16:20.766954 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606da41-8d14-4368-a92a-6a8159a220bc service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:16:20.776560 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 746/1464] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:16:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:16:23.051126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366daab0-710d-4d17-b521-398ddca49c9b None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:23.051668 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366daab0-710d-4d17-b521-398ddca49c9b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:23.051668 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366daab0-710d-4d17-b521-398ddca49c9b None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:23.053135 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 719/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 19:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:16:23.058375 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde76387-c70f-4e30-8f11-cb27f0496104 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:23.059323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde76387-c70f-4e30-8f11-cb27f0496104 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:23.059436 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde76387-c70f-4e30-8f11-cb27f0496104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:23.077553 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-bde76387-c70f-4e30-8f11-cb27f0496104 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:16:23.078737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-bde76387-c70f-4e30-8f11-cb27f0496104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:16:23.087671 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 747/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 19:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:16:23.124168 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366daab0-710d-4d17-b521-398ddca49c9b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:16:23.134803 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366daab0-710d-4d17-b521-398ddca49c9b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:16:23.138864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1640e-c15f-4f17-aaaf-4cb0f492ec76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:16:23.139490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1640e-c15f-4f17-aaaf-4cb0f492ec76 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:23.139769 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1640e-c15f-4f17-aaaf-4cb0f492ec76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:23.140066 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1640e-c15f-4f17-aaaf-4cb0f492ec76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:23.148773 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1640e-c15f-4f17-aaaf-4cb0f492ec76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:16:23.150190 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1640e-c15f-4f17-aaaf-4cb0f492ec76 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:16:23.159654 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 720/1467] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:16:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:16:25.420246 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3ea46-7632-4240-a50c-0efaa9b5f29d None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:25.420821 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3ea46-7632-4240-a50c-0efaa9b5f29d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:25.420821 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3ea46-7632-4240-a50c-0efaa9b5f29d None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:25.422223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 748/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 19:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:16:25.428327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcde37-0cb9-493b-a17e-eaf754e7dc78 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:25.428794 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcde37-0cb9-493b-a17e-eaf754e7dc78 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:25.428915 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcde37-0cb9-493b-a17e-eaf754e7dc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:25.446970 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-b7dcde37-0cb9-493b-a17e-eaf754e7dc78 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:16:25.448206 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b7dcde37-0cb9-493b-a17e-eaf754e7dc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:16:25.456485 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 721/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 19:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:16:25.494107 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3ea46-7632-4240-a50c-0efaa9b5f29d None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:16:25.504959 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3ea46-7632-4240-a50c-0efaa9b5f29d None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:16:25.508455 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ffbbb-efd8-4e35-b5f6-d553224dff0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:16:25.509096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ffbbb-efd8-4e35-b5f6-d553224dff0f service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:25.509371 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ffbbb-efd8-4e35-b5f6-d553224dff0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:25.509672 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ffbbb-efd8-4e35-b5f6-d553224dff0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:25.518966 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ffbbb-efd8-4e35-b5f6-d553224dff0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:16:25.520437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ffbbb-efd8-4e35-b5f6-d553224dff0f service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:16:25.530603 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 749/1470] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:16:35.441510 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=17 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:16:35.525745 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=17 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:16:57.445809 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0e538-790b-4351-886d-3ba124bf27eb None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:57.446408 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0e538-790b-4351-886d-3ba124bf27eb None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:57.446408 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0e538-790b-4351-886d-3ba124bf27eb None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:57.447785 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 722/1471] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:16:57.454016 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93802649-dc15-488e-b44f-0768dcad15b1 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:57.460449 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93802649-dc15-488e-b44f-0768dcad15b1 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:57.460449 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93802649-dc15-488e-b44f-0768dcad15b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:57.473638 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-93802649-dc15-488e-b44f-0768dcad15b1 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:16:57.474842 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-93802649-dc15-488e-b44f-0768dcad15b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:16:57.482847 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 750/1472] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:16:57.531538 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c200c-466f-452b-87b6-c78261cd55ed None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:57.531825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c200c-466f-452b-87b6-c78261cd55ed None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:57.532135 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c200c-466f-452b-87b6-c78261cd55ed None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:57.533636 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 723/1473] 10.222.0.45 () {54 vars in 962 bytes} [Thu Jun 2 19:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:16:57.539419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786ce90-bef8-44dd-89ea-6b88986188fb None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:57.539722 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786ce90-bef8-44dd-89ea-6b88986188fb None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:57.540026 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786ce90-bef8-44dd-89ea-6b88986188fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:57.559811 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-7786ce90-bef8-44dd-89ea-6b88986188fb None None] MFA Rules not processed for user `226743f4f93c44c5aef5919a7813bd3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:16:57.561066 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-7786ce90-bef8-44dd-89ea-6b88986188fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:16:57.567557 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 751/1474] 10.222.0.45 () {58 vars in 1059 bytes} [Thu Jun 2 19:16:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:16:57.575810 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c200c-466f-452b-87b6-c78261cd55ed None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:16:57.586931 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c200c-466f-452b-87b6-c78261cd55ed None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:16:57.590468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7275468-7878-4318-bfd1-d7bbc1cf9f96 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '226743f4f93c44c5aef5919a7813bd3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:16:57.591096 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7275468-7878-4318-bfd1-d7bbc1cf9f96 service glance] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:57.591380 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7275468-7878-4318-bfd1-d7bbc1cf9f96 service glance] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:57.591654 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7275468-7878-4318-bfd1-d7bbc1cf9f96 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:57.600903 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7275468-7878-4318-bfd1-d7bbc1cf9f96 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:16:57.602430 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7275468-7878-4318-bfd1-d7bbc1cf9f96 service glance] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:16:57.612108 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 724/1475] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:16:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:16:59.975260 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05e5e7-63ef-41e4-8fe8-25064f9593f2 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:59.975827 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05e5e7-63ef-41e4-8fe8-25064f9593f2 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:59.975827 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05e5e7-63ef-41e4-8fe8-25064f9593f2 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:16:59.977224 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 752/1476] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:16:59.982829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c83e6f-6446-429b-8636-ee46b6a16f95 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:16:59.983305 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c83e6f-6446-429b-8636-ee46b6a16f95 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:16:59.983420 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c83e6f-6446-429b-8636-ee46b6a16f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:17:00.001804 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-43c83e6f-6446-429b-8636-ee46b6a16f95 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:17:00.003003 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-43c83e6f-6446-429b-8636-ee46b6a16f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:17:00.011436 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 725/1477] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:17:00.035075 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05e5e7-63ef-41e4-8fe8-25064f9593f2 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:17:00.047834 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05e5e7-63ef-41e4-8fe8-25064f9593f2 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:17:00.052216 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6a406-9dba-4d00-a14c-c9b4c56df95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:17:00.052864 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6a406-9dba-4d00-a14c-c9b4c56df95f admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:17:00.053145 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6a406-9dba-4d00-a14c-c9b4c56df95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:17:00.053416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6a406-9dba-4d00-a14c-c9b4c56df95f admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:17:00.054187 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6a406-9dba-4d00-a14c-c9b4c56df95f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:17:00.056159 dv-cinder-797608-28-smb devstack@keystone.service[80608]: WARNING py.warnings [None req-10e6a406-9dba-4d00-a14c-c9b4c56df95f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 19:17:00.056159 dv-cinder-797608-28-smb devstack@keystone.service[80608]: warnings.warn(msg) Jun 02 19:17:00.056159 dv-cinder-797608-28-smb devstack@keystone.service[80608]: Jun 02 19:17:00.057300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6a406-9dba-4d00-a14c-c9b4c56df95f admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:17:00.078087 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 753/1478] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jun 2 19:17:00 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:17:02.359795 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f92b3-7b8f-4e98-857f-445978f34b7a None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:17:02.360412 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f92b3-7b8f-4e98-857f-445978f34b7a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:17:02.360412 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f92b3-7b8f-4e98-857f-445978f34b7a None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:17:02.361737 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 726/1479] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:17:02.367083 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce13d45-cc35-40a0-babe-e4818225c1f1 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:17:02.367534 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce13d45-cc35-40a0-babe-e4818225c1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:17:02.367641 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce13d45-cc35-40a0-babe-e4818225c1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:17:02.385423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-7ce13d45-cc35-40a0-babe-e4818225c1f1 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:17:02.387208 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-7ce13d45-cc35-40a0-babe-e4818225c1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:17:02.395296 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 754/1480] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:17:02.441041 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f92b3-7b8f-4e98-857f-445978f34b7a None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:17:02.456791 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f92b3-7b8f-4e98-857f-445978f34b7a None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:17:02.462719 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba295b8-231f-43e2-9199-1af079a3943f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:17:02.463306 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba295b8-231f-43e2-9199-1af079a3943f service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:17:02.463651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba295b8-231f-43e2-9199-1af079a3943f service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:17:02.464476 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba295b8-231f-43e2-9199-1af079a3943f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:17:02.474060 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba295b8-231f-43e2-9199-1af079a3943f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:17:02.475732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba295b8-231f-43e2-9199-1af079a3943f service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:17:02.486338 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 727/1481] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:17:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:17:04.947164 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1e5d7-c671-4f53-8096-89e8ae2d500c None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:17:04.947729 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1e5d7-c671-4f53-8096-89e8ae2d500c None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:17:04.947729 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1e5d7-c671-4f53-8096-89e8ae2d500c None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:17:04.949619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 755/1482] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:17:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:17:04.955322 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6c1b1-f00e-4986-965b-e1e832c981f5 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:17:04.955750 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6c1b1-f00e-4986-965b-e1e832c981f5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:17:04.955869 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6c1b1-f00e-4986-965b-e1e832c981f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:17:04.974630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-27a6c1b1-f00e-4986-965b-e1e832c981f5 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:17:04.975833 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-27a6c1b1-f00e-4986-965b-e1e832c981f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:17:04.984046 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 728/1483] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:17:05.021336 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1e5d7-c671-4f53-8096-89e8ae2d500c None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:17:05.032137 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1e5d7-c671-4f53-8096-89e8ae2d500c None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:17:05.035674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d9e93-b099-4ede-80c7-2a2175f4c076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:17:05.036380 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d9e93-b099-4ede-80c7-2a2175f4c076 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:17:05.036665 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d9e93-b099-4ede-80c7-2a2175f4c076 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:17:05.036942 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d9e93-b099-4ede-80c7-2a2175f4c076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:17:05.046301 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d9e93-b099-4ede-80c7-2a2175f4c076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:17:05.047734 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d9e93-b099-4ede-80c7-2a2175f4c076 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:17:05.057735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 756/1484] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:17:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:17:07.341919 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18e983-506d-40c6-b7d0-2492855bed5d None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:17:07.342493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18e983-506d-40c6-b7d0-2492855bed5d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:17:07.342493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18e983-506d-40c6-b7d0-2492855bed5d None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:17:07.343861 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 729/1485] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:17:07.349681 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6f56e-317e-425e-9efc-a3f34c0ab5ab None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:17:07.350310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6f56e-317e-425e-9efc-a3f34c0ab5ab None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:17:07.350310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6f56e-317e-425e-9efc-a3f34c0ab5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:17:07.370293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-01c6f56e-317e-425e-9efc-a3f34c0ab5ab None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:17:07.371493 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-01c6f56e-317e-425e-9efc-a3f34c0ab5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:17:07.379153 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 757/1486] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:17:07.418322 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18e983-506d-40c6-b7d0-2492855bed5d None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:17:07.429362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18e983-506d-40c6-b7d0-2492855bed5d None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:17:07.432945 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfd4cd-26b3-46d4-a49f-9c3225d8d6d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:17:07.433583 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfd4cd-26b3-46d4-a49f-9c3225d8d6d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:17:07.433866 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfd4cd-26b3-46d4-a49f-9c3225d8d6d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:17:07.434135 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfd4cd-26b3-46d4-a49f-9c3225d8d6d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:17:07.443313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfd4cd-26b3-46d4-a49f-9c3225d8d6d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:17:07.444761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfd4cd-26b3-46d4-a49f-9c3225d8d6d9 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:17:07.454398 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 730/1487] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:17:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:17:09.855969 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8bdf1-482e-45d5-b321-0855f281fa95 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:17:09.856591 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8bdf1-482e-45d5-b321-0855f281fa95 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:17:09.856591 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8bdf1-482e-45d5-b321-0855f281fa95 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:17:09.857874 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 758/1488] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:17:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:17:09.863211 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeee82b-5265-4af9-ae0f-05408685500a None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:17:09.863636 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeee82b-5265-4af9-ae0f-05408685500a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:17:09.863781 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeee82b-5265-4af9-ae0f-05408685500a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:17:09.881649 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-9eeee82b-5265-4af9-ae0f-05408685500a None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:17:09.882841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9eeee82b-5265-4af9-ae0f-05408685500a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:17:09.891203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 731/1489] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:17:09.931129 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8bdf1-482e-45d5-b321-0855f281fa95 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:17:09.941638 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8bdf1-482e-45d5-b321-0855f281fa95 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:17:09.945104 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778afceb-c2ce-49e6-83fe-ef957fb1b942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:17:09.945731 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778afceb-c2ce-49e6-83fe-ef957fb1b942 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:17:09.946006 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778afceb-c2ce-49e6-83fe-ef957fb1b942 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:17:09.946275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778afceb-c2ce-49e6-83fe-ef957fb1b942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:17:09.955974 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778afceb-c2ce-49e6-83fe-ef957fb1b942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:17:09.957499 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778afceb-c2ce-49e6-83fe-ef957fb1b942 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:17:09.967142 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 759/1490] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:17:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:17:12.606524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f0bff-ad6f-4281-92e0-185ab0a692e3 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:17:12.607108 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f0bff-ad6f-4281-92e0-185ab0a692e3 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:17:12.607217 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f0bff-ad6f-4281-92e0-185ab0a692e3 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:17:12.608579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 732/1491] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jun 2 19:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:17:12.614119 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75cad1-cbfd-4b13-9d85-5f3f07deaa41 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:17:12.614592 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75cad1-cbfd-4b13-9d85-5f3f07deaa41 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:17:12.614723 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75cad1-cbfd-4b13-9d85-5f3f07deaa41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:17:12.633022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-1e75cad1-cbfd-4b13-9d85-5f3f07deaa41 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:17:12.634207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-1e75cad1-cbfd-4b13-9d85-5f3f07deaa41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:17:12.642573 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 760/1492] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jun 2 19:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:17:12.681429 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f0bff-ad6f-4281-92e0-185ab0a692e3 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:17:12.692673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f0bff-ad6f-4281-92e0-185ab0a692e3 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:17:12.696244 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773ebf2-5ca0-47ed-ba2b-4dd0cff7fa46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:17:12.696882 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773ebf2-5ca0-47ed-ba2b-4dd0cff7fa46 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:17:12.697164 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773ebf2-5ca0-47ed-ba2b-4dd0cff7fa46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:17:12.697442 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773ebf2-5ca0-47ed-ba2b-4dd0cff7fa46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:17:12.707513 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773ebf2-5ca0-47ed-ba2b-4dd0cff7fa46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:17:12.709001 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773ebf2-5ca0-47ed-ba2b-4dd0cff7fa46 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:17:12.718979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 733/1493] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:17:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:17:22.627704 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=33 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:17:22.714382 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=33 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:18:47.120434 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca35e4-7d15-434e-9f12-612ee52a6ec6 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:18:47.121068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca35e4-7d15-434e-9f12-612ee52a6ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:18:47.121068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca35e4-7d15-434e-9f12-612ee52a6ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:18:47.138517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-a0ca35e4-7d15-434e-9f12-612ee52a6ec6 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:18:47.139701 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-a0ca35e4-7d15-434e-9f12-612ee52a6ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:18:47.147563 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 761/1494] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:18:47.155302 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90b50b-23a2-4d42-ac0b-910d515537eb None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:18:47.155780 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90b50b-23a2-4d42-ac0b-910d515537eb None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:18:47.155885 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90b50b-23a2-4d42-ac0b-910d515537eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:18:47.173787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-9b90b50b-23a2-4d42-ac0b-910d515537eb None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:18:47.174968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9b90b50b-23a2-4d42-ac0b-910d515537eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:18:47.183331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 734/1495] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:18:47.188106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca35e4-7d15-434e-9f12-612ee52a6ec6 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:18:47.198457 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca35e4-7d15-434e-9f12-612ee52a6ec6 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:18:47.203795 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04765b9-6761-4089-94f3-93b6bf4efc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:18:47.204517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04765b9-6761-4089-94f3-93b6bf4efc3a admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:18:47.204851 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04765b9-6761-4089-94f3-93b6bf4efc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:18:47.205120 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04765b9-6761-4089-94f3-93b6bf4efc3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:18:47.205835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04765b9-6761-4089-94f3-93b6bf4efc3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:18:47.206132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04765b9-6761-4089-94f3-93b6bf4efc3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:18:47.207365 dv-cinder-797608-28-smb devstack@keystone.service[80608]: WARNING py.warnings [None req-e04765b9-6761-4089-94f3-93b6bf4efc3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 19:18:47.207365 dv-cinder-797608-28-smb devstack@keystone.service[80608]: warnings.warn(msg) Jun 02 19:18:47.207365 dv-cinder-797608-28-smb devstack@keystone.service[80608]: Jun 02 19:18:47.208357 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04765b9-6761-4089-94f3-93b6bf4efc3a admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:18:47.220327 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 762/1496] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:18:47.229035 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90b50b-23a2-4d42-ac0b-910d515537eb None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:18:47.238177 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90b50b-23a2-4d42-ac0b-910d515537eb None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:18:47.242804 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d154daa-d05c-4c76-9c85-a3a32bf39172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:18:47.243452 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d154daa-d05c-4c76-9c85-a3a32bf39172 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:18:47.244395 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d154daa-d05c-4c76-9c85-a3a32bf39172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:18:47.244674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d154daa-d05c-4c76-9c85-a3a32bf39172 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:18:47.245364 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d154daa-d05c-4c76-9c85-a3a32bf39172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:18:47.247060 dv-cinder-797608-28-smb devstack@keystone.service[80609]: WARNING py.warnings [None req-0d154daa-d05c-4c76-9c85-a3a32bf39172 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 19:18:47.247060 dv-cinder-797608-28-smb devstack@keystone.service[80609]: warnings.warn(msg) Jun 02 19:18:47.247060 dv-cinder-797608-28-smb devstack@keystone.service[80609]: Jun 02 19:18:47.248275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d154daa-d05c-4c76-9c85-a3a32bf39172 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:18:47.362313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 735/1497] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:18:47 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:18:47.366675 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04765b9-6761-4089-94f3-93b6bf4efc3a admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:18:47.376710 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04765b9-6761-4089-94f3-93b6bf4efc3a admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:18:47.431124 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d296c-4415-4919-bf21-cc7f95a00504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:18:47.431790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d296c-4415-4919-bf21-cc7f95a00504 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:18:47.432098 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d296c-4415-4919-bf21-cc7f95a00504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:18:47.432373 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d296c-4415-4919-bf21-cc7f95a00504 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:18:47.433047 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d296c-4415-4919-bf21-cc7f95a00504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:18:47.434053 dv-cinder-797608-28-smb devstack@keystone.service[80608]: WARNING py.warnings [None req-647d296c-4415-4919-bf21-cc7f95a00504 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 19:18:47.434053 dv-cinder-797608-28-smb devstack@keystone.service[80608]: warnings.warn(msg) Jun 02 19:18:47.434053 dv-cinder-797608-28-smb devstack@keystone.service[80608]: Jun 02 19:18:47.435251 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d296c-4415-4919-bf21-cc7f95a00504 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:18:47.515011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 763/1498] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:18:47 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:18:47.519329 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d154daa-d05c-4c76-9c85-a3a32bf39172 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:18:47.529880 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d154daa-d05c-4c76-9c85-a3a32bf39172 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:18:47.534338 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c699c-0bcc-4ae1-b303-20f1e38e4f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:18:47.534963 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c699c-0bcc-4ae1-b303-20f1e38e4f2d admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:18:47.535239 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c699c-0bcc-4ae1-b303-20f1e38e4f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:18:47.535509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c699c-0bcc-4ae1-b303-20f1e38e4f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:18:47.536256 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c699c-0bcc-4ae1-b303-20f1e38e4f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:18:47.537254 dv-cinder-797608-28-smb devstack@keystone.service[80609]: WARNING py.warnings [None req-ea1c699c-0bcc-4ae1-b303-20f1e38e4f2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 19:18:47.537254 dv-cinder-797608-28-smb devstack@keystone.service[80609]: warnings.warn(msg) Jun 02 19:18:47.537254 dv-cinder-797608-28-smb devstack@keystone.service[80609]: Jun 02 19:18:47.538126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c699c-0bcc-4ae1-b303-20f1e38e4f2d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:18:47.551562 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 736/1499] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:18:47.555611 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d296c-4415-4919-bf21-cc7f95a00504 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:18:47.565988 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d296c-4415-4919-bf21-cc7f95a00504 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:18:47.570762 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f607d-41d8-4272-872d-21b5b2583a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:18:47.571459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f607d-41d8-4272-872d-21b5b2583a8c admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:18:47.571740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f607d-41d8-4272-872d-21b5b2583a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:18:47.572041 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f607d-41d8-4272-872d-21b5b2583a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:18:47.572768 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f607d-41d8-4272-872d-21b5b2583a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:18:47.573781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: WARNING py.warnings [None req-667f607d-41d8-4272-872d-21b5b2583a8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 19:18:47.573781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: warnings.warn(msg) Jun 02 19:18:47.573781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: Jun 02 19:18:47.574718 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f607d-41d8-4272-872d-21b5b2583a8c admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:18:47.588980 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 764/1500] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:18:47.593093 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c699c-0bcc-4ae1-b303-20f1e38e4f2d admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:18:47.602923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c699c-0bcc-4ae1-b303-20f1e38e4f2d admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:18:47.608015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb7c9f-eef3-47df-bed8-9e4e87570308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:18:47.608921 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb7c9f-eef3-47df-bed8-9e4e87570308 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:18:47.609207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb7c9f-eef3-47df-bed8-9e4e87570308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:18:47.609486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb7c9f-eef3-47df-bed8-9e4e87570308 admin admin] PATH_INFO: `/v3/projects/ff7eb017777449ae8538fbbd9670a4cb/users/7859a20d5f744931aba1424b89713659/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:18:47.624078 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb7c9f-eef3-47df-bed8-9e4e87570308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff7eb017777449ae8538fbbd9670a4cb, user_id=7859a20d5f744931aba1424b89713659, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:18:47.625113 dv-cinder-797608-28-smb devstack@keystone.service[80609]: WARNING py.warnings [None req-40eb7c9f-eef3-47df-bed8-9e4e87570308 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 19:18:47.625113 dv-cinder-797608-28-smb devstack@keystone.service[80609]: warnings.warn(msg) Jun 02 19:18:47.625113 dv-cinder-797608-28-smb devstack@keystone.service[80609]: Jun 02 19:18:47.627090 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb7c9f-eef3-47df-bed8-9e4e87570308 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:18:47.732618 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 737/1501] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:18:47 2022] PUT /identity/v3/projects/ff7eb017777449ae8538fbbd9670a4cb/users/7859a20d5f744931aba1424b89713659/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:18:47.744759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693972ec-31c9-4a03-99b2-98ff3a373927 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:18:47.746299 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693972ec-31c9-4a03-99b2-98ff3a373927 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:18:47.746299 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693972ec-31c9-4a03-99b2-98ff3a373927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:18:47.771854 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-693972ec-31c9-4a03-99b2-98ff3a373927 None None] MFA Rules not processed for user `7859a20d5f744931aba1424b89713659`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:18:47.773112 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-693972ec-31c9-4a03-99b2-98ff3a373927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:18:47.835909 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 765/1502] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:18:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:18:47.849777 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9105c74-25d3-48fc-bc48-847b523086c6 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:18:47.855021 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9105c74-25d3-48fc-bc48-847b523086c6 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:18:47.855021 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9105c74-25d3-48fc-bc48-847b523086c6 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:18:47.855021 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 738/1503] 10.222.0.45 () {54 vars in 963 bytes} [Thu Jun 2 19:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:18:47.856610 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d372f-f7c3-407b-8310-097ccc5bb350 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:18:47.856903 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d372f-f7c3-407b-8310-097ccc5bb350 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:18:47.857251 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d372f-f7c3-407b-8310-097ccc5bb350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:18:47.875177 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-e35d372f-f7c3-407b-8310-097ccc5bb350 None None] MFA Rules not processed for user `abb1dec309904b009271f36cd9157511`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:18:47.876414 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-e35d372f-f7c3-407b-8310-097ccc5bb350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:18:47.921106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:18:47.928625 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 766/1504] 10.222.0.45 () {58 vars in 1060 bytes} [Thu Jun 2 19:18:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:18:47.936432 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9105c74-25d3-48fc-bc48-847b523086c6 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:18:47.947732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9105c74-25d3-48fc-bc48-847b523086c6 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:18:47.951275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6e176-6dd4-4c19-ba77-c289b19d8267 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:18:47.951909 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6e176-6dd4-4c19-ba77-c289b19d8267 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:18:47.952494 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6e176-6dd4-4c19-ba77-c289b19d8267 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:18:47.952748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6e176-6dd4-4c19-ba77-c289b19d8267 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:18:47.961062 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6e176-6dd4-4c19-ba77-c289b19d8267 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:18:47.963099 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6e176-6dd4-4c19-ba77-c289b19d8267 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:18:47.972409 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 739/1505] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:18:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:18:48.014399 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b6c35-a4ab-43d4-b3f7-138a6b6076fa None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:18:48.014698 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b6c35-a4ab-43d4-b3f7-138a6b6076fa None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:18:48.014977 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b6c35-a4ab-43d4-b3f7-138a6b6076fa None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:18:48.016349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 767/1506] 10.222.0.45 () {52 vars in 829 bytes} [Thu Jun 2 19:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:18:48.020128 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6e176-6dd4-4c19-ba77-c289b19d8267 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:18:48.083011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6e176-6dd4-4c19-ba77-c289b19d8267 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:18:48.088409 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004d752-e405-4b9a-9bdb-3c9fb5f63b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:18:48.089280 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004d752-e405-4b9a-9bdb-3c9fb5f63b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:18:48.089557 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004d752-e405-4b9a-9bdb-3c9fb5f63b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:18:48.089827 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004d752-e405-4b9a-9bdb-3c9fb5f63b90 admin admin] PATH_INFO: `/v3/users/7859a20d5f744931aba1424b89713659` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:18:48.091049 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b004d752-e405-4b9a-9bdb-3c9fb5f63b90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7859a20d5f744931aba1424b89713659)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:18:48.092090 dv-cinder-797608-28-smb devstack@keystone.service[80609]: WARNING py.warnings [None req-b004d752-e405-4b9a-9bdb-3c9fb5f63b90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 19:18:48.092090 dv-cinder-797608-28-smb devstack@keystone.service[80609]: warnings.warn(msg) Jun 02 19:18:48.092090 dv-cinder-797608-28-smb devstack@keystone.service[80609]: Jun 02 19:18:48.093292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b004d752-e405-4b9a-9bdb-3c9fb5f63b90 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:18:48.327575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b004d752-e405-4b9a-9bdb-3c9fb5f63b90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7859a20d5f744931aba1424b89713659'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:18:48.340146 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b004d752-e405-4b9a-9bdb-3c9fb5f63b90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7859a20d5f744931aba1424b89713659'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:18:48.340805 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b004d752-e405-4b9a-9bdb-3c9fb5f63b90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7859a20d5f744931aba1424b89713659'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:18:48.341516 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b004d752-e405-4b9a-9bdb-3c9fb5f63b90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7859a20d5f744931aba1424b89713659'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:18:48.361658 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b004d752-e405-4b9a-9bdb-3c9fb5f63b90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7859a20d5f744931aba1424b89713659'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:18:48.365613 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:18:48.446035 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 740/1507] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:18:48 2022] DELETE /identity/v3/users/7859a20d5f744931aba1424b89713659 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:18:48.451092 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13f725-2f6e-49a9-9a44-7af53a9f31e6 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:18:48.451566 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13f725-2f6e-49a9-9a44-7af53a9f31e6 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:18:48.451683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13f725-2f6e-49a9-9a44-7af53a9f31e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:18:48.470283 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-3f13f725-2f6e-49a9-9a44-7af53a9f31e6 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:18:48.471765 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-3f13f725-2f6e-49a9-9a44-7af53a9f31e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:18:48.529676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 768/1508] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:18:48.539108 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004d752-e405-4b9a-9bdb-3c9fb5f63b90 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:18:48.540539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b004d752-e405-4b9a-9bdb-3c9fb5f63b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:18:48.598357 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004d752-e405-4b9a-9bdb-3c9fb5f63b90 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:18:48.602237 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5078b03-9b47-4574-bb53-c98e7ad1d79a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:18:48.602899 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5078b03-9b47-4574-bb53-c98e7ad1d79a service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:18:48.603184 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5078b03-9b47-4574-bb53-c98e7ad1d79a service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:18:48.603461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5078b03-9b47-4574-bb53-c98e7ad1d79a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:18:48.612750 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5078b03-9b47-4574-bb53-c98e7ad1d79a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:18:48.614182 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5078b03-9b47-4574-bb53-c98e7ad1d79a service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:18:48.623516 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 741/1509] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:18:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:18:49.070811 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13f725-2f6e-49a9-9a44-7af53a9f31e6 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:18:49.072812 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-3f13f725-2f6e-49a9-9a44-7af53a9f31e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:18:49.085452 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13f725-2f6e-49a9-9a44-7af53a9f31e6 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:18:49.090689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f055c5f-5e1d-4b1c-9914-6c3187e57dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:18:49.091594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f055c5f-5e1d-4b1c-9914-6c3187e57dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:18:49.091887 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f055c5f-5e1d-4b1c-9914-6c3187e57dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:18:49.092828 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f055c5f-5e1d-4b1c-9914-6c3187e57dc8 admin admin] PATH_INFO: `/v3/projects/ff7eb017777449ae8538fbbd9670a4cb` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:18:49.093673 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f055c5f-5e1d-4b1c-9914-6c3187e57dc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff7eb017777449ae8538fbbd9670a4cb)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:18:49.094704 dv-cinder-797608-28-smb devstack@keystone.service[80608]: WARNING py.warnings [None req-4f055c5f-5e1d-4b1c-9914-6c3187e57dc8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 19:18:49.094704 dv-cinder-797608-28-smb devstack@keystone.service[80608]: warnings.warn(msg) Jun 02 19:18:49.094704 dv-cinder-797608-28-smb devstack@keystone.service[80608]: Jun 02 19:18:49.095957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f055c5f-5e1d-4b1c-9914-6c3187e57dc8 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:18:49.218993 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4f055c5f-5e1d-4b1c-9914-6c3187e57dc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff7eb017777449ae8538fbbd9670a4cb', 'request_id': 'req-4f055c5f-5e1d-4b1c-9914-6c3187e57dc8'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:18:49.297283 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4f055c5f-5e1d-4b1c-9914-6c3187e57dc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff7eb017777449ae8538fbbd9670a4cb', 'request_id': 'req-4f055c5f-5e1d-4b1c-9914-6c3187e57dc8'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:18:49.304320 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4f055c5f-5e1d-4b1c-9914-6c3187e57dc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff7eb017777449ae8538fbbd9670a4cb', 'request_id': 'req-4f055c5f-5e1d-4b1c-9914-6c3187e57dc8'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:18:49.324798 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4f055c5f-5e1d-4b1c-9914-6c3187e57dc8 admin admin] The token cache is being invalidate because project ff7eb017777449ae8538fbbd9670a4cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:18:49.325088 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4f055c5f-5e1d-4b1c-9914-6c3187e57dc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:18:49.325896 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4f055c5f-5e1d-4b1c-9914-6c3187e57dc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:18:49.327739 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 769/1510] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:18:49 2022] DELETE /identity/v3/projects/ff7eb017777449ae8538fbbd9670a4cb => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:18:58.619375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:18:59.322098 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:20:33.300474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bb513-4d9f-4161-b21f-90ba369ebf27 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:33.301079 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bb513-4d9f-4161-b21f-90ba369ebf27 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:33.301079 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bb513-4d9f-4161-b21f-90ba369ebf27 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:33.302394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 742/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 19:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:20:33.308037 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8151f80-4e41-45bc-a3f9-c955e25847af None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:33.308511 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8151f80-4e41-45bc-a3f9-c955e25847af None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:33.308618 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8151f80-4e41-45bc-a3f9-c955e25847af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:33.327871 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-e8151f80-4e41-45bc-a3f9-c955e25847af None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:20:33.329182 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-e8151f80-4e41-45bc-a3f9-c955e25847af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:20:33.392491 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 770/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 19:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:20:33.566615 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bb513-4d9f-4161-b21f-90ba369ebf27 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:20:33.568482 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b13bb513-4d9f-4161-b21f-90ba369ebf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:20:33.640779 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bb513-4d9f-4161-b21f-90ba369ebf27 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:20:33.646035 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05a5da-5881-4131-9762-d207b47e1779 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:20:33.646674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05a5da-5881-4131-9762-d207b47e1779 service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:33.646952 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05a5da-5881-4131-9762-d207b47e1779 service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:33.647233 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05a5da-5881-4131-9762-d207b47e1779 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:33.655478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05a5da-5881-4131-9762-d207b47e1779 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:20:33.657089 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05a5da-5881-4131-9762-d207b47e1779 service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:20:33.666863 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 743/1513] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:20:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:20:34.563177 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337d83e-9e7e-4069-a7be-275553ac4810 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:34.563791 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337d83e-9e7e-4069-a7be-275553ac4810 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:34.563791 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337d83e-9e7e-4069-a7be-275553ac4810 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:34.565183 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 771/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 19:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:20:34.570308 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181230fe-4554-4b4a-bc73-d4bf84d39cf0 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:34.570841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181230fe-4554-4b4a-bc73-d4bf84d39cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:34.570841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181230fe-4554-4b4a-bc73-d4bf84d39cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:34.589701 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-181230fe-4554-4b4a-bc73-d4bf84d39cf0 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:20:34.590896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-181230fe-4554-4b4a-bc73-d4bf84d39cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:20:34.598833 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 744/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 19:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:20:34.753228 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337d83e-9e7e-4069-a7be-275553ac4810 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:20:34.778062 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337d83e-9e7e-4069-a7be-275553ac4810 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:20:34.787036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be550327-400a-48c3-8098-dbaf6e9c83b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:20:34.788168 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be550327-400a-48c3-8098-dbaf6e9c83b9 service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:34.788661 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be550327-400a-48c3-8098-dbaf6e9c83b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:34.789135 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be550327-400a-48c3-8098-dbaf6e9c83b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:34.800236 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119afeea-c16a-4570-8aca-01179d78bd73 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:34.800574 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119afeea-c16a-4570-8aca-01179d78bd73 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:34.800916 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119afeea-c16a-4570-8aca-01179d78bd73 None None] PATH_INFO: `/v3` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:34.801229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be550327-400a-48c3-8098-dbaf6e9c83b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:20:34.802418 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 745/1516] 10.222.0.48 () {54 vars in 925 bytes} [Thu Jun 2 19:20:34 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:20:34.802922 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be550327-400a-48c3-8098-dbaf6e9c83b9 service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:20:34.810350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848fba4-6713-4e16-8fd6-85b8746a5417 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:34.810935 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848fba4-6713-4e16-8fd6-85b8746a5417 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:34.811465 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848fba4-6713-4e16-8fd6-85b8746a5417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:34.813540 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 772/1517] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:20:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:20:34.837213 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-5848fba4-6713-4e16-8fd6-85b8746a5417 None None] MFA Rules not processed for user `3ebc95c1b3284c1d8321900cf442a811`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:20:34.838624 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5848fba4-6713-4e16-8fd6-85b8746a5417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:20:34.919002 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 746/1518] 10.222.0.48 () {58 vars in 1015 bytes} [Thu Jun 2 19:20:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:20:39.330360 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4214f-92c2-49bf-9d88-74d5e9bde376 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:39.330913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4214f-92c2-49bf-9d88-74d5e9bde376 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:39.330913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4214f-92c2-49bf-9d88-74d5e9bde376 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:39.332333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 773/1519] 10.222.0.45 () {54 vars in 960 bytes} [Thu Jun 2 19:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:20:39.338178 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac4f7e-4ed3-4579-a891-c964e382c7ac None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:39.338805 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac4f7e-4ed3-4579-a891-c964e382c7ac None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:39.338805 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac4f7e-4ed3-4579-a891-c964e382c7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:39.357653 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-faac4f7e-4ed3-4579-a891-c964e382c7ac None None] MFA Rules not processed for user `3ebc95c1b3284c1d8321900cf442a811`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:20:39.358849 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-faac4f7e-4ed3-4579-a891-c964e382c7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:20:39.367583 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 747/1520] 10.222.0.45 () {58 vars in 1057 bytes} [Thu Jun 2 19:20:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:20:39.375707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4214f-92c2-49bf-9d88-74d5e9bde376 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:20:39.389480 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4214f-92c2-49bf-9d88-74d5e9bde376 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:20:39.395062 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea756d-cd91-4331-b804-8a80951ad040 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ebc95c1b3284c1d8321900cf442a811', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:20:39.395702 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea756d-cd91-4331-b804-8a80951ad040 service placement] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:39.395988 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea756d-cd91-4331-b804-8a80951ad040 service placement] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:39.396296 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea756d-cd91-4331-b804-8a80951ad040 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:39.406360 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea756d-cd91-4331-b804-8a80951ad040 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:20:39.407965 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea756d-cd91-4331-b804-8a80951ad040 service placement] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:20:39.418579 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 774/1521] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:20:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:20:46.197728 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc98a1-e69e-428e-9305-22463c1f8556 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:46.198375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc98a1-e69e-428e-9305-22463c1f8556 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:46.198375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc98a1-e69e-428e-9305-22463c1f8556 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:46.199670 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 748/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 19:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:20:46.205705 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b4143-0aa8-42e7-a7ef-0179d0f2e1bd None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:46.206305 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b4143-0aa8-42e7-a7ef-0179d0f2e1bd None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:46.206305 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b4143-0aa8-42e7-a7ef-0179d0f2e1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:46.226258 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-3c3b4143-0aa8-42e7-a7ef-0179d0f2e1bd None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:20:46.228214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-3c3b4143-0aa8-42e7-a7ef-0179d0f2e1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:20:46.236710 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 775/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 19:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:20:46.391472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc98a1-e69e-428e-9305-22463c1f8556 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:20:46.407098 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc98a1-e69e-428e-9305-22463c1f8556 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:20:46.413209 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b46046-4fb6-48bc-8191-5d6b09b5a3a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:20:46.413928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b46046-4fb6-48bc-8191-5d6b09b5a3a6 service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:46.414843 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b46046-4fb6-48bc-8191-5d6b09b5a3a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:46.415158 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b46046-4fb6-48bc-8191-5d6b09b5a3a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:46.424742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b46046-4fb6-48bc-8191-5d6b09b5a3a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:20:46.426386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b46046-4fb6-48bc-8191-5d6b09b5a3a6 service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:20:46.438044 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 749/1524] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:20:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:20:47.391951 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045f73a-2c0b-48a9-931b-8c082e645298 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:47.392605 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045f73a-2c0b-48a9-931b-8c082e645298 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:47.392974 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045f73a-2c0b-48a9-931b-8c082e645298 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:47.395570 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 776/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 19:20:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:20:47.401992 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af544d-5bd2-4b56-808e-b2457341d32e None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:47.402634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af544d-5bd2-4b56-808e-b2457341d32e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:47.402634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af544d-5bd2-4b56-808e-b2457341d32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:47.423378 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-a9af544d-5bd2-4b56-808e-b2457341d32e None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:20:47.424718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a9af544d-5bd2-4b56-808e-b2457341d32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:20:47.433841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 750/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 19:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:20:47.593955 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045f73a-2c0b-48a9-931b-8c082e645298 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:20:47.609834 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045f73a-2c0b-48a9-931b-8c082e645298 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:20:47.616217 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790ac79-e5d0-4e12-826a-30c613417605 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:20:47.617105 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790ac79-e5d0-4e12-826a-30c613417605 service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:47.618019 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790ac79-e5d0-4e12-826a-30c613417605 service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:47.618397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790ac79-e5d0-4e12-826a-30c613417605 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:47.628076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4790ac79-e5d0-4e12-826a-30c613417605 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:20:47.629747 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4790ac79-e5d0-4e12-826a-30c613417605 service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:20:47.641301 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 777/1527] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:20:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:20:52.108137 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2285b2-0707-4a85-abb0-b525e23b0da4 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:52.108899 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2285b2-0707-4a85-abb0-b525e23b0da4 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:52.108899 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2285b2-0707-4a85-abb0-b525e23b0da4 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:52.110091 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 751/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 19:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:20:52.116607 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127faafa-9fc2-407a-bde1-386a1323247c None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:52.117777 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127faafa-9fc2-407a-bde1-386a1323247c None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:52.117944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127faafa-9fc2-407a-bde1-386a1323247c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:52.137694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-127faafa-9fc2-407a-bde1-386a1323247c None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:20:52.139004 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-127faafa-9fc2-407a-bde1-386a1323247c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:20:52.147490 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 778/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 19:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:20:52.189440 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2285b2-0707-4a85-abb0-b525e23b0da4 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:20:52.191243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-bb2285b2-0707-4a85-abb0-b525e23b0da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:20:52.250872 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:20:52.255564 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2285b2-0707-4a85-abb0-b525e23b0da4 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:20:52.259404 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc7110-453b-47e9-a8ce-9bcb8f0e24e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:20:52.260096 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc7110-453b-47e9-a8ce-9bcb8f0e24e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:52.260377 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc7110-453b-47e9-a8ce-9bcb8f0e24e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:52.260651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc7110-453b-47e9-a8ce-9bcb8f0e24e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:52.271454 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc7110-453b-47e9-a8ce-9bcb8f0e24e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:20:52.273120 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc7110-453b-47e9-a8ce-9bcb8f0e24e9 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:20:52.283747 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 752/1530] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:20:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:20:54.698217 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa5d7d-f4e4-4199-9621-eb8dda31703c None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:54.706456 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa5d7d-f4e4-4199-9621-eb8dda31703c None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:54.706456 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa5d7d-f4e4-4199-9621-eb8dda31703c None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:54.706456 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 779/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 19:20:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:20:54.706981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b742f1f-e115-4ac3-ba7a-aeb34de61195 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:54.707684 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b742f1f-e115-4ac3-ba7a-aeb34de61195 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:54.707684 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b742f1f-e115-4ac3-ba7a-aeb34de61195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:54.728883 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-5b742f1f-e115-4ac3-ba7a-aeb34de61195 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:20:54.730570 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5b742f1f-e115-4ac3-ba7a-aeb34de61195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:20:54.739603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 753/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 19:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:20:54.778566 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa5d7d-f4e4-4199-9621-eb8dda31703c None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:20:54.790184 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa5d7d-f4e4-4199-9621-eb8dda31703c None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:20:54.794416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152555ad-f97e-4b8c-aba2-32b2f8cdaa12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:20:54.795090 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152555ad-f97e-4b8c-aba2-32b2f8cdaa12 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:54.795363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152555ad-f97e-4b8c-aba2-32b2f8cdaa12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:54.795709 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152555ad-f97e-4b8c-aba2-32b2f8cdaa12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:54.807639 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152555ad-f97e-4b8c-aba2-32b2f8cdaa12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:20:54.809224 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152555ad-f97e-4b8c-aba2-32b2f8cdaa12 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:20:54.821299 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 780/1533] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:20:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:20:58.936092 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a357a7-1046-4e60-9dd5-1a1088ea7f00 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:58.936743 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a357a7-1046-4e60-9dd5-1a1088ea7f00 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:58.937110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a357a7-1046-4e60-9dd5-1a1088ea7f00 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:58.939854 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 754/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 19:20:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:20:58.945982 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a9eb0-7b24-402e-8f16-cedf5fe87275 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:58.946586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a9eb0-7b24-402e-8f16-cedf5fe87275 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:58.946586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a9eb0-7b24-402e-8f16-cedf5fe87275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:58.967338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-257a9eb0-7b24-402e-8f16-cedf5fe87275 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:20:58.968837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-257a9eb0-7b24-402e-8f16-cedf5fe87275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:20:58.978142 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 781/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 19:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:20:59.265888 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a357a7-1046-4e60-9dd5-1a1088ea7f00 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:20:59.267662 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-23a357a7-1046-4e60-9dd5-1a1088ea7f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:20:59.344768 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a357a7-1046-4e60-9dd5-1a1088ea7f00 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:20:59.348898 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b474913-9d77-405f-974f-844785ebf412 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:20:59.349633 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b474913-9d77-405f-974f-844785ebf412 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:59.349934 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b474913-9d77-405f-974f-844785ebf412 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:59.350207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b474913-9d77-405f-974f-844785ebf412 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:59.364169 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b474913-9d77-405f-974f-844785ebf412 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:20:59.365709 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b474913-9d77-405f-974f-844785ebf412 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:20:59.376739 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 755/1536] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:20:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:21:01.807411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964cf64-e1d9-400d-a175-98b9f037a86d None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:21:01.808059 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964cf64-e1d9-400d-a175-98b9f037a86d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:21:01.808059 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964cf64-e1d9-400d-a175-98b9f037a86d None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:21:01.809452 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 782/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 19:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:21:01.816642 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd7667-2d5c-45f6-8188-b85d446e5e46 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:21:01.817263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd7667-2d5c-45f6-8188-b85d446e5e46 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:21:01.817614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd7667-2d5c-45f6-8188-b85d446e5e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:21:01.852377 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f9bd7667-2d5c-45f6-8188-b85d446e5e46 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:21:01.854512 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f9bd7667-2d5c-45f6-8188-b85d446e5e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:21:01.867146 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 756/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 19:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:21:02.157438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964cf64-e1d9-400d-a175-98b9f037a86d None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:21:02.160619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-1964cf64-e1d9-400d-a175-98b9f037a86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:21:02.173839 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=61 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:21:02.183485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964cf64-e1d9-400d-a175-98b9f037a86d None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:21:02.189174 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c8243-f5ff-4244-ae9c-292fafe675c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:21:02.190265 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c8243-f5ff-4244-ae9c-292fafe675c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:21:02.190766 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c8243-f5ff-4244-ae9c-292fafe675c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:21:02.191248 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c8243-f5ff-4244-ae9c-292fafe675c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:21:02.207458 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c8243-f5ff-4244-ae9c-292fafe675c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:21:02.209953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c8243-f5ff-4244-ae9c-292fafe675c5 service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:21:02.228325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 783/1539] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:21:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:21:11.841284 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=36 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:21:12.219428 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=5 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:46.261074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bfc46-5331-4ceb-960e-ac0be470b9f8 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:46.262915 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bfc46-5331-4ceb-960e-ac0be470b9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:46.263739 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bfc46-5331-4ceb-960e-ac0be470b9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:46.313803 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-656bfc46-5331-4ceb-960e-ac0be470b9f8 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:46.315628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-656bfc46-5331-4ceb-960e-ac0be470b9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:46.325693 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 757/1540] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:46.338615 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a925b-6c2d-433c-ae14-84d3a7ca40d6 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:46.339224 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a925b-6c2d-433c-ae14-84d3a7ca40d6 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:46.339224 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a925b-6c2d-433c-ae14-84d3a7ca40d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:46.366263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-c07a925b-6c2d-433c-ae14-84d3a7ca40d6 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:46.367412 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c07a925b-6c2d-433c-ae14-84d3a7ca40d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:46.369049 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391d697-00c4-43b7-9db1-c96c38ce23be None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:46.369594 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391d697-00c4-43b7-9db1-c96c38ce23be None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:46.370105 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391d697-00c4-43b7-9db1-c96c38ce23be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:46.384909 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 784/1541] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:46.386255 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2572a4d-c194-4911-8245-78837ffb6a14 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:46.386541 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2572a4d-c194-4911-8245-78837ffb6a14 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:46.386821 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2572a4d-c194-4911-8245-78837ffb6a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:46.404641 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-4391d697-00c4-43b7-9db1-c96c38ce23be None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:46.406496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4391d697-00c4-43b7-9db1-c96c38ce23be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:46.414134 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-d2572a4d-c194-4911-8245-78837ffb6a14 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:46.415428 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-d2572a4d-c194-4911-8245-78837ffb6a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:46.440475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 785/1542] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:46.440475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2572a4d-c194-4911-8245-78837ffb6a14 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:46.444877 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 758/1543] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:46.448743 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb09de-3ac5-4e83-bef1-d2d97f9c1c26 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:46.449656 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb09de-3ac5-4e83-bef1-d2d97f9c1c26 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:46.450347 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb09de-3ac5-4e83-bef1-d2d97f9c1c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:46.473662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2572a4d-c194-4911-8245-78837ffb6a14 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:46.492310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af15a2-adb2-4390-a879-fe4ca318ff3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:46.493605 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af15a2-adb2-4390-a879-fe4ca318ff3f admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:46.493892 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af15a2-adb2-4390-a879-fe4ca318ff3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:46.494165 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af15a2-adb2-4390-a879-fe4ca318ff3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:46.494917 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af15a2-adb2-4390-a879-fe4ca318ff3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:22:46.495222 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af15a2-adb2-4390-a879-fe4ca318ff3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:46.496942 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af15a2-adb2-4390-a879-fe4ca318ff3f admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:46.507284 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-09bb09de-3ac5-4e83-bef1-d2d97f9c1c26 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:46.510678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-09bb09de-3ac5-4e83-bef1-d2d97f9c1c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:46.529087 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 786/1544] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:22:46.531856 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b054d2-1ead-4371-8fe4-a89b1bba2068 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:46.532397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b054d2-1ead-4371-8fe4-a89b1bba2068 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:46.532891 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b054d2-1ead-4371-8fe4-a89b1bba2068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:46.540344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 759/1545] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:46.543655 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff492fc7-0e63-4dd3-96ef-bf2e48c51eed None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:46.544603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff492fc7-0e63-4dd3-96ef-bf2e48c51eed None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:46.545480 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff492fc7-0e63-4dd3-96ef-bf2e48c51eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:46.580402 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-43b054d2-1ead-4371-8fe4-a89b1bba2068 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:46.581629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-43b054d2-1ead-4371-8fe4-a89b1bba2068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:46.605491 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 787/1546] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:46.606356 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b054d2-1ead-4371-8fe4-a89b1bba2068 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:46.607119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-ff492fc7-0e63-4dd3-96ef-bf2e48c51eed None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:46.613328 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ff492fc7-0e63-4dd3-96ef-bf2e48c51eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:46.622383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b054d2-1ead-4371-8fe4-a89b1bba2068 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:46.630662 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 760/1547] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:46.634164 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5fa85-6838-4ae9-95a5-87c21d679275 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:46.634563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5fa85-6838-4ae9-95a5-87c21d679275 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:46.634744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5fa85-6838-4ae9-95a5-87c21d679275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:46.635597 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746781b-6bd0-446d-a723-17098b2226ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:46.636298 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746781b-6bd0-446d-a723-17098b2226ee admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:46.637125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746781b-6bd0-446d-a723-17098b2226ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:46.637125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746781b-6bd0-446d-a723-17098b2226ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:46.637629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746781b-6bd0-446d-a723-17098b2226ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:46.638585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: WARNING py.warnings [None req-7746781b-6bd0-446d-a723-17098b2226ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 19:22:46.638585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: warnings.warn(msg) Jun 02 19:22:46.638585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: Jun 02 19:22:46.641579 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746781b-6bd0-446d-a723-17098b2226ee admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:46.664542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-c7e5fa85-6838-4ae9-95a5-87c21d679275 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:46.666722 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c7e5fa85-6838-4ae9-95a5-87c21d679275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:46.682806 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 761/1548] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:46.685424 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6d4c4-6a95-414c-95d7-c91c2207c49e None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:46.685919 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6d4c4-6a95-414c-95d7-c91c2207c49e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:46.686416 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6d4c4-6a95-414c-95d7-c91c2207c49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:46.719003 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-01a6d4c4-6a95-414c-95d7-c91c2207c49e None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:46.724778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-01a6d4c4-6a95-414c-95d7-c91c2207c49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:46.735822 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 762/1549] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:46.737659 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6d4c4-6a95-414c-95d7-c91c2207c49e None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:46.755013 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6d4c4-6a95-414c-95d7-c91c2207c49e None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:46.762378 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77ee30-759f-4ce5-9fc4-47229ef20eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:46.763516 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77ee30-759f-4ce5-9fc4-47229ef20eed admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:46.764043 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77ee30-759f-4ce5-9fc4-47229ef20eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:46.764562 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77ee30-759f-4ce5-9fc4-47229ef20eed admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:46.765999 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77ee30-759f-4ce5-9fc4-47229ef20eed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:22:46.766538 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77ee30-759f-4ce5-9fc4-47229ef20eed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:46.768563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: WARNING py.warnings [None req-7a77ee30-759f-4ce5-9fc4-47229ef20eed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 19:22:46.768563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: warnings.warn(msg) Jun 02 19:22:46.768563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: Jun 02 19:22:46.770299 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77ee30-759f-4ce5-9fc4-47229ef20eed admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:46.794153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 763/1550] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:22:46.794153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77ee30-759f-4ce5-9fc4-47229ef20eed admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:46.806290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 788/1551] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:22:46 2022] POST /identity/v3/projects => generated 391 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:22:46.806290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe433f6-0460-4de6-933f-a49b1d2b1c00 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:46.806290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe433f6-0460-4de6-933f-a49b1d2b1c00 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:46.806290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe433f6-0460-4de6-933f-a49b1d2b1c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:46.811530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77ee30-759f-4ce5-9fc4-47229ef20eed admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:46.833601 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-bfe433f6-0460-4de6-933f-a49b1d2b1c00 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:46.835782 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-bfe433f6-0460-4de6-933f-a49b1d2b1c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:46.884942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b163dd-9ee0-4b5a-88c1-2d845c087492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:46.884942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b163dd-9ee0-4b5a-88c1-2d845c087492 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:46.884942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b163dd-9ee0-4b5a-88c1-2d845c087492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:46.885409 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b163dd-9ee0-4b5a-88c1-2d845c087492 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:46.886754 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b163dd-9ee0-4b5a-88c1-2d845c087492 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:22:46.887334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b163dd-9ee0-4b5a-88c1-2d845c087492 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:46.890664 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b163dd-9ee0-4b5a-88c1-2d845c087492 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:46.910498 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 789/1552] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:46.912359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15a199-8244-46f8-ac77-873b1af8120f None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:46.912513 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 764/1553] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:22:46.912947 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15a199-8244-46f8-ac77-873b1af8120f None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:46.913501 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15a199-8244-46f8-ac77-873b1af8120f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:46.913962 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b163dd-9ee0-4b5a-88c1-2d845c087492 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:46.929641 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b163dd-9ee0-4b5a-88c1-2d845c087492 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:46.936714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a89afe-2cb8-4407-b2be-f3a584a3eb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:46.936714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a89afe-2cb8-4407-b2be-f3a584a3eb6b admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:46.937802 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a89afe-2cb8-4407-b2be-f3a584a3eb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:46.937802 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a89afe-2cb8-4407-b2be-f3a584a3eb6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:46.937951 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a89afe-2cb8-4407-b2be-f3a584a3eb6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:22:46.938206 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a89afe-2cb8-4407-b2be-f3a584a3eb6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:46.939880 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a89afe-2cb8-4407-b2be-f3a584a3eb6b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:46.940619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-df15a199-8244-46f8-ac77-873b1af8120f None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:46.941841 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-df15a199-8244-46f8-ac77-873b1af8120f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:46.959914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 790/1554] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:46.959914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d16f5-0522-42b3-b238-f281abd5b144 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:46.959914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d16f5-0522-42b3-b238-f281abd5b144 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:46.959914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d16f5-0522-42b3-b238-f281abd5b144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:46.960457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 765/1555] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:22:46.960457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461a929-f21f-4df1-9eac-63e839c25571 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:46.960457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461a929-f21f-4df1-9eac-63e839c25571 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:46.960457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461a929-f21f-4df1-9eac-63e839c25571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:46.984138 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-d29d16f5-0522-42b3-b238-f281abd5b144 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:46.985441 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-d29d16f5-0522-42b3-b238-f281abd5b144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:46.996823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f461a929-f21f-4df1-9eac-63e839c25571 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:46.998135 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 791/1556] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:46.999238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f461a929-f21f-4df1-9eac-63e839c25571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:47.000080 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d16f5-0522-42b3-b238-f281abd5b144 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:47.013135 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d16f5-0522-42b3-b238-f281abd5b144 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:47.018659 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 766/1557] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:47.018659 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461a929-f21f-4df1-9eac-63e839c25571 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:47.022127 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f7ce9-82e8-4b38-96ce-9d608d12f20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:47.022816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f7ce9-82e8-4b38-96ce-9d608d12f20d admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:47.023096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f7ce9-82e8-4b38-96ce-9d608d12f20d admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:47.023372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f7ce9-82e8-4b38-96ce-9d608d12f20d admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:47.024146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f7ce9-82e8-4b38-96ce-9d608d12f20d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:47.026327 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f7ce9-82e8-4b38-96ce-9d608d12f20d admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:47.035217 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461a929-f21f-4df1-9eac-63e839c25571 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:47.043384 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2a839-53dd-42c0-88d4-6442d831d723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:47.044735 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2a839-53dd-42c0-88d4-6442d831d723 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:47.045243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2a839-53dd-42c0-88d4-6442d831d723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:47.045738 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2a839-53dd-42c0-88d4-6442d831d723 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:47.047069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2a839-53dd-42c0-88d4-6442d831d723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:47.049181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: WARNING py.warnings [None req-c7b2a839-53dd-42c0-88d4-6442d831d723 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 19:22:47.049181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: warnings.warn(msg) Jun 02 19:22:47.049181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: Jun 02 19:22:47.051570 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2a839-53dd-42c0-88d4-6442d831d723 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:47.165868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 792/1558] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:22:46 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:22:47.168081 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d653c-724d-41b7-9ee8-33916ebd0b44 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:47.168584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d653c-724d-41b7-9ee8-33916ebd0b44 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:47.169060 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d653c-724d-41b7-9ee8-33916ebd0b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:47.172514 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 767/1559] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:22:47 2022] POST /identity/v3/users => generated 296 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:22:47.174220 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2a839-53dd-42c0-88d4-6442d831d723 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:47.188703 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2a839-53dd-42c0-88d4-6442d831d723 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:47.194460 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-143d653c-724d-41b7-9ee8-33916ebd0b44 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:47.195730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-143d653c-724d-41b7-9ee8-33916ebd0b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:47.254431 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83daf12e-3e1b-48f4-be1b-9d9cf88d6531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:47.255109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daf12e-3e1b-48f4-be1b-9d9cf88d6531 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:47.255410 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daf12e-3e1b-48f4-be1b-9d9cf88d6531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:47.255946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daf12e-3e1b-48f4-be1b-9d9cf88d6531 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:47.256690 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83daf12e-3e1b-48f4-be1b-9d9cf88d6531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:47.258657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83daf12e-3e1b-48f4-be1b-9d9cf88d6531 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:47.267449 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:47.270307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 793/1560] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:47.271695 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80433781-5ba6-486c-89dd-9a685dc1c05c None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:47.271981 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80433781-5ba6-486c-89dd-9a685dc1c05c None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:47.272309 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80433781-5ba6-486c-89dd-9a685dc1c05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:47.292066 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-80433781-5ba6-486c-89dd-9a685dc1c05c None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:47.293985 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-80433781-5ba6-486c-89dd-9a685dc1c05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:47.301545 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 794/1561] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:47.302383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80433781-5ba6-486c-89dd-9a685dc1c05c None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:47.309639 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:47.313648 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80433781-5ba6-486c-89dd-9a685dc1c05c None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:47.318685 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e12a22-cecb-4a7d-b416-19e9694149a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:47.319077 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e12a22-cecb-4a7d-b416-19e9694149a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:47.319455 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e12a22-cecb-4a7d-b416-19e9694149a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:47.320506 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e12a22-cecb-4a7d-b416-19e9694149a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:47.320506 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e12a22-cecb-4a7d-b416-19e9694149a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:47.323069 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e12a22-cecb-4a7d-b416-19e9694149a8 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:47.369100 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 768/1562] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:22:47 2022] POST /identity/v3/projects => generated 371 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:22:47.370762 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c18afd-4df4-4cfa-9d73-95159326093e None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:47.371051 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c18afd-4df4-4cfa-9d73-95159326093e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:47.371330 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c18afd-4df4-4cfa-9d73-95159326093e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:47.391050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f8c18afd-4df4-4cfa-9d73-95159326093e None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:47.392433 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f8c18afd-4df4-4cfa-9d73-95159326093e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:47.457446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 769/1563] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:47.458211 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c18afd-4df4-4cfa-9d73-95159326093e None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:47.468362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c18afd-4df4-4cfa-9d73-95159326093e None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:47.473992 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e273060-6072-4f1f-9f08-44d37c0912b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:47.479422 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e273060-6072-4f1f-9f08-44d37c0912b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:47.479422 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e273060-6072-4f1f-9f08-44d37c0912b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:47.479422 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e273060-6072-4f1f-9f08-44d37c0912b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:47.479422 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e273060-6072-4f1f-9f08-44d37c0912b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:22:47.479422 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e273060-6072-4f1f-9f08-44d37c0912b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:47.480488 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e273060-6072-4f1f-9f08-44d37c0912b0 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:47.487331 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 795/1564] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:22:47 2022] POST /identity/v3/projects => generated 389 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:22:47.488859 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e12a22-cecb-4a7d-b416-19e9694149a8 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:47.499092 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 770/1565] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:22:47.500638 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e273060-6072-4f1f-9f08-44d37c0912b0 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:47.519031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e273060-6072-4f1f-9f08-44d37c0912b0 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:47.575716 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e12a22-cecb-4a7d-b416-19e9694149a8 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:47.581482 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e258f2-1e73-498c-8acd-f4ee543b9911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:47.582236 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e258f2-1e73-498c-8acd-f4ee543b9911 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:47.582528 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e258f2-1e73-498c-8acd-f4ee543b9911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:47.582802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e258f2-1e73-498c-8acd-f4ee543b9911 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:47.583504 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e258f2-1e73-498c-8acd-f4ee543b9911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:47.585542 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e258f2-1e73-498c-8acd-f4ee543b9911 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:47.591685 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3671341-24db-4b88-9878-3dea1e55e270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:47.592664 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3671341-24db-4b88-9878-3dea1e55e270 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:47.592914 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3671341-24db-4b88-9878-3dea1e55e270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:47.593090 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3671341-24db-4b88-9878-3dea1e55e270 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:47.593872 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3671341-24db-4b88-9878-3dea1e55e270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:47.595519 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3671341-24db-4b88-9878-3dea1e55e270 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:47.607273 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 771/1566] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:22:47.611087 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3671341-24db-4b88-9878-3dea1e55e270 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:47.619156 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3671341-24db-4b88-9878-3dea1e55e270 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:47.626357 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374191a-249b-43f7-94e1-fffc66954f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:47.627043 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374191a-249b-43f7-94e1-fffc66954f30 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:47.627327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374191a-249b-43f7-94e1-fffc66954f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:47.627603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374191a-249b-43f7-94e1-fffc66954f30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:47.628406 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374191a-249b-43f7-94e1-fffc66954f30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:22:47.628875 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374191a-249b-43f7-94e1-fffc66954f30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:47.639853 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374191a-249b-43f7-94e1-fffc66954f30 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:47.653925 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 772/1567] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:22:47.654809 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374191a-249b-43f7-94e1-fffc66954f30 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:47.665674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374191a-249b-43f7-94e1-fffc66954f30 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:47.670479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1266ad5-979e-4ab0-929c-b0514f68680c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:47.671157 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1266ad5-979e-4ab0-929c-b0514f68680c admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:47.671444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1266ad5-979e-4ab0-929c-b0514f68680c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:47.671723 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1266ad5-979e-4ab0-929c-b0514f68680c admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:47.672498 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1266ad5-979e-4ab0-929c-b0514f68680c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:22:47.672809 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1266ad5-979e-4ab0-929c-b0514f68680c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:47.674502 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1266ad5-979e-4ab0-929c-b0514f68680c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:47.688153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 773/1568] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:22:47.689041 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1266ad5-979e-4ab0-929c-b0514f68680c admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:47.693013 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 796/1569] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:22:47 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:22:47.694958 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e258f2-1e73-498c-8acd-f4ee543b9911 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:47.701129 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1266ad5-979e-4ab0-929c-b0514f68680c admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:47.706084 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb89efa-29a4-48fb-8e9a-71ea447f3416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:47.706356 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e258f2-1e73-498c-8acd-f4ee543b9911 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:47.706794 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb89efa-29a4-48fb-8e9a-71ea447f3416 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:47.707078 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb89efa-29a4-48fb-8e9a-71ea447f3416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:47.707360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb89efa-29a4-48fb-8e9a-71ea447f3416 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:47.708183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb89efa-29a4-48fb-8e9a-71ea447f3416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:47.710097 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb89efa-29a4-48fb-8e9a-71ea447f3416 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:47.711527 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8b9cb-7b6f-4ff1-9208-6b3c09c7341e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:47.712373 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8b9cb-7b6f-4ff1-9208-6b3c09c7341e admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:47.712755 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8b9cb-7b6f-4ff1-9208-6b3c09c7341e admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:47.713263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8b9cb-7b6f-4ff1-9208-6b3c09c7341e admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:47.714215 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8b9cb-7b6f-4ff1-9208-6b3c09c7341e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:22:47.714623 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8b9cb-7b6f-4ff1-9208-6b3c09c7341e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:47.716466 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8b9cb-7b6f-4ff1-9208-6b3c09c7341e admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:47.733689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 797/1570] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:22:47.734542 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8b9cb-7b6f-4ff1-9208-6b3c09c7341e admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:47.752189 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8b9cb-7b6f-4ff1-9208-6b3c09c7341e admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:47.757155 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ad55c-6d6c-4745-97f2-915ff8df3859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:47.757847 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ad55c-6d6c-4745-97f2-915ff8df3859 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:47.758158 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ad55c-6d6c-4745-97f2-915ff8df3859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:47.758454 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ad55c-6d6c-4745-97f2-915ff8df3859 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:47.759185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ad55c-6d6c-4745-97f2-915ff8df3859 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:47.761190 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ad55c-6d6c-4745-97f2-915ff8df3859 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:47.807408 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 774/1571] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:22:47 2022] POST /identity/v3/users => generated 286 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:22:47.808264 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb89efa-29a4-48fb-8e9a-71ea447f3416 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:47.818504 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb89efa-29a4-48fb-8e9a-71ea447f3416 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:47.823581 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861e8b6-7531-4214-b447-7f0d2f42d63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:47.824286 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861e8b6-7531-4214-b447-7f0d2f42d63e admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:47.824570 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861e8b6-7531-4214-b447-7f0d2f42d63e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:47.824845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861e8b6-7531-4214-b447-7f0d2f42d63e admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:47.825563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861e8b6-7531-4214-b447-7f0d2f42d63e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:47.827530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861e8b6-7531-4214-b447-7f0d2f42d63e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:47.837712 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 798/1572] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:22:47 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:22:47.839135 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ad55c-6d6c-4745-97f2-915ff8df3859 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:47.857617 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ad55c-6d6c-4745-97f2-915ff8df3859 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:47.863773 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781d63b-b8e0-4ed2-a20b-4d68c7822235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:47.864488 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781d63b-b8e0-4ed2-a20b-4d68c7822235 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:47.864770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781d63b-b8e0-4ed2-a20b-4d68c7822235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:47.865060 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781d63b-b8e0-4ed2-a20b-4d68c7822235 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:47.865788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c781d63b-b8e0-4ed2-a20b-4d68c7822235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:47.867505 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c781d63b-b8e0-4ed2-a20b-4d68c7822235 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:47.879741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 799/1573] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:22:47.886792 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781d63b-b8e0-4ed2-a20b-4d68c7822235 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:47.892138 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781d63b-b8e0-4ed2-a20b-4d68c7822235 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:47.897169 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e8cac-801d-4311-9420-eecae48eb5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:47.897855 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e8cac-801d-4311-9420-eecae48eb5f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:47.898148 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e8cac-801d-4311-9420-eecae48eb5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:47.898426 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e8cac-801d-4311-9420-eecae48eb5f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:47.899209 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e8cac-801d-4311-9420-eecae48eb5f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:47.901244 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e8cac-801d-4311-9420-eecae48eb5f1 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:47.917552 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 775/1574] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:22:47 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:22:47.918440 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861e8b6-7531-4214-b447-7f0d2f42d63e admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:47.930089 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:47.992216 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861e8b6-7531-4214-b447-7f0d2f42d63e admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:47.997231 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5371ca-7da6-4b13-834a-1438c2bbe038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:47.997912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5371ca-7da6-4b13-834a-1438c2bbe038 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:47.998202 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5371ca-7da6-4b13-834a-1438c2bbe038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:47.998472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5371ca-7da6-4b13-834a-1438c2bbe038 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:47.999306 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5371ca-7da6-4b13-834a-1438c2bbe038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:48.001079 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5371ca-7da6-4b13-834a-1438c2bbe038 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:48.012923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 776/1575] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:22:48.013824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5371ca-7da6-4b13-834a-1438c2bbe038 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:48.026922 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5371ca-7da6-4b13-834a-1438c2bbe038 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:48.034407 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4bb28-9a62-40f0-85fd-68cda7dad3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:48.035140 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4bb28-9a62-40f0-85fd-68cda7dad3da admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:48.035461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4bb28-9a62-40f0-85fd-68cda7dad3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:48.035776 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4bb28-9a62-40f0-85fd-68cda7dad3da admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:48.036689 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4bb28-9a62-40f0-85fd-68cda7dad3da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:48.038999 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4bb28-9a62-40f0-85fd-68cda7dad3da admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:48.045198 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 800/1576] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:22:47 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:22:48.048733 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e8cac-801d-4311-9420-eecae48eb5f1 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:48.118660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e8cac-801d-4311-9420-eecae48eb5f1 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:48.124080 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aedc4b-41f2-4a2f-8f07-81f57cf95282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:48.125162 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aedc4b-41f2-4a2f-8f07-81f57cf95282 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:48.125542 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aedc4b-41f2-4a2f-8f07-81f57cf95282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:48.125917 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aedc4b-41f2-4a2f-8f07-81f57cf95282 admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:48.126786 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aedc4b-41f2-4a2f-8f07-81f57cf95282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:48.128981 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aedc4b-41f2-4a2f-8f07-81f57cf95282 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:48.144450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:48.159069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 777/1577] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:22:48 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:22:48.159376 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4bb28-9a62-40f0-85fd-68cda7dad3da admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:48.229900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4bb28-9a62-40f0-85fd-68cda7dad3da admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:48.234900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a2d41-21e3-4f2b-ba53-047e95f85914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:48.235635 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a2d41-21e3-4f2b-ba53-047e95f85914 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:48.235986 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a2d41-21e3-4f2b-ba53-047e95f85914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:48.236380 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a2d41-21e3-4f2b-ba53-047e95f85914 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:48.237360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a2d41-21e3-4f2b-ba53-047e95f85914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:48.239064 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a2d41-21e3-4f2b-ba53-047e95f85914 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:48.255694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 801/1578] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:22:48 2022] POST /identity/v3/projects => generated 375 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:22:48.255694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aedc4b-41f2-4a2f-8f07-81f57cf95282 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:48.256459 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 778/1579] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:22:48.258267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a2d41-21e3-4f2b-ba53-047e95f85914 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:48.273550 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a2d41-21e3-4f2b-ba53-047e95f85914 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:48.347832 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aedc4b-41f2-4a2f-8f07-81f57cf95282 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:48.352976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c99579-1de5-4621-8ef5-c2a905416ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:48.353685 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c99579-1de5-4621-8ef5-c2a905416ceb admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:48.353965 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c99579-1de5-4621-8ef5-c2a905416ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:48.354231 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c99579-1de5-4621-8ef5-c2a905416ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:48.354981 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c99579-1de5-4621-8ef5-c2a905416ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:48.356696 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c99579-1de5-4621-8ef5-c2a905416ceb admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:48.368445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 802/1580] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:22:48.369225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c99579-1de5-4621-8ef5-c2a905416ceb admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:48.369533 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55dfbb-1fdc-4e89-95ba-3bfa4aa3091e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:48.371169 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55dfbb-1fdc-4e89-95ba-3bfa4aa3091e admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:48.371666 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55dfbb-1fdc-4e89-95ba-3bfa4aa3091e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:48.372232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55dfbb-1fdc-4e89-95ba-3bfa4aa3091e admin admin] PATH_INFO: `/v3/projects/7b00525fe239473b834f484d0726af59/users/8fce5ea9cc1346b89cce855aaaa77466/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:48.384880 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c99579-1de5-4621-8ef5-c2a905416ceb admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:48.390148 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7549ac8-8c50-4e69-93e5-c3b38151419a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:48.390838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7549ac8-8c50-4e69-93e5-c3b38151419a admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:48.391119 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7549ac8-8c50-4e69-93e5-c3b38151419a admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:48.391400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7549ac8-8c50-4e69-93e5-c3b38151419a admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:48.392143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7549ac8-8c50-4e69-93e5-c3b38151419a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:48.394694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7549ac8-8c50-4e69-93e5-c3b38151419a admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:48.398236 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55dfbb-1fdc-4e89-95ba-3bfa4aa3091e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b00525fe239473b834f484d0726af59, user_id=8fce5ea9cc1346b89cce855aaaa77466, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:48.402623 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55dfbb-1fdc-4e89-95ba-3bfa4aa3091e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:48.482301 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 803/1581] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:22:48 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:22:48.483348 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7549ac8-8c50-4e69-93e5-c3b38151419a admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:48.494679 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7549ac8-8c50-4e69-93e5-c3b38151419a admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:48.499979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:48.500376 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d432b-f4ce-4e16-a238-758ba7a5f383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:48.501076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d432b-f4ce-4e16-a238-758ba7a5f383 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:48.501355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d432b-f4ce-4e16-a238-758ba7a5f383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:48.501759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d432b-f4ce-4e16-a238-758ba7a5f383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:48.502527 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d432b-f4ce-4e16-a238-758ba7a5f383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:48.504240 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d432b-f4ce-4e16-a238-758ba7a5f383 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:48.507247 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 779/1582] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:22:48 2022] PUT /identity/v3/projects/7b00525fe239473b834f484d0726af59/users/8fce5ea9cc1346b89cce855aaaa77466/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:22:48.508050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55dfbb-1fdc-4e89-95ba-3bfa4aa3091e admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:48.525448 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 804/1583] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:22:48.528166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d432b-f4ce-4e16-a238-758ba7a5f383 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:48.541524 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d432b-f4ce-4e16-a238-758ba7a5f383 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:48.584028 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55dfbb-1fdc-4e89-95ba-3bfa4aa3091e admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:48.590263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331a890-c2d3-4459-8d65-b112c6de7d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:48.591201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331a890-c2d3-4459-8d65-b112c6de7d23 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:48.591592 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331a890-c2d3-4459-8d65-b112c6de7d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:48.591926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331a890-c2d3-4459-8d65-b112c6de7d23 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:48.592734 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331a890-c2d3-4459-8d65-b112c6de7d23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:48.595054 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331a890-c2d3-4459-8d65-b112c6de7d23 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:48.638177 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc9d35-aab2-46bd-a734-51b2ae2fa76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:48.638996 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc9d35-aab2-46bd-a734-51b2ae2fa76c admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:48.639333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc9d35-aab2-46bd-a734-51b2ae2fa76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:48.639609 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc9d35-aab2-46bd-a734-51b2ae2fa76c admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:48.640365 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc9d35-aab2-46bd-a734-51b2ae2fa76c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:48.642381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc9d35-aab2-46bd-a734-51b2ae2fa76c admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:48.676243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 780/1584] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:22:48 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:22:48.677106 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331a890-c2d3-4459-8d65-b112c6de7d23 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:48.688249 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331a890-c2d3-4459-8d65-b112c6de7d23 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:48.693404 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabd5e0-db11-4024-8922-72ddbaba0675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:48.694103 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabd5e0-db11-4024-8922-72ddbaba0675 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:48.694393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabd5e0-db11-4024-8922-72ddbaba0675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:48.694673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabd5e0-db11-4024-8922-72ddbaba0675 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:48.695386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabd5e0-db11-4024-8922-72ddbaba0675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:48.698375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabd5e0-db11-4024-8922-72ddbaba0675 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:48.733117 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 805/1585] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:22:48 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:22:48.734195 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc9d35-aab2-46bd-a734-51b2ae2fa76c admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:48.745438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc9d35-aab2-46bd-a734-51b2ae2fa76c admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:48.750376 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded77ec-026d-4f03-884c-430690a6d177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:48.751067 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded77ec-026d-4f03-884c-430690a6d177 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:48.751351 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded77ec-026d-4f03-884c-430690a6d177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:48.751628 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded77ec-026d-4f03-884c-430690a6d177 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:48.752405 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded77ec-026d-4f03-884c-430690a6d177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:48.754129 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded77ec-026d-4f03-884c-430690a6d177 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:48.774637 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 806/1586] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:22:48.776208 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded77ec-026d-4f03-884c-430690a6d177 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:48.790799 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded77ec-026d-4f03-884c-430690a6d177 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:48.798680 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bdd1d4-387a-4501-8a9f-c4494ec0bdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:48.799587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdd1d4-387a-4501-8a9f-c4494ec0bdfb admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:48.799929 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdd1d4-387a-4501-8a9f-c4494ec0bdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:48.800270 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdd1d4-387a-4501-8a9f-c4494ec0bdfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:48.801091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bdd1d4-387a-4501-8a9f-c4494ec0bdfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:48.803042 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bdd1d4-387a-4501-8a9f-c4494ec0bdfb admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:48.814640 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 781/1587] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:22:48 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:22:48.815892 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabd5e0-db11-4024-8922-72ddbaba0675 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:48.818387 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 807/1588] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:22:48.820693 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cf944-a960-4f9b-a3ac-8b87c6c8387f None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:48.821898 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cf944-a960-4f9b-a3ac-8b87c6c8387f None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:48.822393 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cf944-a960-4f9b-a3ac-8b87c6c8387f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:48.830242 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabd5e0-db11-4024-8922-72ddbaba0675 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:48.836266 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb4742-719e-4a5f-a625-58b73dd5d447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:48.837165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb4742-719e-4a5f-a625-58b73dd5d447 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:48.837624 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb4742-719e-4a5f-a625-58b73dd5d447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:48.838097 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb4742-719e-4a5f-a625-58b73dd5d447 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:48.838945 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb4742-719e-4a5f-a625-58b73dd5d447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:48.841156 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb4742-719e-4a5f-a625-58b73dd5d447 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:48.847934 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-e08cf944-a960-4f9b-a3ac-8b87c6c8387f None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:48.847934 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-e08cf944-a960-4f9b-a3ac-8b87c6c8387f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:48.857573 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 782/1589] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:22:48.857573 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb4742-719e-4a5f-a625-58b73dd5d447 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:48.859357 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 808/1590] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:48.860872 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cf944-a960-4f9b-a3ac-8b87c6c8387f None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:48.875664 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb4742-719e-4a5f-a625-58b73dd5d447 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:48.877668 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cf944-a960-4f9b-a3ac-8b87c6c8387f None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:48.885328 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf9dd7-c716-4203-90f8-234ca07b166c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:48.885550 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220393f6-aa13-449a-90a8-0e027b0c25d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:48.886364 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220393f6-aa13-449a-90a8-0e027b0c25d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:48.886784 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf9dd7-c716-4203-90f8-234ca07b166c admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:48.886890 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220393f6-aa13-449a-90a8-0e027b0c25d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:48.887233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220393f6-aa13-449a-90a8-0e027b0c25d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:48.887501 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf9dd7-c716-4203-90f8-234ca07b166c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:48.887941 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf9dd7-c716-4203-90f8-234ca07b166c admin admin] PATH_INFO: `/v3/projects/f1a9171b2b994b06b502b6aff31354e4/users/f5c4899799c445e0bd331745d0ba1380/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:48.888566 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220393f6-aa13-449a-90a8-0e027b0c25d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:48.891476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220393f6-aa13-449a-90a8-0e027b0c25d1 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:48.912848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 809/1591] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:22:48.912848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220393f6-aa13-449a-90a8-0e027b0c25d1 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:48.917397 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf9dd7-c716-4203-90f8-234ca07b166c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a9171b2b994b06b502b6aff31354e4, user_id=f5c4899799c445e0bd331745d0ba1380, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:48.922619 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf9dd7-c716-4203-90f8-234ca07b166c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:48.928597 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220393f6-aa13-449a-90a8-0e027b0c25d1 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:48.934215 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1f1dc-9867-425f-a298-1c72e5119c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:48.934695 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1f1dc-9867-425f-a298-1c72e5119c92 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:48.934979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1f1dc-9867-425f-a298-1c72e5119c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:48.935254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1f1dc-9867-425f-a298-1c72e5119c92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:48.936118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1f1dc-9867-425f-a298-1c72e5119c92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:48.946735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1f1dc-9867-425f-a298-1c72e5119c92 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:48.946735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:48.955559 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 810/1592] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:22:48.957167 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1f1dc-9867-425f-a298-1c72e5119c92 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:48.975110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1f1dc-9867-425f-a298-1c72e5119c92 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:48.983347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0b40f-58ca-47ff-97b4-57f0ecd0744c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:48.985033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0b40f-58ca-47ff-97b4-57f0ecd0744c admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:48.985541 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0b40f-58ca-47ff-97b4-57f0ecd0744c admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:48.986051 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0b40f-58ca-47ff-97b4-57f0ecd0744c admin admin] PATH_INFO: `/v3/projects/a0f3e0548c674c84b4ca68e0a806c41d/users/3e216b852ef14dbdbad59f71e6aa3aaf/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:49.006243 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0b40f-58ca-47ff-97b4-57f0ecd0744c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0f3e0548c674c84b4ca68e0a806c41d, user_id=3e216b852ef14dbdbad59f71e6aa3aaf, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:49.007741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: WARNING py.warnings [None req-e9c0b40f-58ca-47ff-97b4-57f0ecd0744c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 19:22:49.007741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: warnings.warn(msg) Jun 02 19:22:49.007741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: Jun 02 19:22:49.011665 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0b40f-58ca-47ff-97b4-57f0ecd0744c admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:49.016751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 783/1593] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:22:48 2022] PUT /identity/v3/projects/f1a9171b2b994b06b502b6aff31354e4/users/f5c4899799c445e0bd331745d0ba1380/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:22:49.017713 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf9dd7-c716-4203-90f8-234ca07b166c admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:49.088602 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf9dd7-c716-4203-90f8-234ca07b166c admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:49.094816 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67bf0c-367c-492f-9279-d61096ba9b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:49.095896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67bf0c-367c-492f-9279-d61096ba9b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:49.096313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67bf0c-367c-492f-9279-d61096ba9b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:49.096702 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67bf0c-367c-492f-9279-d61096ba9b64 admin admin] PATH_INFO: `/v3/projects/5a4a4f0451d14230bc5086449cbc7a48/users/f8890c84089c48d291b3ff73e9b2e423/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:49.100043 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 811/1594] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:22:48 2022] PUT /identity/v3/projects/a0f3e0548c674c84b4ca68e0a806c41d/users/3e216b852ef14dbdbad59f71e6aa3aaf/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:22:49.103235 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0b40f-58ca-47ff-97b4-57f0ecd0744c admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:49.121851 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67bf0c-367c-492f-9279-d61096ba9b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4a4f0451d14230bc5086449cbc7a48, user_id=f8890c84089c48d291b3ff73e9b2e423, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:49.125282 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67bf0c-367c-492f-9279-d61096ba9b64 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:49.175726 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0b40f-58ca-47ff-97b4-57f0ecd0744c admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:49.181439 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3885e-6d30-4496-9ae3-b7297085bec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:49.182131 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3885e-6d30-4496-9ae3-b7297085bec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:49.182411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3885e-6d30-4496-9ae3-b7297085bec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:49.182684 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3885e-6d30-4496-9ae3-b7297085bec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:49.183490 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3885e-6d30-4496-9ae3-b7297085bec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:49.185165 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3885e-6d30-4496-9ae3-b7297085bec6 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:49.196851 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 812/1595] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:22:49.199954 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3885e-6d30-4496-9ae3-b7297085bec6 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:49.208574 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3885e-6d30-4496-9ae3-b7297085bec6 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:49.213634 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7d4aa-29b6-466f-8398-ac0e08722bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:49.214318 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7d4aa-29b6-466f-8398-ac0e08722bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:49.214602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7d4aa-29b6-466f-8398-ac0e08722bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:49.214877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7d4aa-29b6-466f-8398-ac0e08722bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:49.215615 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7d4aa-29b6-466f-8398-ac0e08722bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:49.217421 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7d4aa-29b6-466f-8398-ac0e08722bbd admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:49.226643 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 784/1596] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:22:49 2022] PUT /identity/v3/projects/5a4a4f0451d14230bc5086449cbc7a48/users/f8890c84089c48d291b3ff73e9b2e423/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:22:49.228499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67bf0c-367c-492f-9279-d61096ba9b64 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:49.237326 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 813/1597] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:22:49.237326 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7d4aa-29b6-466f-8398-ac0e08722bbd admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:49.249272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7d4aa-29b6-466f-8398-ac0e08722bbd admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:49.259431 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:49.319034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67bf0c-367c-492f-9279-d61096ba9b64 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:49.323467 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f2e27-e540-4c86-934a-de74087d2b1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:49.324171 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f2e27-e540-4c86-934a-de74087d2b1d service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:49.324456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f2e27-e540-4c86-934a-de74087d2b1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:49.324859 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f2e27-e540-4c86-934a-de74087d2b1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:49.329106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bebece-6026-4f77-a298-6017eb2b865c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:49.330340 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bebece-6026-4f77-a298-6017eb2b865c admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:49.330833 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bebece-6026-4f77-a298-6017eb2b865c admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:49.331320 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bebece-6026-4f77-a298-6017eb2b865c admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:49.332726 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bebece-6026-4f77-a298-6017eb2b865c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:49.335813 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bebece-6026-4f77-a298-6017eb2b865c admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:49.337106 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f2e27-e540-4c86-934a-de74087d2b1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:49.339369 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f2e27-e540-4c86-934a-de74087d2b1d service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:49.350766 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 785/1598] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:22:49.351496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f2e27-e540-4c86-934a-de74087d2b1d service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:49.356519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 814/1599] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:22:49.358915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b30fc6-6625-415c-828c-b0524b6f1346 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:49.359121 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b30fc6-6625-415c-828c-b0524b6f1346 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:49.359529 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b30fc6-6625-415c-828c-b0524b6f1346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:49.363201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f2e27-e540-4c86-934a-de74087d2b1d service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:49.371623 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef436c25-0502-424f-8555-c9ec698792d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:49.372752 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef436c25-0502-424f-8555-c9ec698792d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:49.373636 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef436c25-0502-424f-8555-c9ec698792d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:49.373636 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef436c25-0502-424f-8555-c9ec698792d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:49.375111 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef436c25-0502-424f-8555-c9ec698792d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:49.379526 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef436c25-0502-424f-8555-c9ec698792d4 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:49.381976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-11b30fc6-6625-415c-828c-b0524b6f1346 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:49.383280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-11b30fc6-6625-415c-828c-b0524b6f1346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:49.392159 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 815/1600] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:49.393424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711ab99-e2ce-42f2-9ed4-d132d5dbdc17 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:49.395916 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711ab99-e2ce-42f2-9ed4-d132d5dbdc17 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:49.395916 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711ab99-e2ce-42f2-9ed4-d132d5dbdc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:49.396658 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 786/1601] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:22:49.397893 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef436c25-0502-424f-8555-c9ec698792d4 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:49.411313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef436c25-0502-424f-8555-c9ec698792d4 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:49.417475 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a1634-c90d-4ed3-8699-965dfece4b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:49.418167 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a1634-c90d-4ed3-8699-965dfece4b51 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:49.418451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a1634-c90d-4ed3-8699-965dfece4b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:49.418733 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a1634-c90d-4ed3-8699-965dfece4b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:49.419469 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a1634-c90d-4ed3-8699-965dfece4b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:49.421143 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a1634-c90d-4ed3-8699-965dfece4b51 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:49.433154 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 787/1602] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:22:49.434536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184cffd-c936-43f7-99d1-88f3a5f75cb8 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:49.434816 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184cffd-c936-43f7-99d1-88f3a5f75cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:49.435119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184cffd-c936-43f7-99d1-88f3a5f75cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:49.443111 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-5711ab99-e2ce-42f2-9ed4-d132d5dbdc17 None None] MFA Rules not processed for user `3e216b852ef14dbdbad59f71e6aa3aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:49.445336 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5711ab99-e2ce-42f2-9ed4-d132d5dbdc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:49.456072 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-e184cffd-c936-43f7-99d1-88f3a5f75cb8 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:49.457418 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e184cffd-c936-43f7-99d1-88f3a5f75cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:49.466923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 788/1603] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:49.467913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184cffd-c936-43f7-99d1-88f3a5f75cb8 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:49.484869 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184cffd-c936-43f7-99d1-88f3a5f75cb8 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:49.490301 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2670525-bfe8-479c-b800-b13d7868f440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:49.491244 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2670525-bfe8-479c-b800-b13d7868f440 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:49.491524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2670525-bfe8-479c-b800-b13d7868f440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:49.491825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2670525-bfe8-479c-b800-b13d7868f440 admin admin] PATH_INFO: `/v3/projects/a6b7c2a8d14d4fae8a2f59bb8a51ed41/users/8021bf1b29564ef4bd2117eeb0edbcec/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:49.501743 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:49.508154 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2670525-bfe8-479c-b800-b13d7868f440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b7c2a8d14d4fae8a2f59bb8a51ed41, user_id=8021bf1b29564ef4bd2117eeb0edbcec, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:49.510878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2670525-bfe8-479c-b800-b13d7868f440 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:49.527056 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 816/1604] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:49.527972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711ab99-e2ce-42f2-9ed4-d132d5dbdc17 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:49.541757 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711ab99-e2ce-42f2-9ed4-d132d5dbdc17 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:49.546461 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db72424-c567-4683-b4cf-19b1a177ee2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:49.547420 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db72424-c567-4683-b4cf-19b1a177ee2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:49.547696 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db72424-c567-4683-b4cf-19b1a177ee2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:49.547969 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db72424-c567-4683-b4cf-19b1a177ee2e admin admin] PATH_INFO: `/v3/projects/a7fa411193fa4faa8bf3d7266c989727/users/112f88a111774f258929fd8fcd96eb63/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:49.566627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db72424-c567-4683-b4cf-19b1a177ee2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7fa411193fa4faa8bf3d7266c989727, user_id=112f88a111774f258929fd8fcd96eb63, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:49.567784 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db72424-c567-4683-b4cf-19b1a177ee2e admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:49.632432 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 789/1605] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:22:49 2022] PUT /identity/v3/projects/a6b7c2a8d14d4fae8a2f59bb8a51ed41/users/8021bf1b29564ef4bd2117eeb0edbcec/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:22:49.633915 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2670525-bfe8-479c-b800-b13d7868f440 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:49.711852 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2670525-bfe8-479c-b800-b13d7868f440 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:49.721132 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2ae97-c7ca-4e71-b96b-caa06571af51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:49.721132 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2ae97-c7ca-4e71-b96b-caa06571af51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:49.721132 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2ae97-c7ca-4e71-b96b-caa06571af51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:49.721132 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2ae97-c7ca-4e71-b96b-caa06571af51 admin admin] PATH_INFO: `/v3/projects/c9ce3a5f432f49269b40f397a7191f5a/users/27c5deeab63347048484a02f6bdbab29/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:49.731018 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 817/1606] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:22:49 2022] PUT /identity/v3/projects/a7fa411193fa4faa8bf3d7266c989727/users/112f88a111774f258929fd8fcd96eb63/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:22:49.732691 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db72424-c567-4683-b4cf-19b1a177ee2e admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:49.739138 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-8db72424-c567-4683-b4cf-19b1a177ee2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:49.746946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2ae97-c7ca-4e71-b96b-caa06571af51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9ce3a5f432f49269b40f397a7191f5a, user_id=27c5deeab63347048484a02f6bdbab29, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:49.751634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2ae97-c7ca-4e71-b96b-caa06571af51 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:49.838241 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 790/1607] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:22:49 2022] PUT /identity/v3/projects/c9ce3a5f432f49269b40f397a7191f5a/users/27c5deeab63347048484a02f6bdbab29/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:22:49.841380 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2ae97-c7ca-4e71-b96b-caa06571af51 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:49.849340 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db72424-c567-4683-b4cf-19b1a177ee2e admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:49.921033 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:49.932907 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2ae97-c7ca-4e71-b96b-caa06571af51 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:49.934204 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7baa72a-0bc1-4df7-ac60-e7a2a374d68d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:49.934878 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baa72a-0bc1-4df7-ac60-e7a2a374d68d service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:49.935260 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baa72a-0bc1-4df7-ac60-e7a2a374d68d service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:49.935543 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baa72a-0bc1-4df7-ac60-e7a2a374d68d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:49.938831 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908a411-bf0e-4626-a180-b2b989522318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:49.940544 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908a411-bf0e-4626-a180-b2b989522318 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:49.940870 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908a411-bf0e-4626-a180-b2b989522318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:49.941104 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908a411-bf0e-4626-a180-b2b989522318 admin admin] PATH_INFO: `/v3/projects/40c7570a0cda4db98d33e30c6b2ea476/users/35658a179ed84e2d949312d9bde201a4/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:49.946469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7baa72a-0bc1-4df7-ac60-e7a2a374d68d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:49.948479 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7baa72a-0bc1-4df7-ac60-e7a2a374d68d service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:49.959530 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 818/1608] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:22:49.962842 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908a411-bf0e-4626-a180-b2b989522318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c7570a0cda4db98d33e30c6b2ea476, user_id=35658a179ed84e2d949312d9bde201a4, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:49.963037 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7baa72a-0bc1-4df7-ac60-e7a2a374d68d service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:49.963936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908a411-bf0e-4626-a180-b2b989522318 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:49.969613 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7baa72a-0bc1-4df7-ac60-e7a2a374d68d service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:49.973522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c3a4f-7b79-4b8c-baf7-9ec1a962722b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:49.974178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c3a4f-7b79-4b8c-baf7-9ec1a962722b service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:49.974537 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c3a4f-7b79-4b8c-baf7-9ec1a962722b service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:49.974821 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c3a4f-7b79-4b8c-baf7-9ec1a962722b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:49.986091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c3a4f-7b79-4b8c-baf7-9ec1a962722b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:49.987582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c3a4f-7b79-4b8c-baf7-9ec1a962722b service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:49.999125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 819/1609] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:22:49.999961 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c3a4f-7b79-4b8c-baf7-9ec1a962722b service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:50.010105 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c3a4f-7b79-4b8c-baf7-9ec1a962722b service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:50.015235 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa479c-f5b5-48dd-bd95-108ced7e233a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:50.015930 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa479c-f5b5-48dd-bd95-108ced7e233a admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:50.016284 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa479c-f5b5-48dd-bd95-108ced7e233a admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:50.016560 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa479c-f5b5-48dd-bd95-108ced7e233a admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:50.017261 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa479c-f5b5-48dd-bd95-108ced7e233a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:50.019221 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa479c-f5b5-48dd-bd95-108ced7e233a admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:50.044757 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 791/1610] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:22:49 2022] PUT /identity/v3/projects/40c7570a0cda4db98d33e30c6b2ea476/users/35658a179ed84e2d949312d9bde201a4/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:22:50.045871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f6d70-77c7-4e00-ad4e-26bdcfc47ceb None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:50.046166 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f6d70-77c7-4e00-ad4e-26bdcfc47ceb None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:50.049490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f6d70-77c7-4e00-ad4e-26bdcfc47ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:50.081154 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-c81f6d70-77c7-4e00-ad4e-26bdcfc47ceb None None] MFA Rules not processed for user `8021bf1b29564ef4bd2117eeb0edbcec`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:50.082255 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c81f6d70-77c7-4e00-ad4e-26bdcfc47ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:50.162985 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 820/1611] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:22:49 2022] POST /identity/v3/projects => generated 371 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:22:50.167654 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477be64-ee28-4b8a-af53-ba38c39175d7 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:50.169123 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477be64-ee28-4b8a-af53-ba38c39175d7 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:50.169832 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477be64-ee28-4b8a-af53-ba38c39175d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:50.176686 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 792/1612] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:50.178354 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d776d-6337-4bcc-9de8-b0865512a6c8 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:50.178753 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d776d-6337-4bcc-9de8-b0865512a6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:50.179043 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d776d-6337-4bcc-9de8-b0865512a6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:50.205465 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-111d776d-6337-4bcc-9de8-b0865512a6c8 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:50.206811 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-111d776d-6337-4bcc-9de8-b0865512a6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:50.256940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-7477be64-ee28-4b8a-af53-ba38c39175d7 None None] MFA Rules not processed for user `112f88a111774f258929fd8fcd96eb63`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:50.260479 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-7477be64-ee28-4b8a-af53-ba38c39175d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:50.286622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 793/1613] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:50.287853 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835690bb-2e99-4942-ac4a-82af49a0fd1a None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:50.288769 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835690bb-2e99-4942-ac4a-82af49a0fd1a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:50.289058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835690bb-2e99-4942-ac4a-82af49a0fd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:50.309374 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-835690bb-2e99-4942-ac4a-82af49a0fd1a None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:50.311195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-835690bb-2e99-4942-ac4a-82af49a0fd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:50.321128 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 794/1614] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:50.325955 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835690bb-2e99-4942-ac4a-82af49a0fd1a None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:50.335638 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835690bb-2e99-4942-ac4a-82af49a0fd1a None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:50.342163 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e701bb1-9cee-409a-b237-a239e92ca937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:50.342543 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:50.342860 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e701bb1-9cee-409a-b237-a239e92ca937 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:50.343371 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e701bb1-9cee-409a-b237-a239e92ca937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:50.343535 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e701bb1-9cee-409a-b237-a239e92ca937 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:50.344465 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e701bb1-9cee-409a-b237-a239e92ca937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:50.346456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e701bb1-9cee-409a-b237-a239e92ca937 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:50.403866 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 821/1615] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:50.405686 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729a852-cb81-4dfb-b49e-06ecfaf960c7 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:50.406191 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729a852-cb81-4dfb-b49e-06ecfaf960c7 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:50.406507 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729a852-cb81-4dfb-b49e-06ecfaf960c7 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:50.408662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 822/1616] 10.222.0.45 () {54 vars in 961 bytes} [Thu Jun 2 19:22:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:22:50.419119 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729a852-cb81-4dfb-b49e-06ecfaf960c7 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:50.488815 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 795/1617] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:22:50 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:22:50.490724 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e701bb1-9cee-409a-b237-a239e92ca937 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:50.514290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729a852-cb81-4dfb-b49e-06ecfaf960c7 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:50.519569 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbbfcd1-57db-49a2-98bd-864b50603221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:50.520379 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbfcd1-57db-49a2-98bd-864b50603221 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:50.521263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbfcd1-57db-49a2-98bd-864b50603221 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:50.521645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbfcd1-57db-49a2-98bd-864b50603221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:50.535897 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbbfcd1-57db-49a2-98bd-864b50603221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:50.545295 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbbfcd1-57db-49a2-98bd-864b50603221 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:50.555632 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 823/1618] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:22:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:22:50.556999 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae074f43-3f60-4c5f-9392-f2cf4d8811c2 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:50.557287 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae074f43-3f60-4c5f-9392-f2cf4d8811c2 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:50.557562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae074f43-3f60-4c5f-9392-f2cf4d8811c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:50.564084 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:50.577976 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e701bb1-9cee-409a-b237-a239e92ca937 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:50.584778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888e6bb-0db6-4130-8a89-7953cb6c7e4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:50.585036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-ae074f43-3f60-4c5f-9392-f2cf4d8811c2 None None] MFA Rules not processed for user `575f61ef70314f86b5d9dad3ba1b3aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:50.585819 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888e6bb-0db6-4130-8a89-7953cb6c7e4c service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:50.586130 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-ae074f43-3f60-4c5f-9392-f2cf4d8811c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:50.586949 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888e6bb-0db6-4130-8a89-7953cb6c7e4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:50.587325 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888e6bb-0db6-4130-8a89-7953cb6c7e4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:50.599077 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888e6bb-0db6-4130-8a89-7953cb6c7e4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:50.600865 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888e6bb-0db6-4130-8a89-7953cb6c7e4c service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:50.613131 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 796/1619] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:22:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:22:50.614784 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6e338-e82a-42e7-948b-d87d4654660b None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:50.615180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6e338-e82a-42e7-948b-d87d4654660b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:50.615535 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6e338-e82a-42e7-948b-d87d4654660b None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:50.618099 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 797/1620] 10.222.0.45 () {54 vars in 961 bytes} [Thu Jun 2 19:22:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:22:50.618899 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6e338-e82a-42e7-948b-d87d4654660b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:50.636902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6e338-e82a-42e7-948b-d87d4654660b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:50.661232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a784a-6e14-4b31-b92f-00d0a5e105bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:50.661232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a784a-6e14-4b31-b92f-00d0a5e105bd admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:50.661232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a784a-6e14-4b31-b92f-00d0a5e105bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:50.661232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a784a-6e14-4b31-b92f-00d0a5e105bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:50.661614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a784a-6e14-4b31-b92f-00d0a5e105bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:50.663344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a784a-6e14-4b31-b92f-00d0a5e105bd admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:50.677333 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 798/1621] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:22:50.678905 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30888107-a7dd-4805-b22b-8bf1d52187e5 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:50.679548 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30888107-a7dd-4805-b22b-8bf1d52187e5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:50.679833 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30888107-a7dd-4805-b22b-8bf1d52187e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:50.702266 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-30888107-a7dd-4805-b22b-8bf1d52187e5 None None] MFA Rules not processed for user `575f61ef70314f86b5d9dad3ba1b3aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:50.703784 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-30888107-a7dd-4805-b22b-8bf1d52187e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:50.734723 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 824/1622] 10.222.0.45 () {58 vars in 1058 bytes} [Thu Jun 2 19:22:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:50.735885 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae074f43-3f60-4c5f-9392-f2cf4d8811c2 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:50.753482 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae074f43-3f60-4c5f-9392-f2cf4d8811c2 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:50.760061 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bf83e-5a99-40db-9e13-7c8d0dbcae0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:50.761567 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bf83e-5a99-40db-9e13-7c8d0dbcae0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:50.761962 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bf83e-5a99-40db-9e13-7c8d0dbcae0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:50.762343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bf83e-5a99-40db-9e13-7c8d0dbcae0a admin admin] PATH_INFO: `/v3/projects/13dc5e971b374fb5a175f27c21690137/users/835a226dd4b34f4a913705742813eb2c/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:50.787407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bf83e-5a99-40db-9e13-7c8d0dbcae0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=13dc5e971b374fb5a175f27c21690137, user_id=835a226dd4b34f4a913705742813eb2c, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:50.787681 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bf83e-5a99-40db-9e13-7c8d0dbcae0a admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:50.834703 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 799/1623] 10.222.0.45 () {58 vars in 1058 bytes} [Thu Jun 2 19:22:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:50.836148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30888107-a7dd-4805-b22b-8bf1d52187e5 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:50.850115 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30888107-a7dd-4805-b22b-8bf1d52187e5 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:50.862770 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e3ce6-56d9-4629-a13e-8cbc974869ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:50.867247 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 825/1624] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:22:50 2022] PUT /identity/v3/projects/13dc5e971b374fb5a175f27c21690137/users/835a226dd4b34f4a913705742813eb2c/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:22:50.871814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bf83e-5a99-40db-9e13-7c8d0dbcae0a admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:50.873666 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e3ce6-56d9-4629-a13e-8cbc974869ac service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:50.875550 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e3ce6-56d9-4629-a13e-8cbc974869ac service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:50.876572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e3ce6-56d9-4629-a13e-8cbc974869ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:51.009291 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e3ce6-56d9-4629-a13e-8cbc974869ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:51.013748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e3ce6-56d9-4629-a13e-8cbc974869ac service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:51.045121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 800/1625] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:22:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:22:51.048935 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bf83e-5a99-40db-9e13-7c8d0dbcae0a admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:51.059468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e3ce6-56d9-4629-a13e-8cbc974869ac service nova] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:51.064627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db17886-ef1f-4f55-975d-ee7a9919c290 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:51.066516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db17886-ef1f-4f55-975d-ee7a9919c290 service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:51.067419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db17886-ef1f-4f55-975d-ee7a9919c290 service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:51.068093 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db17886-ef1f-4f55-975d-ee7a9919c290 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:51.081358 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e3ce6-56d9-4629-a13e-8cbc974869ac service nova] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:51.198669 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97329063-c337-4056-aa7b-58f7cbab1406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:51.199402 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97329063-c337-4056-aa7b-58f7cbab1406 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:51.199697 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97329063-c337-4056-aa7b-58f7cbab1406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:51.199954 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97329063-c337-4056-aa7b-58f7cbab1406 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:51.200786 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97329063-c337-4056-aa7b-58f7cbab1406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:51.206821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97329063-c337-4056-aa7b-58f7cbab1406 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:51.233675 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 801/1626] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:22:51.235583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db17886-ef1f-4f55-975d-ee7a9919c290 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:51.237360 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db17886-ef1f-4f55-975d-ee7a9919c290 service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:51.239379 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97329063-c337-4056-aa7b-58f7cbab1406 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:51.255430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:51.256847 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97329063-c337-4056-aa7b-58f7cbab1406 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:51.262384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 826/1627] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:22:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:22:51.266555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906ffea-86f4-4b94-afb0-44d6c242bbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:51.267479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906ffea-86f4-4b94-afb0-44d6c242bbed admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:51.270420 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906ffea-86f4-4b94-afb0-44d6c242bbed admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:51.270420 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906ffea-86f4-4b94-afb0-44d6c242bbed admin admin] PATH_INFO: `/v3/projects/13dc5e971b374fb5a175f27c21690137/users/835a226dd4b34f4a913705742813eb2c/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:51.270420 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906ffea-86f4-4b94-afb0-44d6c242bbed admin admin] RBAC: Authorizing `identity:create_grant(project_id=13dc5e971b374fb5a175f27c21690137, user_id=835a226dd4b34f4a913705742813eb2c, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:51.274396 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906ffea-86f4-4b94-afb0-44d6c242bbed admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:51.288956 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 802/1628] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:22:51 2022] PUT /identity/v3/projects/13dc5e971b374fb5a175f27c21690137/users/835a226dd4b34f4a913705742813eb2c/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:22:51.299817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55927d-045d-4057-8051-186b0849015d None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:51.300178 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55927d-045d-4057-8051-186b0849015d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:51.300485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55927d-045d-4057-8051-186b0849015d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:51.355558 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-1b55927d-045d-4057-8051-186b0849015d None None] MFA Rules not processed for user `835a226dd4b34f4a913705742813eb2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:51.360250 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-1b55927d-045d-4057-8051-186b0849015d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:51.521356 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 827/1629] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:51 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:22:51.536209 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906ffea-86f4-4b94-afb0-44d6c242bbed admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:51.679854 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38295c68-9f3c-40af-b1a5-93ea515ca332 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:51.679854 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38295c68-9f3c-40af-b1a5-93ea515ca332 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:51.679854 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38295c68-9f3c-40af-b1a5-93ea515ca332 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:51.679854 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 828/1630] 10.222.0.45 () {54 vars in 912 bytes} [Thu Jun 2 19:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:22:51.690021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ea7b6-822d-495e-9d31-8051aedf58cd None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:51.690562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ea7b6-822d-495e-9d31-8051aedf58cd None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:51.691083 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ea7b6-822d-495e-9d31-8051aedf58cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:51.691555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906ffea-86f4-4b94-afb0-44d6c242bbed admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:51.704695 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65a8e1-cced-4259-8c10-f0ee337c74f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:51.706364 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65a8e1-cced-4259-8c10-f0ee337c74f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:51.708713 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65a8e1-cced-4259-8c10-f0ee337c74f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:51.708713 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65a8e1-cced-4259-8c10-f0ee337c74f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:51.754543 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-cd8ea7b6-822d-495e-9d31-8051aedf58cd None None] MFA Rules not processed for user `575f61ef70314f86b5d9dad3ba1b3aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:51.759488 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-cd8ea7b6-822d-495e-9d31-8051aedf58cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:51.760836 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65a8e1-cced-4259-8c10-f0ee337c74f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:51.763717 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65a8e1-cced-4259-8c10-f0ee337c74f3 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:51.799103 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:51.814378 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 803/1631] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:22:51 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:22:51.908880 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 829/1632] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jun 2 19:22:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:22:51.922162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3e2a9-aa1e-44d4-9f4f-9e7ab62eaf59 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:51.928580 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3e2a9-aa1e-44d4-9f4f-9e7ab62eaf59 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:51.928580 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3e2a9-aa1e-44d4-9f4f-9e7ab62eaf59 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:51.928580 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 804/1633] 10.222.0.45 () {54 vars in 912 bytes} [Thu Jun 2 19:22:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:22:51.934490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3e2a9-aa1e-44d4-9f4f-9e7ab62eaf59 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:51.938773 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe229239-d629-4f8b-912c-efb7232ce96a None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:51.940591 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe229239-d629-4f8b-912c-efb7232ce96a None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:51.946798 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe229239-d629-4f8b-912c-efb7232ce96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:51.964197 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3e2a9-aa1e-44d4-9f4f-9e7ab62eaf59 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:51.983625 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127b901-99aa-4c83-bc17-a7c87319da56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:51.987091 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127b901-99aa-4c83-bc17-a7c87319da56 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:51.987091 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127b901-99aa-4c83-bc17-a7c87319da56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:51.989880 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127b901-99aa-4c83-bc17-a7c87319da56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:52.027877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-fe229239-d629-4f8b-912c-efb7232ce96a None None] MFA Rules not processed for user `575f61ef70314f86b5d9dad3ba1b3aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:52.034036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-fe229239-d629-4f8b-912c-efb7232ce96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:52.043667 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127b901-99aa-4c83-bc17-a7c87319da56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:52.060220 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127b901-99aa-4c83-bc17-a7c87319da56 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:52.090057 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 830/1634] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jun 2 19:22:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:52.108344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 805/1635] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:22:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:22:52.210487 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe229239-d629-4f8b-912c-efb7232ce96a None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:52.225865 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe229239-d629-4f8b-912c-efb7232ce96a None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:52.232993 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ceb637-7ac8-4feb-bd22-e10d9a1b43b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:52.234482 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ceb637-7ac8-4feb-bd22-e10d9a1b43b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:52.234979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ceb637-7ac8-4feb-bd22-e10d9a1b43b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:52.235159 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ceb637-7ac8-4feb-bd22-e10d9a1b43b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:52.250640 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ceb637-7ac8-4feb-bd22-e10d9a1b43b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:52.252562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ceb637-7ac8-4feb-bd22-e10d9a1b43b1 service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:52.268430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 831/1636] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:22:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:22:52.279076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:52.586632 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b86180-9253-4d92-ab86-f3bb891f393d None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:52.592627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b86180-9253-4d92-ab86-f3bb891f393d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:52.592627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b86180-9253-4d92-ab86-f3bb891f393d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:52.645493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-69b86180-9253-4d92-ab86-f3bb891f393d None None] MFA Rules not processed for user `f5c4899799c445e0bd331745d0ba1380`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:52.648928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-69b86180-9253-4d92-ab86-f3bb891f393d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:52.844070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 806/1637] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:52.854920 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2ebf5-87ed-4e3d-a8c9-6abf96505bed None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:52.855538 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2ebf5-87ed-4e3d-a8c9-6abf96505bed None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:52.855538 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2ebf5-87ed-4e3d-a8c9-6abf96505bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:52.913042 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-d3e2ebf5-87ed-4e3d-a8c9-6abf96505bed None None] MFA Rules not processed for user `f5c4899799c445e0bd331745d0ba1380`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:52.919377 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-d3e2ebf5-87ed-4e3d-a8c9-6abf96505bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:52.939340 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 832/1638] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:22:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:53.776462 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b86180-9253-4d92-ab86-f3bb891f393d None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:53.793555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b86180-9253-4d92-ab86-f3bb891f393d None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:53.801069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e418a-1df1-42de-9372-f59aa3b063b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:53.801773 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e418a-1df1-42de-9372-f59aa3b063b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:53.802064 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e418a-1df1-42de-9372-f59aa3b063b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:53.802351 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e418a-1df1-42de-9372-f59aa3b063b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:54.005257 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e418a-1df1-42de-9372-f59aa3b063b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:54.023473 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e418a-1df1-42de-9372-f59aa3b063b3 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:54.087844 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 807/1639] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:22:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:22:54.124092 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2ebf5-87ed-4e3d-a8c9-6abf96505bed None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:54.147663 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2ebf5-87ed-4e3d-a8c9-6abf96505bed None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:54.170188 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71937bbc-d3aa-4f47-a371-6dc158ba55ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:54.171199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71937bbc-d3aa-4f47-a371-6dc158ba55ef service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:54.171673 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71937bbc-d3aa-4f47-a371-6dc158ba55ef service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:54.172149 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71937bbc-d3aa-4f47-a371-6dc158ba55ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:54.203076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71937bbc-d3aa-4f47-a371-6dc158ba55ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:54.205084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71937bbc-d3aa-4f47-a371-6dc158ba55ef service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:54.229419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 833/1640] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:22:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:22:55.524964 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574b76e-e6f1-4e74-a4ad-9ceadf1c6324 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:55.526143 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574b76e-e6f1-4e74-a4ad-9ceadf1c6324 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:55.526680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574b76e-e6f1-4e74-a4ad-9ceadf1c6324 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:55.530906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 808/1641] 10.222.0.45 () {54 vars in 912 bytes} [Thu Jun 2 19:22:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:22:55.538428 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98330c4-94c0-43c1-addc-e1c92d979853 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:55.539883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98330c4-94c0-43c1-addc-e1c92d979853 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:55.540213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98330c4-94c0-43c1-addc-e1c92d979853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:55.641831 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-a98330c4-94c0-43c1-addc-e1c92d979853 None None] MFA Rules not processed for user `2efd679ca9314c8591cabbca15f8c61b`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:55.643167 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-a98330c4-94c0-43c1-addc-e1c92d979853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:55.777499 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 834/1642] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jun 2 19:22:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:22:55.815294 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574b76e-e6f1-4e74-a4ad-9ceadf1c6324 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:55.824216 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:55.837906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574b76e-e6f1-4e74-a4ad-9ceadf1c6324 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:55.843553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393041af-f250-447a-a1e4-a4b887b74990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:55.844330 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393041af-f250-447a-a1e4-a4b887b74990 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:55.844673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393041af-f250-447a-a1e4-a4b887b74990 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:55.844989 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393041af-f250-447a-a1e4-a4b887b74990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:55.869480 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393041af-f250-447a-a1e4-a4b887b74990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:55.871027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393041af-f250-447a-a1e4-a4b887b74990 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:55.901013 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 809/1643] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:22:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:22:57.915366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e1064-4698-4da9-a597-e3180e26caf6 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:57.916797 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e1064-4698-4da9-a597-e3180e26caf6 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:57.917560 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e1064-4698-4da9-a597-e3180e26caf6 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:57.919649 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 835/1644] 10.222.0.45 () {54 vars in 960 bytes} [Thu Jun 2 19:22:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:22:57.947631 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b73dc9-1b98-4a5d-99f6-38820b3cf627 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:57.948460 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b73dc9-1b98-4a5d-99f6-38820b3cf627 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:57.953220 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b73dc9-1b98-4a5d-99f6-38820b3cf627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:58.005852 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f8b73dc9-1b98-4a5d-99f6-38820b3cf627 None None] MFA Rules not processed for user `3ebc95c1b3284c1d8321900cf442a811`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:22:58.011549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f8b73dc9-1b98-4a5d-99f6-38820b3cf627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:58.269839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 810/1645] 10.222.0.45 () {58 vars in 1057 bytes} [Thu Jun 2 19:22:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:22:58.277931 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e1064-4698-4da9-a597-e3180e26caf6 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:58.325858 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e1064-4698-4da9-a597-e3180e26caf6 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:58.343738 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd914293-1a0d-4680-874f-07d8c6e53ca3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ebc95c1b3284c1d8321900cf442a811', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:58.344444 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd914293-1a0d-4680-874f-07d8c6e53ca3 service placement] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:58.344727 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd914293-1a0d-4680-874f-07d8c6e53ca3 service placement] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:58.345001 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd914293-1a0d-4680-874f-07d8c6e53ca3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:58.351781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-cd914293-1a0d-4680-874f-07d8c6e53ca3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:22:58.375302 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd914293-1a0d-4680-874f-07d8c6e53ca3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:58.405618 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd914293-1a0d-4680-874f-07d8c6e53ca3 service placement] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:58.478622 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 836/1646] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:22:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:22:59.204393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b73dc9-1b98-4a5d-99f6-38820b3cf627 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:59.462345 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b73dc9-1b98-4a5d-99f6-38820b3cf627 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:59.475885 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7e8eb-bc22-4a86-8099-f5c52a00f110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:59.477211 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7e8eb-bc22-4a86-8099-f5c52a00f110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:59.478413 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7e8eb-bc22-4a86-8099-f5c52a00f110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:59.478413 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7e8eb-bc22-4a86-8099-f5c52a00f110 admin admin] PATH_INFO: `/v3/users/8021bf1b29564ef4bd2117eeb0edbcec` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:59.485440 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7e8eb-bc22-4a86-8099-f5c52a00f110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8021bf1b29564ef4bd2117eeb0edbcec)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:59.487480 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7e8eb-bc22-4a86-8099-f5c52a00f110 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:59.832654 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0da7e8eb-bc22-4a86-8099-f5c52a00f110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8021bf1b29564ef4bd2117eeb0edbcec'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:22:59.853159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0da7e8eb-bc22-4a86-8099-f5c52a00f110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8021bf1b29564ef4bd2117eeb0edbcec'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:22:59.854247 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0da7e8eb-bc22-4a86-8099-f5c52a00f110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8021bf1b29564ef4bd2117eeb0edbcec'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:22:59.855037 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0da7e8eb-bc22-4a86-8099-f5c52a00f110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8021bf1b29564ef4bd2117eeb0edbcec'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:22:59.892384 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0da7e8eb-bc22-4a86-8099-f5c52a00f110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8021bf1b29564ef4bd2117eeb0edbcec'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:00.101385 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 811/1647] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:22:59 2022] DELETE /identity/v3/users/8021bf1b29564ef4bd2117eeb0edbcec => generated 0 bytes in 895 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:00.104698 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debfafe-3ce1-49a1-aaab-0dbf615a99ec None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:00.105179 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debfafe-3ce1-49a1-aaab-0dbf615a99ec None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:00.105247 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debfafe-3ce1-49a1-aaab-0dbf615a99ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:00.133798 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-5debfafe-3ce1-49a1-aaab-0dbf615a99ec None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:00.135048 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5debfafe-3ce1-49a1-aaab-0dbf615a99ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:00.316196 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 837/1648] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:00.333324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7e8eb-bc22-4a86-8099-f5c52a00f110 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:00.335636 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0da7e8eb-bc22-4a86-8099-f5c52a00f110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:00.360839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:00.464077 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7e8eb-bc22-4a86-8099-f5c52a00f110 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:00.468517 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcadd8-7fe8-4b8b-985c-630542573a0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:00.470144 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcadd8-7fe8-4b8b-985c-630542573a0f service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:00.470645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcadd8-7fe8-4b8b-985c-630542573a0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:00.471120 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcadd8-7fe8-4b8b-985c-630542573a0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:00.514703 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fcadd8-7fe8-4b8b-985c-630542573a0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:00.519902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fcadd8-7fe8-4b8b-985c-630542573a0f service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:00.617186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 812/1649] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:23:01.427493 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debfafe-3ce1-49a1-aaab-0dbf615a99ec None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:01.430638 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5debfafe-3ce1-49a1-aaab-0dbf615a99ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:01.454363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debfafe-3ce1-49a1-aaab-0dbf615a99ec None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:01.471861 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ddcb4-34be-4079-b137-1194cdb18692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:01.473069 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ddcb4-34be-4079-b137-1194cdb18692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:01.473561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ddcb4-34be-4079-b137-1194cdb18692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:01.474079 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ddcb4-34be-4079-b137-1194cdb18692 admin admin] PATH_INFO: `/v3/users/112f88a111774f258929fd8fcd96eb63` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:01.476741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ddcb4-34be-4079-b137-1194cdb18692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=112f88a111774f258929fd8fcd96eb63)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:01.484084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: WARNING py.warnings [None req-5f9ddcb4-34be-4079-b137-1194cdb18692 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 19:23:01.484084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: warnings.warn(msg) Jun 02 19:23:01.484084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: Jun 02 19:23:01.485949 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ddcb4-34be-4079-b137-1194cdb18692 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:01.799095 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:01.827734 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-5f9ddcb4-34be-4079-b137-1194cdb18692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '112f88a111774f258929fd8fcd96eb63'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:01.878216 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-5f9ddcb4-34be-4079-b137-1194cdb18692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '112f88a111774f258929fd8fcd96eb63'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:01.929302 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-5f9ddcb4-34be-4079-b137-1194cdb18692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '112f88a111774f258929fd8fcd96eb63'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:01.931941 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-5f9ddcb4-34be-4079-b137-1194cdb18692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '112f88a111774f258929fd8fcd96eb63'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:01.934326 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-5f9ddcb4-34be-4079-b137-1194cdb18692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '112f88a111774f258929fd8fcd96eb63'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:02.071651 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 838/1650] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:23:01 2022] DELETE /identity/v3/users/112f88a111774f258929fd8fcd96eb63 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:02.078037 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd2cae-5ff1-4c32-8cdb-bb53b352e974 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:02.078642 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd2cae-5ff1-4c32-8cdb-bb53b352e974 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:02.078642 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd2cae-5ff1-4c32-8cdb-bb53b352e974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:02.118109 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ddcb4-34be-4079-b137-1194cdb18692 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:02.119859 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5f9ddcb4-34be-4079-b137-1194cdb18692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:02.122637 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-58cd2cae-5ff1-4c32-8cdb-bb53b352e974 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:02.124514 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-58cd2cae-5ff1-4c32-8cdb-bb53b352e974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:02.290252 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ddcb4-34be-4079-b137-1194cdb18692 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:02.316101 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff29808-1b2c-4bd6-a7ee-d63177ceb646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:02.317363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff29808-1b2c-4bd6-a7ee-d63177ceb646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:02.317820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff29808-1b2c-4bd6-a7ee-d63177ceb646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:02.331766 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff29808-1b2c-4bd6-a7ee-d63177ceb646 admin admin] PATH_INFO: `/v3/projects/a6b7c2a8d14d4fae8a2f59bb8a51ed41` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:02.336906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 813/1651] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:02.338658 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff29808-1b2c-4bd6-a7ee-d63177ceb646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6b7c2a8d14d4fae8a2f59bb8a51ed41)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:02.344177 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff29808-1b2c-4bd6-a7ee-d63177ceb646 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:02.403665 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd2cae-5ff1-4c32-8cdb-bb53b352e974 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:02.405917 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-58cd2cae-5ff1-4c32-8cdb-bb53b352e974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:02.580186 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4ff29808-1b2c-4bd6-a7ee-d63177ceb646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6b7c2a8d14d4fae8a2f59bb8a51ed41', 'request_id': 'req-4ff29808-1b2c-4bd6-a7ee-d63177ceb646'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:02.606004 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd2cae-5ff1-4c32-8cdb-bb53b352e974 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:02.681683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4ff29808-1b2c-4bd6-a7ee-d63177ceb646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6b7c2a8d14d4fae8a2f59bb8a51ed41', 'request_id': 'req-4ff29808-1b2c-4bd6-a7ee-d63177ceb646'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:02.692170 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4ff29808-1b2c-4bd6-a7ee-d63177ceb646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6b7c2a8d14d4fae8a2f59bb8a51ed41', 'request_id': 'req-4ff29808-1b2c-4bd6-a7ee-d63177ceb646'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:02.739910 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e8554-f257-43e7-b12f-88b12e6d1354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:02.740642 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e8554-f257-43e7-b12f-88b12e6d1354 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:02.740930 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e8554-f257-43e7-b12f-88b12e6d1354 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:02.746509 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4ff29808-1b2c-4bd6-a7ee-d63177ceb646 admin admin] The token cache is being invalidate because project a6b7c2a8d14d4fae8a2f59bb8a51ed41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:23:02.747577 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4ff29808-1b2c-4bd6-a7ee-d63177ceb646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:02.748196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e8554-f257-43e7-b12f-88b12e6d1354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:02.760875 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4ff29808-1b2c-4bd6-a7ee-d63177ceb646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:02.767438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 839/1652] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:23:02 2022] DELETE /identity/v3/projects/a6b7c2a8d14d4fae8a2f59bb8a51ed41 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:02.769267 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b74dc7-021f-4b2e-83d1-d1769c716148 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:02.769803 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b74dc7-021f-4b2e-83d1-d1769c716148 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:02.770475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b74dc7-021f-4b2e-83d1-d1769c716148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:02.834155 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-48b74dc7-021f-4b2e-83d1-d1769c716148 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:02.835874 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-48b74dc7-021f-4b2e-83d1-d1769c716148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:02.944536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:03.010785 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e8554-f257-43e7-b12f-88b12e6d1354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:03.014935 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e8554-f257-43e7-b12f-88b12e6d1354 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:03.067634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 814/1653] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:03.083160 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 840/1654] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:03.090022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62f176-6b50-4cca-966f-f130202f7550 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:03.090022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62f176-6b50-4cca-966f-f130202f7550 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:03.090619 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62f176-6b50-4cca-966f-f130202f7550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:03.148492 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-3b62f176-6b50-4cca-966f-f130202f7550 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:03.154144 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3b62f176-6b50-4cca-966f-f130202f7550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:03.184259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 815/1655] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:03.184344 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b74dc7-021f-4b2e-83d1-d1769c716148 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:03.199599 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b74dc7-021f-4b2e-83d1-d1769c716148 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:03.204860 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b968377-34ac-46b2-b1c0-7c1eb6914739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:03.207198 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b968377-34ac-46b2-b1c0-7c1eb6914739 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:03.207198 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b968377-34ac-46b2-b1c0-7c1eb6914739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:03.207198 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b968377-34ac-46b2-b1c0-7c1eb6914739 admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:03.207198 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b968377-34ac-46b2-b1c0-7c1eb6914739 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:23:03.207198 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b968377-34ac-46b2-b1c0-7c1eb6914739 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:03.209066 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b968377-34ac-46b2-b1c0-7c1eb6914739 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:03.225221 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 841/1656] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:23:03.231148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62f176-6b50-4cca-966f-f130202f7550 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:03.243469 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62f176-6b50-4cca-966f-f130202f7550 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:03.251213 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23017b40-940d-41d2-85cc-af01cc84890e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:03.252505 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23017b40-940d-41d2-85cc-af01cc84890e admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:03.253017 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23017b40-940d-41d2-85cc-af01cc84890e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:03.253472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23017b40-940d-41d2-85cc-af01cc84890e admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:03.254546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23017b40-940d-41d2-85cc-af01cc84890e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:03.259300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23017b40-940d-41d2-85cc-af01cc84890e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:03.392610 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 816/1657] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:23:03 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:03.393938 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b968377-34ac-46b2-b1c0-7c1eb6914739 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:03.406655 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b968377-34ac-46b2-b1c0-7c1eb6914739 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:03.443746 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cfa1a-8625-497f-8b63-f106cb856ee7 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:03.444293 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cfa1a-8625-497f-8b63-f106cb856ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:03.444846 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cfa1a-8625-497f-8b63-f106cb856ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:03.508440 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49138c6c-63d7-4c9a-a5ce-89cbcc7d7bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:03.513107 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49138c6c-63d7-4c9a-a5ce-89cbcc7d7bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:03.514085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-7d3cfa1a-8625-497f-8b63-f106cb856ee7 None None] MFA Rules not processed for user `f8890c84089c48d291b3ff73e9b2e423`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:03.515633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49138c6c-63d7-4c9a-a5ce-89cbcc7d7bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:03.517180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7d3cfa1a-8625-497f-8b63-f106cb856ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:03.520257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49138c6c-63d7-4c9a-a5ce-89cbcc7d7bc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:03.523004 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49138c6c-63d7-4c9a-a5ce-89cbcc7d7bc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:03.532961 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49138c6c-63d7-4c9a-a5ce-89cbcc7d7bc8 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:03.667126 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 842/1658] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:23:03 2022] POST /identity/v3/users => generated 288 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:23:03.675596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49138c6c-63d7-4c9a-a5ce-89cbcc7d7bc8 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:03.714935 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49138c6c-63d7-4c9a-a5ce-89cbcc7d7bc8 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:03.731087 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a046744-b9e3-4637-bbf3-ab7f83c88e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:03.732089 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a046744-b9e3-4637-bbf3-ab7f83c88e4b admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:03.732516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a046744-b9e3-4637-bbf3-ab7f83c88e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:03.732936 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a046744-b9e3-4637-bbf3-ab7f83c88e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:03.733837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a046744-b9e3-4637-bbf3-ab7f83c88e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:03.736721 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a046744-b9e3-4637-bbf3-ab7f83c88e4b admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:03.811264 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 817/1659] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:03.819618 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 843/1660] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:23:03.824054 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cfa1a-8625-497f-8b63-f106cb856ee7 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:03.830070 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a046744-b9e3-4637-bbf3-ab7f83c88e4b admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:03.832823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-9a046744-b9e3-4637-bbf3-ab7f83c88e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:03.842013 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cfa1a-8625-497f-8b63-f106cb856ee7 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:03.847847 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e99ef7-c910-4a01-9bf2-748c97702437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:03.852464 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99ef7-c910-4a01-9bf2-748c97702437 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:03.852464 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99ef7-c910-4a01-9bf2-748c97702437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:03.852464 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99ef7-c910-4a01-9bf2-748c97702437 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:03.852464 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e99ef7-c910-4a01-9bf2-748c97702437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:03.852464 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e99ef7-c910-4a01-9bf2-748c97702437 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:03.881513 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 818/1661] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:23:03.887630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e99ef7-c910-4a01-9bf2-748c97702437 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:03.911074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e99ef7-c910-4a01-9bf2-748c97702437 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:03.937525 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b57057-7139-4cea-92f0-a9d6e4304662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:03.938516 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b57057-7139-4cea-92f0-a9d6e4304662 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:03.938797 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b57057-7139-4cea-92f0-a9d6e4304662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:03.939071 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b57057-7139-4cea-92f0-a9d6e4304662 admin admin] PATH_INFO: `/v3/projects/7ffa588569294c0e8e3d6a72889113b2/users/3948079ac091417a91c8f3511afe0b61/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:03.992167 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:04.041798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b57057-7139-4cea-92f0-a9d6e4304662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ffa588569294c0e8e3d6a72889113b2, user_id=3948079ac091417a91c8f3511afe0b61, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:04.054422 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b57057-7139-4cea-92f0-a9d6e4304662 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:04.210516 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 819/1662] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:23:03 2022] PUT /identity/v3/projects/7ffa588569294c0e8e3d6a72889113b2/users/3948079ac091417a91c8f3511afe0b61/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:23:04.229549 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a046744-b9e3-4637-bbf3-ab7f83c88e4b admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:04.235375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac07af-ac1e-4a4d-b385-f96a6ca495e6 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:04.235840 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac07af-ac1e-4a4d-b385-f96a6ca495e6 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:04.236367 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac07af-ac1e-4a4d-b385-f96a6ca495e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:04.342040 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-b8ac07af-ac1e-4a4d-b385-f96a6ca495e6 None None] MFA Rules not processed for user `3948079ac091417a91c8f3511afe0b61`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:04.346698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b8ac07af-ac1e-4a4d-b385-f96a6ca495e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:04.497702 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:04.556362 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c162472-5f7f-4d18-8a04-7006728f0031 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:04.558542 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c162472-5f7f-4d18-8a04-7006728f0031 service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:04.558542 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c162472-5f7f-4d18-8a04-7006728f0031 service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:04.558542 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c162472-5f7f-4d18-8a04-7006728f0031 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:04.747119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 820/1663] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 514 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:04.754412 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c162472-5f7f-4d18-8a04-7006728f0031 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:04.769062 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c162472-5f7f-4d18-8a04-7006728f0031 service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:04.801963 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 844/1664] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 973 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:04.863032 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac07af-ac1e-4a4d-b385-f96a6ca495e6 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:04.865594 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b8ac07af-ac1e-4a4d-b385-f96a6ca495e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:04.893531 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6beda8-e521-41f6-bb33-cb09b646e136 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:04.893819 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6beda8-e521-41f6-bb33-cb09b646e136 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:04.895019 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6beda8-e521-41f6-bb33-cb09b646e136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:04.925296 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac07af-ac1e-4a4d-b385-f96a6ca495e6 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:04.945516 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bef8c-81ba-4bd7-ac42-bcde67ad589a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:04.946250 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bef8c-81ba-4bd7-ac42-bcde67ad589a service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:04.949078 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-5b6beda8-e521-41f6-bb33-cb09b646e136 None None] MFA Rules not processed for user `235042beafd246c5b227b3926098c8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:04.950984 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bef8c-81ba-4bd7-ac42-bcde67ad589a service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:04.955760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bef8c-81ba-4bd7-ac42-bcde67ad589a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:04.958717 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5b6beda8-e521-41f6-bb33-cb09b646e136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:04.993527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39bef8c-81ba-4bd7-ac42-bcde67ad589a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:04.993527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39bef8c-81ba-4bd7-ac42-bcde67ad589a service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:05.023590 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 821/1665] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:05.149102 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 845/1666] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jun 2 19:23:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:23:05.541809 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bef8c-81ba-4bd7-ac42-bcde67ad589a service nova] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:05.778136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6beda8-e521-41f6-bb33-cb09b646e136 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:05.783023 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5b6beda8-e521-41f6-bb33-cb09b646e136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:05.798811 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:05.919148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bef8c-81ba-4bd7-ac42-bcde67ad589a service nova] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:05.944624 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45199b71-8ee9-40c9-8284-d9996db28322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:05.949117 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45199b71-8ee9-40c9-8284-d9996db28322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:05.949565 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45199b71-8ee9-40c9-8284-d9996db28322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:05.949980 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45199b71-8ee9-40c9-8284-d9996db28322 admin admin] PATH_INFO: `/v3/users/3948079ac091417a91c8f3511afe0b61` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:05.959879 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45199b71-8ee9-40c9-8284-d9996db28322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3948079ac091417a91c8f3511afe0b61)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:05.965857 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45199b71-8ee9-40c9-8284-d9996db28322 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:06.225627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6beda8-e521-41f6-bb33-cb09b646e136 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:06.238005 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e9d97-0280-4aee-8617-d8786f6b6f70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ba0ab9510d49c4ab4c634e82790efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:06.246947 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e9d97-0280-4aee-8617-d8786f6b6f70 service swift] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:06.247913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e9d97-0280-4aee-8617-d8786f6b6f70 service swift] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:06.248766 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e9d97-0280-4aee-8617-d8786f6b6f70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:06.278063 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e9d97-0280-4aee-8617-d8786f6b6f70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:06.284473 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e9d97-0280-4aee-8617-d8786f6b6f70 service swift] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:06.338593 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 846/1667] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jun 2 19:23:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 19:23:06.340177 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e9d97-0280-4aee-8617-d8786f6b6f70 service swift] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:06.349928 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-ab3e9d97-0280-4aee-8617-d8786f6b6f70 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:06.357140 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-45199b71-8ee9-40c9-8284-d9996db28322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3948079ac091417a91c8f3511afe0b61'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:06.442235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-45199b71-8ee9-40c9-8284-d9996db28322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3948079ac091417a91c8f3511afe0b61'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:06.451225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e9d97-0280-4aee-8617-d8786f6b6f70 service swift] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:06.457446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-45199b71-8ee9-40c9-8284-d9996db28322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3948079ac091417a91c8f3511afe0b61'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:06.463230 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c9b56-558c-40cd-b1da-8abb78391f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:06.464568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-45199b71-8ee9-40c9-8284-d9996db28322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3948079ac091417a91c8f3511afe0b61'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:06.465152 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c9b56-558c-40cd-b1da-8abb78391f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:06.468048 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c9b56-558c-40cd-b1da-8abb78391f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:06.468048 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c9b56-558c-40cd-b1da-8abb78391f09 admin admin] PATH_INFO: `/v3/projects/a7fa411193fa4faa8bf3d7266c989727` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:06.468680 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c9b56-558c-40cd-b1da-8abb78391f09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7fa411193fa4faa8bf3d7266c989727)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:06.473996 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c9b56-558c-40cd-b1da-8abb78391f09 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:06.523015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-45199b71-8ee9-40c9-8284-d9996db28322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3948079ac091417a91c8f3511afe0b61'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:06.644310 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 822/1668] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:23:05 2022] DELETE /identity/v3/users/3948079ac091417a91c8f3511afe0b61 => generated 0 bytes in 1103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:06.652260 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9057b87-c2ca-45b8-a5a6-31a7cfb1c371 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:06.652553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9057b87-c2ca-45b8-a5a6-31a7cfb1c371 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:06.652834 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9057b87-c2ca-45b8-a5a6-31a7cfb1c371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:06.733092 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-d9057b87-c2ca-45b8-a5a6-31a7cfb1c371 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:06.734635 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d9057b87-c2ca-45b8-a5a6-31a7cfb1c371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:06.784943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-9b3c9b56-558c-40cd-b1da-8abb78391f09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7fa411193fa4faa8bf3d7266c989727', 'request_id': 'req-9b3c9b56-558c-40cd-b1da-8abb78391f09'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:06.889710 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-9b3c9b56-558c-40cd-b1da-8abb78391f09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7fa411193fa4faa8bf3d7266c989727', 'request_id': 'req-9b3c9b56-558c-40cd-b1da-8abb78391f09'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:06.929634 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-9b3c9b56-558c-40cd-b1da-8abb78391f09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7fa411193fa4faa8bf3d7266c989727', 'request_id': 'req-9b3c9b56-558c-40cd-b1da-8abb78391f09'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:07.043901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:07.046442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-9b3c9b56-558c-40cd-b1da-8abb78391f09 admin admin] The token cache is being invalidate because project a7fa411193fa4faa8bf3d7266c989727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:23:07.053098 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-9b3c9b56-558c-40cd-b1da-8abb78391f09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:07.064923 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-9b3c9b56-558c-40cd-b1da-8abb78391f09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:07.075860 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 847/1669] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:23:06 2022] DELETE /identity/v3/projects/a7fa411193fa4faa8bf3d7266c989727 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:07.083789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a584602-4a6c-4b63-906b-6fd93bf42987 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:07.086608 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a584602-4a6c-4b63-906b-6fd93bf42987 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:07.092478 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a584602-4a6c-4b63-906b-6fd93bf42987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:07.210799 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-9a584602-4a6c-4b63-906b-6fd93bf42987 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:07.221664 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-9a584602-4a6c-4b63-906b-6fd93bf42987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:07.244520 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 823/1670] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 592 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:07.271551 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9057b87-c2ca-45b8-a5a6-31a7cfb1c371 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:07.278489 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d9057b87-c2ca-45b8-a5a6-31a7cfb1c371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:07.280601 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 848/1671] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:07.290119 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b57f3-ae0b-4df4-8a6c-189233a6991b None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:07.290690 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b57f3-ae0b-4df4-8a6c-189233a6991b None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:07.292732 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:07.293381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b57f3-ae0b-4df4-8a6c-189233a6991b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:07.329075 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-e69b57f3-ae0b-4df4-8a6c-189233a6991b None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:07.333768 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-e69b57f3-ae0b-4df4-8a6c-189233a6991b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:07.369612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 849/1672] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:07.384827 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b57f3-ae0b-4df4-8a6c-189233a6991b None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:07.437956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b57f3-ae0b-4df4-8a6c-189233a6991b None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:07.453127 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9c978-7e65-4117-8cdc-bebd7d862cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:07.454186 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9c978-7e65-4117-8cdc-bebd7d862cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:07.454611 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9c978-7e65-4117-8cdc-bebd7d862cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:07.455195 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9c978-7e65-4117-8cdc-bebd7d862cb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:07.458686 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9c978-7e65-4117-8cdc-bebd7d862cb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:23:07.460637 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9c978-7e65-4117-8cdc-bebd7d862cb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:07.467673 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9c978-7e65-4117-8cdc-bebd7d862cb1 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:07.503432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 850/1673] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:23:07.510946 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9c978-7e65-4117-8cdc-bebd7d862cb1 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:07.527225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9c978-7e65-4117-8cdc-bebd7d862cb1 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:07.539155 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a89552-4163-40a1-9460-c0ede901285c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:07.541669 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a89552-4163-40a1-9460-c0ede901285c admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:07.543704 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a89552-4163-40a1-9460-c0ede901285c admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:07.547784 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a89552-4163-40a1-9460-c0ede901285c admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:07.547784 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a89552-4163-40a1-9460-c0ede901285c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:07.553358 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a89552-4163-40a1-9460-c0ede901285c admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:07.592649 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9057b87-c2ca-45b8-a5a6-31a7cfb1c371 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:07.635896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4dc33-f5ef-4125-b544-473af3b7963f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:07.635896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4dc33-f5ef-4125-b544-473af3b7963f service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:07.638994 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4dc33-f5ef-4125-b544-473af3b7963f service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:07.641946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4dc33-f5ef-4125-b544-473af3b7963f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:07.685166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 851/1674] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:23:07 2022] POST /identity/v3/projects => generated 403 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:23:07.686786 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a89552-4163-40a1-9460-c0ede901285c admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:07.690998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4dc33-f5ef-4125-b544-473af3b7963f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:07.699486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4dc33-f5ef-4125-b544-473af3b7963f service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:07.766862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 824/1675] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:07.852149 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a89552-4163-40a1-9460-c0ede901285c admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:07.874615 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cbb5d-a5d1-4b81-a3f0-e990a637ace3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:07.879672 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cbb5d-a5d1-4b81-a3f0-e990a637ace3 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:07.879672 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cbb5d-a5d1-4b81-a3f0-e990a637ace3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:07.880861 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cbb5d-a5d1-4b81-a3f0-e990a637ace3 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:07.884467 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6cbb5d-a5d1-4b81-a3f0-e990a637ace3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:07.906202 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6cbb5d-a5d1-4b81-a3f0-e990a637ace3 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:08.111873 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 852/1676] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:23:07 2022] POST /identity/v3/users => generated 302 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:08.115261 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4dc33-f5ef-4125-b544-473af3b7963f service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:08.156404 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4dc33-f5ef-4125-b544-473af3b7963f service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:08.222873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b436f20-00a1-4c3e-a19f-e46b9fa85802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:08.225357 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b436f20-00a1-4c3e-a19f-e46b9fa85802 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:08.225800 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b436f20-00a1-4c3e-a19f-e46b9fa85802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:08.228898 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b436f20-00a1-4c3e-a19f-e46b9fa85802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:08.228898 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b436f20-00a1-4c3e-a19f-e46b9fa85802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:08.235437 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b436f20-00a1-4c3e-a19f-e46b9fa85802 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:08.303671 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 825/1677] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:23:08.305199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cbb5d-a5d1-4b81-a3f0-e990a637ace3 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:08.334007 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cbb5d-a5d1-4b81-a3f0-e990a637ace3 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:08.508690 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76311e0b-27bf-4cb5-a9b3-01508904ba80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:08.508690 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76311e0b-27bf-4cb5-a9b3-01508904ba80 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:08.508690 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76311e0b-27bf-4cb5-a9b3-01508904ba80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:08.508690 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76311e0b-27bf-4cb5-a9b3-01508904ba80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:08.511566 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76311e0b-27bf-4cb5-a9b3-01508904ba80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:08.511566 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76311e0b-27bf-4cb5-a9b3-01508904ba80 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:08.511566 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 853/1678] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:23:08.512125 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b436f20-00a1-4c3e-a19f-e46b9fa85802 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:08.512125 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b436f20-00a1-4c3e-a19f-e46b9fa85802 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:08.512125 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351af9ce-f11b-426a-9035-b8b3a82235bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:08.512125 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af9ce-f11b-426a-9035-b8b3a82235bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:08.512385 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af9ce-f11b-426a-9035-b8b3a82235bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:08.512385 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af9ce-f11b-426a-9035-b8b3a82235bf admin admin] PATH_INFO: `/v3/projects/b9033eadc805452e9718596b47f12a32/users/4905cef89e384a4285fc28c9f1e924a5/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:08.573394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351af9ce-f11b-426a-9035-b8b3a82235bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9033eadc805452e9718596b47f12a32, user_id=4905cef89e384a4285fc28c9f1e924a5, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:08.573394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351af9ce-f11b-426a-9035-b8b3a82235bf admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:08.959176 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 826/1679] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:23:08 2022] PUT /identity/v3/projects/b9033eadc805452e9718596b47f12a32/users/4905cef89e384a4285fc28c9f1e924a5/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:08.962886 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0eac2-6f4e-40a3-865d-9b36a6d6d6e0 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:08.964622 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0eac2-6f4e-40a3-865d-9b36a6d6d6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:08.965548 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0eac2-6f4e-40a3-865d-9b36a6d6d6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:09.045285 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-05b0eac2-6f4e-40a3-865d-9b36a6d6d6e0 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:09.047774 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-05b0eac2-6f4e-40a3-865d-9b36a6d6d6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:09.182225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:09.251501 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 854/1680] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:09.343714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351af9ce-f11b-426a-9035-b8b3a82235bf admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:09.434866 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52079f53-2bbb-4c72-8d65-db13861d2d6a None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:09.434866 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52079f53-2bbb-4c72-8d65-db13861d2d6a None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:09.434866 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52079f53-2bbb-4c72-8d65-db13861d2d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:09.472898 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-52079f53-2bbb-4c72-8d65-db13861d2d6a None None] MFA Rules not processed for user `2efd679ca9314c8591cabbca15f8c61b`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:09.483979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-52079f53-2bbb-4c72-8d65-db13861d2d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:09.654762 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 855/1681] 10.222.0.48 () {58 vars in 1015 bytes} [Thu Jun 2 19:23:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:09.678524 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52079f53-2bbb-4c72-8d65-db13861d2d6a None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:09.680822 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-52079f53-2bbb-4c72-8d65-db13861d2d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:09.703954 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52079f53-2bbb-4c72-8d65-db13861d2d6a None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:09.704490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351af9ce-f11b-426a-9035-b8b3a82235bf admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:09.721706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852b6bd-c5ae-42c4-b555-02dfc5181ffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:09.731506 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852b6bd-c5ae-42c4-b555-02dfc5181ffa service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:09.731915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93b8b8-6e6a-410f-9c9a-1ba79f508300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:09.731915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93b8b8-6e6a-410f-9c9a-1ba79f508300 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:09.731915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93b8b8-6e6a-410f-9c9a-1ba79f508300 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:09.731915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93b8b8-6e6a-410f-9c9a-1ba79f508300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:09.732516 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852b6bd-c5ae-42c4-b555-02dfc5181ffa service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:09.732516 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852b6bd-c5ae-42c4-b555-02dfc5181ffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:09.755653 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93b8b8-6e6a-410f-9c9a-1ba79f508300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:09.758932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93b8b8-6e6a-410f-9c9a-1ba79f508300 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:09.764795 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852b6bd-c5ae-42c4-b555-02dfc5181ffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:09.772611 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852b6bd-c5ae-42c4-b555-02dfc5181ffa service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:09.786755 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 856/1682] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:23:09.838296 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 827/1683] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:10.341384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8a033-3ab8-4237-84a6-faf2805dbc98 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:10.342419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8a033-3ab8-4237-84a6-faf2805dbc98 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:10.342910 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8a033-3ab8-4237-84a6-faf2805dbc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:10.430901 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-40e8a033-3ab8-4237-84a6-faf2805dbc98 None None] MFA Rules not processed for user `8fce5ea9cc1346b89cce855aaaa77466`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:10.432597 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-40e8a033-3ab8-4237-84a6-faf2805dbc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:10.604143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 857/1684] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:10.613689 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b951e9-5fb1-4253-ba96-bc8a256e54e9 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:10.614263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b951e9-5fb1-4253-ba96-bc8a256e54e9 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:10.615450 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b951e9-5fb1-4253-ba96-bc8a256e54e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:10.649912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-99b951e9-5fb1-4253-ba96-bc8a256e54e9 None None] MFA Rules not processed for user `8fce5ea9cc1346b89cce855aaaa77466`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:10.651316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-99b951e9-5fb1-4253-ba96-bc8a256e54e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:10.675176 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 828/1685] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:23:10.689362 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8a033-3ab8-4237-84a6-faf2805dbc98 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:10.691020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-40e8a033-3ab8-4237-84a6-faf2805dbc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:10.816976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:10.857785 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8a033-3ab8-4237-84a6-faf2805dbc98 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:10.895274 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064b9f2-6f4c-4a8b-83f9-83c347cf67a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:10.896225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064b9f2-6f4c-4a8b-83f9-83c347cf67a6 service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:10.898247 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064b9f2-6f4c-4a8b-83f9-83c347cf67a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:10.900837 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b951e9-5fb1-4253-ba96-bc8a256e54e9 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:10.902635 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-99b951e9-5fb1-4253-ba96-bc8a256e54e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:10.913944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064b9f2-6f4c-4a8b-83f9-83c347cf67a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:10.950371 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b951e9-5fb1-4253-ba96-bc8a256e54e9 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:10.952799 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064b9f2-6f4c-4a8b-83f9-83c347cf67a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:10.959576 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064b9f2-6f4c-4a8b-83f9-83c347cf67a6 service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:10.971142 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4315e-8877-4042-a561-09735dcbebec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:10.972224 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4315e-8877-4042-a561-09735dcbebec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:10.972630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4315e-8877-4042-a561-09735dcbebec admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:10.973922 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4315e-8877-4042-a561-09735dcbebec admin admin] PATH_INFO: `/v3/projects/7ffa588569294c0e8e3d6a72889113b2` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:10.979086 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4315e-8877-4042-a561-09735dcbebec admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ffa588569294c0e8e3d6a72889113b2)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:10.980350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: WARNING py.warnings [None req-baa4315e-8877-4042-a561-09735dcbebec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 19:23:10.980350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: warnings.warn(msg) Jun 02 19:23:10.980350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: Jun 02 19:23:10.985007 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4315e-8877-4042-a561-09735dcbebec admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:10.994757 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 858/1686] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:23:11.271877 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:11.339494 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-baa4315e-8877-4042-a561-09735dcbebec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ffa588569294c0e8e3d6a72889113b2', 'request_id': 'req-baa4315e-8877-4042-a561-09735dcbebec'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:11.369658 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-baa4315e-8877-4042-a561-09735dcbebec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ffa588569294c0e8e3d6a72889113b2', 'request_id': 'req-baa4315e-8877-4042-a561-09735dcbebec'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:11.491482 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-baa4315e-8877-4042-a561-09735dcbebec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ffa588569294c0e8e3d6a72889113b2', 'request_id': 'req-baa4315e-8877-4042-a561-09735dcbebec'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:11.515590 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-baa4315e-8877-4042-a561-09735dcbebec admin admin] The token cache is being invalidate because project 7ffa588569294c0e8e3d6a72889113b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:23:11.521089 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-baa4315e-8877-4042-a561-09735dcbebec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:11.523705 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-baa4315e-8877-4042-a561-09735dcbebec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:11.532396 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 829/1687] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:23:10 2022] DELETE /identity/v3/projects/7ffa588569294c0e8e3d6a72889113b2 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:11.540913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83027c1-faaa-445f-aa27-0cfbdbcf5f9a None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:11.541706 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83027c1-faaa-445f-aa27-0cfbdbcf5f9a None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:11.541968 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83027c1-faaa-445f-aa27-0cfbdbcf5f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:11.599815 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-d83027c1-faaa-445f-aa27-0cfbdbcf5f9a None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:11.603190 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-d83027c1-faaa-445f-aa27-0cfbdbcf5f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:11.813570 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 859/1688] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:23:11.828292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9247f9-1dfc-4a57-bcef-b4f3c9a8f7e0 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:11.828872 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9247f9-1dfc-4a57-bcef-b4f3c9a8f7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:11.829073 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9247f9-1dfc-4a57-bcef-b4f3c9a8f7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:11.863813 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-5b9247f9-1dfc-4a57-bcef-b4f3c9a8f7e0 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:11.873595 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5b9247f9-1dfc-4a57-bcef-b4f3c9a8f7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:11.913575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 830/1689] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 02 19:23:11.913881 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83027c1-faaa-445f-aa27-0cfbdbcf5f9a None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:11.946039 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83027c1-faaa-445f-aa27-0cfbdbcf5f9a None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:11.986434 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e8dfd-1a28-4242-b717-ab5749ef43b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:11.987939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e8dfd-1a28-4242-b717-ab5749ef43b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:11.988489 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e8dfd-1a28-4242-b717-ab5749ef43b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:11.988977 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e8dfd-1a28-4242-b717-ab5749ef43b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:11.993683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e8dfd-1a28-4242-b717-ab5749ef43b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:23:12.000604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e8dfd-1a28-4242-b717-ab5749ef43b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:12.007332 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e8dfd-1a28-4242-b717-ab5749ef43b9 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:12.056257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 860/1690] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:23:12.063145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9247f9-1dfc-4a57-bcef-b4f3c9a8f7e0 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:12.118154 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9247f9-1dfc-4a57-bcef-b4f3c9a8f7e0 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:12.165902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710616da-7968-4cfb-9441-2a6198ce2026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:12.174840 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710616da-7968-4cfb-9441-2a6198ce2026 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:12.187180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710616da-7968-4cfb-9441-2a6198ce2026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:12.187180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710616da-7968-4cfb-9441-2a6198ce2026 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:12.187180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710616da-7968-4cfb-9441-2a6198ce2026 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:12.187180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710616da-7968-4cfb-9441-2a6198ce2026 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:12.377416 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 831/1691] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:23:12 2022] POST /identity/v3/projects => generated 401 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:23:12.379129 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e8dfd-1a28-4242-b717-ab5749ef43b9 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:12.401303 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e8dfd-1a28-4242-b717-ab5749ef43b9 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:12.645328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bb759-3848-4055-aa79-bfcea111ed61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:12.646302 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bb759-3848-4055-aa79-bfcea111ed61 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:12.646840 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bb759-3848-4055-aa79-bfcea111ed61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:12.647329 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bb759-3848-4055-aa79-bfcea111ed61 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:12.648335 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bb759-3848-4055-aa79-bfcea111ed61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:12.650689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bb759-3848-4055-aa79-bfcea111ed61 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:12.802165 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 861/1692] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:23:12 2022] POST /identity/v3/users => generated 301 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:12.808959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710616da-7968-4cfb-9441-2a6198ce2026 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:12.829196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710616da-7968-4cfb-9441-2a6198ce2026 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:12.866822 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d99e0-fd36-44dd-9fd1-02cbaa729aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:12.867722 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d99e0-fd36-44dd-9fd1-02cbaa729aec admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:12.868043 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d99e0-fd36-44dd-9fd1-02cbaa729aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:12.868352 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d99e0-fd36-44dd-9fd1-02cbaa729aec admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:12.871329 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d99e0-fd36-44dd-9fd1-02cbaa729aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:12.876920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d99e0-fd36-44dd-9fd1-02cbaa729aec admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:12.969601 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 832/1693] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:23:12.977420 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bb759-3848-4055-aa79-bfcea111ed61 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:13.042650 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bb759-3848-4055-aa79-bfcea111ed61 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:13.079364 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e5a28-7762-494f-a743-dcfad33ad7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:13.090044 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e5a28-7762-494f-a743-dcfad33ad7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:13.090745 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e5a28-7762-494f-a743-dcfad33ad7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:13.091518 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e5a28-7762-494f-a743-dcfad33ad7f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:13.093391 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e5a28-7762-494f-a743-dcfad33ad7f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:13.097306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e5a28-7762-494f-a743-dcfad33ad7f7 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:13.142705 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d99e0-fd36-44dd-9fd1-02cbaa729aec admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:13.161340 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 862/1694] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:23:13.180922 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d99e0-fd36-44dd-9fd1-02cbaa729aec admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:13.217987 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4fda1-c2ad-4444-97f7-fdb82efff588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:13.222017 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4fda1-c2ad-4444-97f7-fdb82efff588 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:13.222726 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4fda1-c2ad-4444-97f7-fdb82efff588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:13.223243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4fda1-c2ad-4444-97f7-fdb82efff588 admin admin] PATH_INFO: `/v3/projects/521ebb716531441d8870538f8f193dbb/users/d2d1f8fe7e6e48eab9f6a1ab8e756fdb/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:13.280661 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4fda1-c2ad-4444-97f7-fdb82efff588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=521ebb716531441d8870538f8f193dbb, user_id=d2d1f8fe7e6e48eab9f6a1ab8e756fdb, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:13.300351 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4fda1-c2ad-4444-97f7-fdb82efff588 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:13.462575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 833/1695] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:23:13 2022] PUT /identity/v3/projects/521ebb716531441d8870538f8f193dbb/users/d2d1f8fe7e6e48eab9f6a1ab8e756fdb/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:13.488824 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44a77b-716d-4cc9-b1e4-7d302be0a10e None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:13.493914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44a77b-716d-4cc9-b1e4-7d302be0a10e None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:13.494871 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44a77b-716d-4cc9-b1e4-7d302be0a10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:13.602233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-1c44a77b-716d-4cc9-b1e4-7d302be0a10e None None] MFA Rules not processed for user `d2d1f8fe7e6e48eab9f6a1ab8e756fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:13.604817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-1c44a77b-716d-4cc9-b1e4-7d302be0a10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:13.779513 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:13.992858 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 863/1696] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 507 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:14.002378 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4fda1-c2ad-4444-97f7-fdb82efff588 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:14.285427 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4fda1-c2ad-4444-97f7-fdb82efff588 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:14.296735 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee7138-de38-4484-8926-8647cc20828f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:14.312587 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee7138-de38-4484-8926-8647cc20828f admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:14.313493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee7138-de38-4484-8926-8647cc20828f admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:14.313969 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee7138-de38-4484-8926-8647cc20828f admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:14.315522 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee7138-de38-4484-8926-8647cc20828f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:14.331704 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee7138-de38-4484-8926-8647cc20828f admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:14.489962 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44a77b-716d-4cc9-b1e4-7d302be0a10e None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:14.502593 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 834/1697] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:23:14 2022] POST /identity/v3/projects => generated 405 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:14.522903 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44a77b-716d-4cc9-b1e4-7d302be0a10e None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:14.687259 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60ea27-42c7-41d2-a66a-9e50aa285514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:14.687259 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60ea27-42c7-41d2-a66a-9e50aa285514 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:14.687259 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60ea27-42c7-41d2-a66a-9e50aa285514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:14.687259 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60ea27-42c7-41d2-a66a-9e50aa285514 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:14.687816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60ea27-42c7-41d2-a66a-9e50aa285514 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:14.689963 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60ea27-42c7-41d2-a66a-9e50aa285514 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:14.813768 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 864/1698] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:23:14 2022] POST /identity/v3/users => generated 309 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:14.822232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee7138-de38-4484-8926-8647cc20828f admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:14.874145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee7138-de38-4484-8926-8647cc20828f admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:14.925909 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c405d3-c1b0-46ab-b040-2ec334bdf664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:14.929297 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c405d3-c1b0-46ab-b040-2ec334bdf664 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:14.932387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c405d3-c1b0-46ab-b040-2ec334bdf664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:14.936979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c405d3-c1b0-46ab-b040-2ec334bdf664 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:14.939150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c405d3-c1b0-46ab-b040-2ec334bdf664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:14.946197 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c405d3-c1b0-46ab-b040-2ec334bdf664 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:14.995792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 835/1699] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:23:14.997812 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60ea27-42c7-41d2-a66a-9e50aa285514 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:15.032934 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60ea27-42c7-41d2-a66a-9e50aa285514 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:15.046471 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb6d94-2681-4999-ba5e-8a74e8751d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:15.049972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb6d94-2681-4999-ba5e-8a74e8751d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:15.051162 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb6d94-2681-4999-ba5e-8a74e8751d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:15.055158 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb6d94-2681-4999-ba5e-8a74e8751d86 admin admin] PATH_INFO: `/v3/projects/434c6901f32d44b09bb0c33c796ee4d9/users/c04e38b0df3f4704a0c39d6c2767e988/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:15.124321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb6d94-2681-4999-ba5e-8a74e8751d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=434c6901f32d44b09bb0c33c796ee4d9, user_id=c04e38b0df3f4704a0c39d6c2767e988, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:15.132236 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb6d94-2681-4999-ba5e-8a74e8751d86 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:15.319088 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 865/1700] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:23:14 2022] PUT /identity/v3/projects/434c6901f32d44b09bb0c33c796ee4d9/users/c04e38b0df3f4704a0c39d6c2767e988/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:15.319608 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c405d3-c1b0-46ab-b040-2ec334bdf664 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:15.339750 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c405d3-c1b0-46ab-b040-2ec334bdf664 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:15.456382 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46259273-e1d3-411d-b319-092b90314132 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:15.460492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46259273-e1d3-411d-b319-092b90314132 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:15.460492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46259273-e1d3-411d-b319-092b90314132 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:15.460798 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 866/1701] 10.222.0.45 () {54 vars in 912 bytes} [Thu Jun 2 19:23:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:23:15.478492 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:15.500307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c804344-224a-42f7-9b45-a72b1bbb9779 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:15.501822 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c804344-224a-42f7-9b45-a72b1bbb9779 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:15.502528 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c804344-224a-42f7-9b45-a72b1bbb9779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:15.567055 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3060c2d-8a8b-41cd-b266-160c2fd109fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:15.568348 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3060c2d-8a8b-41cd-b266-160c2fd109fe admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:15.568348 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3060c2d-8a8b-41cd-b266-160c2fd109fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:15.568622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3060c2d-8a8b-41cd-b266-160c2fd109fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:15.569177 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3060c2d-8a8b-41cd-b266-160c2fd109fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:15.579105 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3060c2d-8a8b-41cd-b266-160c2fd109fe admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:15.622973 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 836/1702] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:23:15.624346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3060c2d-8a8b-41cd-b266-160c2fd109fe admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:15.665664 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3060c2d-8a8b-41cd-b266-160c2fd109fe admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:15.689654 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28017d90-5021-4c34-b09c-7373521c1891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:15.695515 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28017d90-5021-4c34-b09c-7373521c1891 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:15.695515 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28017d90-5021-4c34-b09c-7373521c1891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:15.695515 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28017d90-5021-4c34-b09c-7373521c1891 admin admin] PATH_INFO: `/v3/projects/434c6901f32d44b09bb0c33c796ee4d9/users/c04e38b0df3f4704a0c39d6c2767e988/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:15.708608 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28017d90-5021-4c34-b09c-7373521c1891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=434c6901f32d44b09bb0c33c796ee4d9, user_id=c04e38b0df3f4704a0c39d6c2767e988, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:15.709251 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-7c804344-224a-42f7-9b45-a72b1bbb9779 None None] MFA Rules not processed for user `2efd679ca9314c8591cabbca15f8c61b`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:15.714381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-7c804344-224a-42f7-9b45-a72b1bbb9779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:15.719207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28017d90-5021-4c34-b09c-7373521c1891 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:15.768030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 837/1703] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:23:15 2022] PUT /identity/v3/projects/434c6901f32d44b09bb0c33c796ee4d9/users/c04e38b0df3f4704a0c39d6c2767e988/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:23:15.779151 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd8810-e568-4825-871c-9c4d5f59a48d None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:15.779525 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd8810-e568-4825-871c-9c4d5f59a48d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:15.779897 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd8810-e568-4825-871c-9c4d5f59a48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:15.844591 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-a6cd8810-e568-4825-871c-9c4d5f59a48d None None] MFA Rules not processed for user `c04e38b0df3f4704a0c39d6c2767e988`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:15.846861 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a6cd8810-e568-4825-871c-9c4d5f59a48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:16.027552 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 838/1704] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:15 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:23:16.044182 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd8810-e568-4825-871c-9c4d5f59a48d None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:16.049178 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a6cd8810-e568-4825-871c-9c4d5f59a48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:16.110488 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 867/1705] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jun 2 19:23:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 626 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:23:16.177791 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c804344-224a-42f7-9b45-a72b1bbb9779 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:16.187681 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-7c804344-224a-42f7-9b45-a72b1bbb9779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:16.241412 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c804344-224a-42f7-9b45-a72b1bbb9779 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:16.326728 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd8810-e568-4825-871c-9c4d5f59a48d None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:16.351037 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745b228-74f9-4bcb-a7e0-a0506ff03d94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:16.351037 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745b228-74f9-4bcb-a7e0-a0506ff03d94 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:16.351037 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745b228-74f9-4bcb-a7e0-a0506ff03d94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:16.351037 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745b228-74f9-4bcb-a7e0-a0506ff03d94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:16.386889 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745b228-74f9-4bcb-a7e0-a0506ff03d94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:16.388453 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745b228-74f9-4bcb-a7e0-a0506ff03d94 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:16.424248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 839/1706] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:16 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:16.607135 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e38d2-4d41-4d26-ae65-c02fb6dc084e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:16.607135 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e38d2-4d41-4d26-ae65-c02fb6dc084e service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:16.607135 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e38d2-4d41-4d26-ae65-c02fb6dc084e service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:16.607135 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e38d2-4d41-4d26-ae65-c02fb6dc084e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:16.637568 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:16.676463 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e38d2-4d41-4d26-ae65-c02fb6dc084e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:16.680299 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e38d2-4d41-4d26-ae65-c02fb6dc084e service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:16.744571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 868/1707] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:16.744902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745b228-74f9-4bcb-a7e0-a0506ff03d94 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:16.958364 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:16.977226 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da29fc5-c60d-4113-abfe-143bc85f88df None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:16.977530 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da29fc5-c60d-4113-abfe-143bc85f88df None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:16.977817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da29fc5-c60d-4113-abfe-143bc85f88df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:17.057942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745b228-74f9-4bcb-a7e0-a0506ff03d94 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:17.083947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37817510-0dd9-4d72-b523-c58728752159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:17.085449 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37817510-0dd9-4d72-b523-c58728752159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:17.086124 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37817510-0dd9-4d72-b523-c58728752159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:17.086673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37817510-0dd9-4d72-b523-c58728752159 admin admin] PATH_INFO: `/v3/users/d2d1f8fe7e6e48eab9f6a1ab8e756fdb` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:17.094883 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37817510-0dd9-4d72-b523-c58728752159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2d1f8fe7e6e48eab9f6a1ab8e756fdb)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:17.099787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37817510-0dd9-4d72-b523-c58728752159 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:17.224106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-4da29fc5-c60d-4113-abfe-143bc85f88df None None] MFA Rules not processed for user `27c5deeab63347048484a02f6bdbab29`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:17.233280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-4da29fc5-c60d-4113-abfe-143bc85f88df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:17.554789 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-37817510-0dd9-4d72-b523-c58728752159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2d1f8fe7e6e48eab9f6a1ab8e756fdb'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:17.573920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-37817510-0dd9-4d72-b523-c58728752159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2d1f8fe7e6e48eab9f6a1ab8e756fdb'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:17.574697 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-37817510-0dd9-4d72-b523-c58728752159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2d1f8fe7e6e48eab9f6a1ab8e756fdb'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:17.575347 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-37817510-0dd9-4d72-b523-c58728752159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2d1f8fe7e6e48eab9f6a1ab8e756fdb'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:17.621675 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-37817510-0dd9-4d72-b523-c58728752159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2d1f8fe7e6e48eab9f6a1ab8e756fdb'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:17.659026 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 869/1708] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 680 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:17.660721 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b12ca4-dbbb-4497-ac94-6fbea9fa54a1 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:17.660977 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b12ca4-dbbb-4497-ac94-6fbea9fa54a1 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:17.666429 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b12ca4-dbbb-4497-ac94-6fbea9fa54a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:17.741413 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 840/1709] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:23:16 2022] DELETE /identity/v3/users/d2d1f8fe7e6e48eab9f6a1ab8e756fdb => generated 0 bytes in 997 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:17.748083 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a037b1-b93a-4a3b-a339-f2d21ddb7bae None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:17.748394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a037b1-b93a-4a3b-a339-f2d21ddb7bae None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:17.748647 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a037b1-b93a-4a3b-a339-f2d21ddb7bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:17.762115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-a2b12ca4-dbbb-4497-ac94-6fbea9fa54a1 None None] MFA Rules not processed for user `4905cef89e384a4285fc28c9f1e924a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:17.763809 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-a2b12ca4-dbbb-4497-ac94-6fbea9fa54a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:17.830737 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-12a037b1-b93a-4a3b-a339-f2d21ddb7bae None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:17.841681 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-12a037b1-b93a-4a3b-a339-f2d21ddb7bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:18.047504 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 870/1710] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:18.050108 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc466565-d61a-4f53-b77d-4d907b99cbe3 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:18.057152 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc466565-d61a-4f53-b77d-4d907b99cbe3 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:18.057152 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc466565-d61a-4f53-b77d-4d907b99cbe3 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:18.057152 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 871/1711] 10.222.0.45 () {54 vars in 921 bytes} [Thu Jun 2 19:23:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:23:18.060733 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc466565-d61a-4f53-b77d-4d907b99cbe3 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:18.064287 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-cc466565-d61a-4f53-b77d-4d907b99cbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:18.103570 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 841/1712] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:18.132519 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a037b1-b93a-4a3b-a339-f2d21ddb7bae None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:18.135407 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-12a037b1-b93a-4a3b-a339-f2d21ddb7bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:18.146088 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc466565-d61a-4f53-b77d-4d907b99cbe3 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:18.157400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8744070-0b29-4c20-9d9e-0760c2fd51e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:18.158092 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8744070-0b29-4c20-9d9e-0760c2fd51e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:18.158380 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8744070-0b29-4c20-9d9e-0760c2fd51e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:18.158658 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8744070-0b29-4c20-9d9e-0760c2fd51e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:18.162398 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8744070-0b29-4c20-9d9e-0760c2fd51e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:18.168372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8744070-0b29-4c20-9d9e-0760c2fd51e5 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:18.294127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:18.307219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a037b1-b93a-4a3b-a339-f2d21ddb7bae None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:18.308393 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 872/1713] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:23:18 2022] POST /identity/v3/projects => generated 403 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:18.309848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8744070-0b29-4c20-9d9e-0760c2fd51e5 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:18.317020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-a8744070-0b29-4c20-9d9e-0760c2fd51e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:18.498262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8744070-0b29-4c20-9d9e-0760c2fd51e5 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:18.510492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b95771-d30e-45b4-b9ab-86b8f3f7ae81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:18.513906 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b95771-d30e-45b4-b9ab-86b8f3f7ae81 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:18.515513 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b95771-d30e-45b4-b9ab-86b8f3f7ae81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:18.515828 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b95771-d30e-45b4-b9ab-86b8f3f7ae81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:18.541814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:18.600067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc3e8b-854e-43f4-93e1-186b2f205651 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:18.606565 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc3e8b-854e-43f4-93e1-186b2f205651 service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:18.606565 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc3e8b-854e-43f4-93e1-186b2f205651 service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:18.606565 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc3e8b-854e-43f4-93e1-186b2f205651 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:18.608809 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-cecc3e8b-854e-43f4-93e1-186b2f205651 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:18.734678 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b95771-d30e-45b4-b9ab-86b8f3f7ae81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:18.745431 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b95771-d30e-45b4-b9ab-86b8f3f7ae81 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:18.776873 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 873/1714] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:18.798861 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b95771-d30e-45b4-b9ab-86b8f3f7ae81 service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:18.802080 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc3e8b-854e-43f4-93e1-186b2f205651 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:18.805027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc3e8b-854e-43f4-93e1-186b2f205651 service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:18.826933 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b95771-d30e-45b4-b9ab-86b8f3f7ae81 service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:18.858554 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed52897-2383-4a83-81ec-601db87b1508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:18.862400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed52897-2383-4a83-81ec-601db87b1508 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:18.865954 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed52897-2383-4a83-81ec-601db87b1508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:18.868832 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed52897-2383-4a83-81ec-601db87b1508 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:18.872329 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed52897-2383-4a83-81ec-601db87b1508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:18.880129 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 842/1715] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 749 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:23:18.882992 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb970c-e761-4e8e-91bc-1c5f6d960e24 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:18.884452 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed52897-2383-4a83-81ec-601db87b1508 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:18.887283 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb970c-e761-4e8e-91bc-1c5f6d960e24 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:18.887867 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb970c-e761-4e8e-91bc-1c5f6d960e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:19.002691 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 874/1716] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:23:18 2022] POST /identity/v3/users => generated 308 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:19.004414 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930d52c-1e6e-4330-8b85-f8ae6bd849a3 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:19.004707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930d52c-1e6e-4330-8b85-f8ae6bd849a3 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:19.004983 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930d52c-1e6e-4330-8b85-f8ae6bd849a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:19.020479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-b3eb970c-e761-4e8e-91bc-1c5f6d960e24 None None] MFA Rules not processed for user `8fce5ea9cc1346b89cce855aaaa77466`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:19.029715 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b3eb970c-e761-4e8e-91bc-1c5f6d960e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:19.099524 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-a930d52c-1e6e-4330-8b85-f8ae6bd849a3 None None] MFA Rules not processed for user `575f61ef70314f86b5d9dad3ba1b3aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:19.107624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-a930d52c-1e6e-4330-8b85-f8ae6bd849a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:19.198628 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 875/1717] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jun 2 19:23:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:19.203698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 843/1718] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:19.206852 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930d52c-1e6e-4330-8b85-f8ae6bd849a3 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:19.270533 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930d52c-1e6e-4330-8b85-f8ae6bd849a3 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:19.324446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe76e7-4ef1-4882-b611-50649afb3993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:19.333668 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe76e7-4ef1-4882-b611-50649afb3993 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:19.334276 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe76e7-4ef1-4882-b611-50649afb3993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:19.343808 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe76e7-4ef1-4882-b611-50649afb3993 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:19.351280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe76e7-4ef1-4882-b611-50649afb3993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:19.373989 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe76e7-4ef1-4882-b611-50649afb3993 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:19.466384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 876/1719] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:23:19.470972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb970c-e761-4e8e-91bc-1c5f6d960e24 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:19.503831 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb970c-e761-4e8e-91bc-1c5f6d960e24 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:19.519419 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f099e-5612-4bfb-b263-967b4fbebbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:19.520581 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f099e-5612-4bfb-b263-967b4fbebbe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:19.520969 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f099e-5612-4bfb-b263-967b4fbebbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:19.522412 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f099e-5612-4bfb-b263-967b4fbebbe0 admin admin] PATH_INFO: `/v3/projects/5cbb09db03224b9883581916b32c0c10/users/7ff644774fef4c309ee0c31399eeeed7/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:19.559060 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f099e-5612-4bfb-b263-967b4fbebbe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cbb09db03224b9883581916b32c0c10, user_id=7ff644774fef4c309ee0c31399eeeed7, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:19.574364 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f099e-5612-4bfb-b263-967b4fbebbe0 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:19.666185 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 844/1720] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:23:19 2022] PUT /identity/v3/projects/5cbb09db03224b9883581916b32c0c10/users/7ff644774fef4c309ee0c31399eeeed7/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:19.673757 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe76e7-4ef1-4882-b611-50649afb3993 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:19.743571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe76e7-4ef1-4882-b611-50649afb3993 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:19.967415 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a7fb5-fbea-4758-81b3-37dcf53a9e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:19.968174 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a7fb5-fbea-4758-81b3-37dcf53a9e81 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:19.968461 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a7fb5-fbea-4758-81b3-37dcf53a9e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:19.968734 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a7fb5-fbea-4758-81b3-37dcf53a9e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:19.969494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a7fb5-fbea-4758-81b3-37dcf53a9e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:19.989824 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a7fb5-fbea-4758-81b3-37dcf53a9e81 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:20.007624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 877/1721] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:23:20.012925 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f099e-5612-4bfb-b263-967b4fbebbe0 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:20.030298 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f099e-5612-4bfb-b263-967b4fbebbe0 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:20.037451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c43b2a-3872-4f14-b459-2af2cd2e2764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:20.039893 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c43b2a-3872-4f14-b459-2af2cd2e2764 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:20.040582 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c43b2a-3872-4f14-b459-2af2cd2e2764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:20.041444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c43b2a-3872-4f14-b459-2af2cd2e2764 admin admin] PATH_INFO: `/v3/projects/5cbb09db03224b9883581916b32c0c10/users/7ff644774fef4c309ee0c31399eeeed7/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:20.052399 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c43b2a-3872-4f14-b459-2af2cd2e2764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cbb09db03224b9883581916b32c0c10, user_id=7ff644774fef4c309ee0c31399eeeed7, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:20.052399 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c43b2a-3872-4f14-b459-2af2cd2e2764 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:20.100727 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 845/1722] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:23:20 2022] PUT /identity/v3/projects/5cbb09db03224b9883581916b32c0c10/users/7ff644774fef4c309ee0c31399eeeed7/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:23:20.235289 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a7fb5-fbea-4758-81b3-37dcf53a9e81 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:20.237533 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-269a7fb5-fbea-4758-81b3-37dcf53a9e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:20.521502 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:20.589044 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a7fb5-fbea-4758-81b3-37dcf53a9e81 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:20.836770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b59f10-8671-468a-af82-34d3aef48f2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:20.837521 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b59f10-8671-468a-af82-34d3aef48f2e service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:20.837967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b59f10-8671-468a-af82-34d3aef48f2e service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:20.838982 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b59f10-8671-468a-af82-34d3aef48f2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:20.880461 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b59f10-8671-468a-af82-34d3aef48f2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:20.933473 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b59f10-8671-468a-af82-34d3aef48f2e service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:21.048171 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 878/1723] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 812 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:23:21.286207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c43b2a-3872-4f14-b459-2af2cd2e2764 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:21.292813 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a8c43b2a-3872-4f14-b459-2af2cd2e2764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:21.329101 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:21.600539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c43b2a-3872-4f14-b459-2af2cd2e2764 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:21.628055 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b09d02-e152-409c-afd6-7738b1be9880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:21.632126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b09d02-e152-409c-afd6-7738b1be9880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:21.635616 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b09d02-e152-409c-afd6-7738b1be9880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:21.638913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b09d02-e152-409c-afd6-7738b1be9880 admin admin] PATH_INFO: `/v3/projects/521ebb716531441d8870538f8f193dbb` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:21.644923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b09d02-e152-409c-afd6-7738b1be9880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=521ebb716531441d8870538f8f193dbb)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:21.668506 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b09d02-e152-409c-afd6-7738b1be9880 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:21.976417 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d8b09d02-e152-409c-afd6-7738b1be9880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '521ebb716531441d8870538f8f193dbb', 'request_id': 'req-d8b09d02-e152-409c-afd6-7738b1be9880'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:22.003653 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d8b09d02-e152-409c-afd6-7738b1be9880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '521ebb716531441d8870538f8f193dbb', 'request_id': 'req-d8b09d02-e152-409c-afd6-7738b1be9880'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:22.090671 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d8b09d02-e152-409c-afd6-7738b1be9880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '521ebb716531441d8870538f8f193dbb', 'request_id': 'req-d8b09d02-e152-409c-afd6-7738b1be9880'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:22.130334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d8b09d02-e152-409c-afd6-7738b1be9880 admin admin] The token cache is being invalidate because project 521ebb716531441d8870538f8f193dbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:23:22.130528 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d8b09d02-e152-409c-afd6-7738b1be9880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:22.138003 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d8b09d02-e152-409c-afd6-7738b1be9880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:22.147842 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 846/1724] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:23:21 2022] DELETE /identity/v3/projects/521ebb716531441d8870538f8f193dbb => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:22.150325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b59f10-8671-468a-af82-34d3aef48f2e service nova] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:22.195979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b59f10-8671-468a-af82-34d3aef48f2e service nova] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:22.477597 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119747c-79e9-4b5c-94f5-a688f9aa3bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:22.478553 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119747c-79e9-4b5c-94f5-a688f9aa3bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:22.478876 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119747c-79e9-4b5c-94f5-a688f9aa3bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:22.479157 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119747c-79e9-4b5c-94f5-a688f9aa3bdf admin admin] PATH_INFO: `/v3/users/c04e38b0df3f4704a0c39d6c2767e988` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:22.481877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119747c-79e9-4b5c-94f5-a688f9aa3bdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c04e38b0df3f4704a0c39d6c2767e988)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:22.484033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119747c-79e9-4b5c-94f5-a688f9aa3bdf admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:22.916281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-1119747c-79e9-4b5c-94f5-a688f9aa3bdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c04e38b0df3f4704a0c39d6c2767e988'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:22.967379 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-1119747c-79e9-4b5c-94f5-a688f9aa3bdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c04e38b0df3f4704a0c39d6c2767e988'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:22.981083 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-1119747c-79e9-4b5c-94f5-a688f9aa3bdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c04e38b0df3f4704a0c39d6c2767e988'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:22.982858 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-1119747c-79e9-4b5c-94f5-a688f9aa3bdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c04e38b0df3f4704a0c39d6c2767e988'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:22.982858 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-1119747c-79e9-4b5c-94f5-a688f9aa3bdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c04e38b0df3f4704a0c39d6c2767e988'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:23.101893 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 879/1725] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:23:22 2022] DELETE /identity/v3/users/c04e38b0df3f4704a0c39d6c2767e988 => generated 0 bytes in 952 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:23:24.830015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be97cc9-941f-41ee-8e07-cde1edaa634b None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:24.836505 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be97cc9-941f-41ee-8e07-cde1edaa634b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:24.836505 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be97cc9-941f-41ee-8e07-cde1edaa634b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:24.913889 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-9be97cc9-941f-41ee-8e07-cde1edaa634b None None] MFA Rules not processed for user `35658a179ed84e2d949312d9bde201a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:24.917315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9be97cc9-941f-41ee-8e07-cde1edaa634b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:25.177893 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 847/1726] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:25.212590 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119747c-79e9-4b5c-94f5-a688f9aa3bdf admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:25.214776 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-1119747c-79e9-4b5c-94f5-a688f9aa3bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:25.228529 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:25.490920 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119747c-79e9-4b5c-94f5-a688f9aa3bdf admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:25.510282 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5346b-223a-4987-a260-8a9fdbd56fe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:25.511671 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5346b-223a-4987-a260-8a9fdbd56fe3 service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:25.511965 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5346b-223a-4987-a260-8a9fdbd56fe3 service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:25.512288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5346b-223a-4987-a260-8a9fdbd56fe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:25.534007 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5346b-223a-4987-a260-8a9fdbd56fe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:25.545013 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5346b-223a-4987-a260-8a9fdbd56fe3 service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:25.568522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 880/1727] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:26.199675 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7351ac-94f5-481c-bca5-5bfc7ebb4221 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:26.201625 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7351ac-94f5-481c-bca5-5bfc7ebb4221 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:26.204864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7351ac-94f5-481c-bca5-5bfc7ebb4221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:26.245219 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5346b-223a-4987-a260-8a9fdbd56fe3 service nova] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:26.247551 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-75a5346b-223a-4987-a260-8a9fdbd56fe3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:26.277774 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-7d7351ac-94f5-481c-bca5-5bfc7ebb4221 None None] MFA Rules not processed for user `f8890c84089c48d291b3ff73e9b2e423`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:26.279764 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7d7351ac-94f5-481c-bca5-5bfc7ebb4221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:26.376399 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5346b-223a-4987-a260-8a9fdbd56fe3 service nova] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:26.384513 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:26.392416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79cd55-50a0-4b12-90b7-c78f3ac277a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:26.395734 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79cd55-50a0-4b12-90b7-c78f3ac277a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:26.395734 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79cd55-50a0-4b12-90b7-c78f3ac277a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:26.395734 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79cd55-50a0-4b12-90b7-c78f3ac277a8 admin admin] PATH_INFO: `/v3/projects/434c6901f32d44b09bb0c33c796ee4d9` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:26.398643 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79cd55-50a0-4b12-90b7-c78f3ac277a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=434c6901f32d44b09bb0c33c796ee4d9)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:26.402619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79cd55-50a0-4b12-90b7-c78f3ac277a8 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:26.458822 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 848/1728] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:26.461041 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e404e47-e36a-4e50-847c-3d82f3058a11 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:26.461816 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e404e47-e36a-4e50-847c-3d82f3058a11 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:26.462626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e404e47-e36a-4e50-847c-3d82f3058a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:26.660042 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-3e404e47-e36a-4e50-847c-3d82f3058a11 None None] MFA Rules not processed for user `7ff644774fef4c309ee0c31399eeeed7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:26.662183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3e404e47-e36a-4e50-847c-3d82f3058a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:26.709933 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-ca79cd55-50a0-4b12-90b7-c78f3ac277a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '434c6901f32d44b09bb0c33c796ee4d9', 'request_id': 'req-ca79cd55-50a0-4b12-90b7-c78f3ac277a8'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:26.831209 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-ca79cd55-50a0-4b12-90b7-c78f3ac277a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '434c6901f32d44b09bb0c33c796ee4d9', 'request_id': 'req-ca79cd55-50a0-4b12-90b7-c78f3ac277a8'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:26.842876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 849/1729] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:26 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:26.857623 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-ca79cd55-50a0-4b12-90b7-c78f3ac277a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '434c6901f32d44b09bb0c33c796ee4d9', 'request_id': 'req-ca79cd55-50a0-4b12-90b7-c78f3ac277a8'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:26.921561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-ca79cd55-50a0-4b12-90b7-c78f3ac277a8 admin admin] The token cache is being invalidate because project 434c6901f32d44b09bb0c33c796ee4d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:23:26.922063 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-ca79cd55-50a0-4b12-90b7-c78f3ac277a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:26.930464 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-ca79cd55-50a0-4b12-90b7-c78f3ac277a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:26.940281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 881/1730] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:23:26 2022] DELETE /identity/v3/projects/434c6901f32d44b09bb0c33c796ee4d9 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:26.947808 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc528fb8-3555-4f4f-8992-0dfea55dd1fe None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:26.947808 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc528fb8-3555-4f4f-8992-0dfea55dd1fe None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:26.948106 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc528fb8-3555-4f4f-8992-0dfea55dd1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:27.009024 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-cc528fb8-3555-4f4f-8992-0dfea55dd1fe None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:27.010366 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-cc528fb8-3555-4f4f-8992-0dfea55dd1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:27.124842 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4011b-b0c1-408c-8822-80e578466d9f None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:27.125142 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 850/1731] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:23:27.125350 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4011b-b0c1-408c-8822-80e578466d9f None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:27.125807 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4011b-b0c1-408c-8822-80e578466d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:27.204249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-eac4011b-b0c1-408c-8822-80e578466d9f None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:27.206868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-eac4011b-b0c1-408c-8822-80e578466d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:27.228425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 882/1732] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:27.232165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc528fb8-3555-4f4f-8992-0dfea55dd1fe None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:27.248838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc528fb8-3555-4f4f-8992-0dfea55dd1fe None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:27.258998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f598ede-7460-4fe6-a4c4-92d24bac59f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:27.260618 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f598ede-7460-4fe6-a4c4-92d24bac59f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:27.261241 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f598ede-7460-4fe6-a4c4-92d24bac59f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:27.261931 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f598ede-7460-4fe6-a4c4-92d24bac59f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:27.264112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f598ede-7460-4fe6-a4c4-92d24bac59f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:23:27.264833 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f598ede-7460-4fe6-a4c4-92d24bac59f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:27.266950 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f598ede-7460-4fe6-a4c4-92d24bac59f6 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:27.293144 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 851/1733] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:23:27.294337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4011b-b0c1-408c-8822-80e578466d9f None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:27.348028 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4011b-b0c1-408c-8822-80e578466d9f None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:27.390460 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b473b8b-6e05-4043-abf5-70b392eb70c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:27.391985 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b473b8b-6e05-4043-abf5-70b392eb70c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:27.394142 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b473b8b-6e05-4043-abf5-70b392eb70c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:27.394880 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b473b8b-6e05-4043-abf5-70b392eb70c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:27.396805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b473b8b-6e05-4043-abf5-70b392eb70c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:27.403007 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b473b8b-6e05-4043-abf5-70b392eb70c9 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:27.444792 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:27.578010 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 883/1734] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:23:27 2022] POST /identity/v3/projects => generated 379 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:27.580112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f598ede-7460-4fe6-a4c4-92d24bac59f6 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:27.597918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f598ede-7460-4fe6-a4c4-92d24bac59f6 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:27.709939 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:27.745768 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4fed8-6cc9-4823-92e9-4a2c77664256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:27.746571 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4fed8-6cc9-4823-92e9-4a2c77664256 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:27.749311 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4fed8-6cc9-4823-92e9-4a2c77664256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:27.749311 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4fed8-6cc9-4823-92e9-4a2c77664256 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:27.750123 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4fed8-6cc9-4823-92e9-4a2c77664256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:27.753026 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4fed8-6cc9-4823-92e9-4a2c77664256 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:27.842790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b473b8b-6e05-4043-abf5-70b392eb70c9 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:27.845351 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 852/1735] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:23:27 2022] POST /identity/v3/users => generated 290 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:23:27.857207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b473b8b-6e05-4043-abf5-70b392eb70c9 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:27.863035 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa86a43-19fb-4863-a526-5c6b3c3f2b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:27.864436 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa86a43-19fb-4863-a526-5c6b3c3f2b17 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:27.864919 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa86a43-19fb-4863-a526-5c6b3c3f2b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:27.865369 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa86a43-19fb-4863-a526-5c6b3c3f2b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:27.866318 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa86a43-19fb-4863-a526-5c6b3c3f2b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:27.869415 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa86a43-19fb-4863-a526-5c6b3c3f2b17 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:27.890487 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4fed8-6cc9-4823-92e9-4a2c77664256 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:27.909038 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 884/1736] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:23:27.909217 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4fed8-6cc9-4823-92e9-4a2c77664256 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:27.913411 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d13039-5927-456b-bc1e-919e40cce8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:27.915059 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d13039-5927-456b-bc1e-919e40cce8eb admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:27.915753 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d13039-5927-456b-bc1e-919e40cce8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:27.916198 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d13039-5927-456b-bc1e-919e40cce8eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:27.917136 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d13039-5927-456b-bc1e-919e40cce8eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:27.920360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d13039-5927-456b-bc1e-919e40cce8eb admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:27.942081 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa86a43-19fb-4863-a526-5c6b3c3f2b17 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:27.943124 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 853/1737] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:23:27.972645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa86a43-19fb-4863-a526-5c6b3c3f2b17 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:27.972645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d64da4-64e6-442c-9d3b-7e5a21aa1537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:27.972645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d64da4-64e6-442c-9d3b-7e5a21aa1537 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:27.972645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d64da4-64e6-442c-9d3b-7e5a21aa1537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:27.973256 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d64da4-64e6-442c-9d3b-7e5a21aa1537 admin admin] PATH_INFO: `/v3/projects/adc4e4dd7cdd4524a7e2e43b8b98cb83/users/0dc9ea39b9584aae9de9595e86fbc54c/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:27.987796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d64da4-64e6-442c-9d3b-7e5a21aa1537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adc4e4dd7cdd4524a7e2e43b8b98cb83, user_id=0dc9ea39b9584aae9de9595e86fbc54c, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:27.991046 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d64da4-64e6-442c-9d3b-7e5a21aa1537 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:28.153900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8259937-c536-4e70-a627-ce36ea22bf88 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:28.154329 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8259937-c536-4e70-a627-ce36ea22bf88 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:28.154679 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8259937-c536-4e70-a627-ce36ea22bf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:28.175722 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 885/1738] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:23:27 2022] PUT /identity/v3/projects/adc4e4dd7cdd4524a7e2e43b8b98cb83/users/0dc9ea39b9584aae9de9595e86fbc54c/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:28.205564 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-c8259937-c536-4e70-a627-ce36ea22bf88 None None] MFA Rules not processed for user `0dc9ea39b9584aae9de9595e86fbc54c`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:28.208994 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c8259937-c536-4e70-a627-ce36ea22bf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:28.414445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d64da4-64e6-442c-9d3b-7e5a21aa1537 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:28.418081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 854/1739] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:28.657627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d64da4-64e6-442c-9d3b-7e5a21aa1537 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:28.690941 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02262311-7a40-4a6c-8f59-3eee59b4c1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:28.692511 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02262311-7a40-4a6c-8f59-3eee59b4c1ad admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:28.692902 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02262311-7a40-4a6c-8f59-3eee59b4c1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:28.693285 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02262311-7a40-4a6c-8f59-3eee59b4c1ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:28.694127 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02262311-7a40-4a6c-8f59-3eee59b4c1ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:28.697437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02262311-7a40-4a6c-8f59-3eee59b4c1ad admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:28.831843 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 886/1740] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:23:28 2022] POST /identity/v3/projects => generated 379 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:28.836118 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8259937-c536-4e70-a627-ce36ea22bf88 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:28.847969 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8259937-c536-4e70-a627-ce36ea22bf88 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:28.963509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3449f2-48f2-4e40-9047-18449aa229b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:28.965508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3449f2-48f2-4e40-9047-18449aa229b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:28.967811 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3449f2-48f2-4e40-9047-18449aa229b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:28.968209 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3449f2-48f2-4e40-9047-18449aa229b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:28.972236 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3449f2-48f2-4e40-9047-18449aa229b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:28.974538 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3449f2-48f2-4e40-9047-18449aa229b1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:29.190785 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 855/1741] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:23:28 2022] POST /identity/v3/users => generated 296 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:23:29.191626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02262311-7a40-4a6c-8f59-3eee59b4c1ad admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:29.213468 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02262311-7a40-4a6c-8f59-3eee59b4c1ad admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:29.225951 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bb18e-cbcc-4559-8e7d-c4ee701017d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:29.233451 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bb18e-cbcc-4559-8e7d-c4ee701017d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:29.233451 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bb18e-cbcc-4559-8e7d-c4ee701017d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:29.233451 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bb18e-cbcc-4559-8e7d-c4ee701017d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:29.233451 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bb18e-cbcc-4559-8e7d-c4ee701017d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:29.234481 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bb18e-cbcc-4559-8e7d-c4ee701017d2 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:29.278350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3449f2-48f2-4e40-9047-18449aa229b1 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:29.290108 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 887/1742] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:23:29.301129 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3449f2-48f2-4e40-9047-18449aa229b1 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:29.309647 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff743f-af99-4854-b79f-d2dad8507e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:29.311317 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff743f-af99-4854-b79f-d2dad8507e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:29.311804 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff743f-af99-4854-b79f-d2dad8507e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:29.312554 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff743f-af99-4854-b79f-d2dad8507e8a admin admin] PATH_INFO: `/v3/projects/8b20d8a3e54c47fea3189138d76ae85c/users/8e1eb1866f5b459bbf81d0e9aa95e1a0/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:29.370575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff743f-af99-4854-b79f-d2dad8507e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b20d8a3e54c47fea3189138d76ae85c, user_id=8e1eb1866f5b459bbf81d0e9aa95e1a0, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:29.375883 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff743f-af99-4854-b79f-d2dad8507e8a admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:29.488145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 856/1743] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:23:29 2022] PUT /identity/v3/projects/8b20d8a3e54c47fea3189138d76ae85c/users/8e1eb1866f5b459bbf81d0e9aa95e1a0/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:23:29.493920 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bb18e-cbcc-4559-8e7d-c4ee701017d2 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:29.510153 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bb18e-cbcc-4559-8e7d-c4ee701017d2 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:29.611273 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41fadb-8e99-4015-af18-17b80f1ba600 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:29.611630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41fadb-8e99-4015-af18-17b80f1ba600 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:29.611976 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41fadb-8e99-4015-af18-17b80f1ba600 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:29.613963 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 857/1744] 10.222.0.45 () {54 vars in 921 bytes} [Thu Jun 2 19:23:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:23:29.624319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd9daf-7a22-4187-a133-bb11cd544813 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:29.625219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd9daf-7a22-4187-a133-bb11cd544813 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:29.625219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd9daf-7a22-4187-a133-bb11cd544813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:29.664068 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-e8fd9daf-7a22-4187-a133-bb11cd544813 None None] MFA Rules not processed for user `3ebc95c1b3284c1d8321900cf442a811`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:29.672969 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e8fd9daf-7a22-4187-a133-bb11cd544813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:29.687967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a50ac6-95e6-4841-9383-81e831253e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:29.688968 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a50ac6-95e6-4841-9383-81e831253e44 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:29.689434 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a50ac6-95e6-4841-9383-81e831253e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:29.690064 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a50ac6-95e6-4841-9383-81e831253e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:29.691231 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a50ac6-95e6-4841-9383-81e831253e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:29.694022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a50ac6-95e6-4841-9383-81e831253e44 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:29.720779 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:29.755600 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 888/1745] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:23:29.758630 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d954c15-d268-4162-be67-5391b253f288 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:29.759783 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d954c15-d268-4162-be67-5391b253f288 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:29.759783 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d954c15-d268-4162-be67-5391b253f288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:29.787054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-4d954c15-d268-4162-be67-5391b253f288 None None] MFA Rules not processed for user `27c5deeab63347048484a02f6bdbab29`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:29.788864 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-4d954c15-d268-4162-be67-5391b253f288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:29.798179 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 858/1746] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jun 2 19:23:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:23:29.799622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd9daf-7a22-4187-a133-bb11cd544813 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:29.823306 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd9daf-7a22-4187-a133-bb11cd544813 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:29.833271 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:29.838475 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0e344-769d-4d6f-a5e4-346a8fd7a849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:29.840168 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0e344-769d-4d6f-a5e4-346a8fd7a849 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:29.840462 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0e344-769d-4d6f-a5e4-346a8fd7a849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:29.840749 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0e344-769d-4d6f-a5e4-346a8fd7a849 admin admin] PATH_INFO: `/v3/projects/8b20d8a3e54c47fea3189138d76ae85c/users/8e1eb1866f5b459bbf81d0e9aa95e1a0/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:29.843910 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0e344-769d-4d6f-a5e4-346a8fd7a849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b20d8a3e54c47fea3189138d76ae85c, user_id=8e1eb1866f5b459bbf81d0e9aa95e1a0, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:29.848151 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0e344-769d-4d6f-a5e4-346a8fd7a849 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:29.970341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 859/1747] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:23:29 2022] PUT /identity/v3/projects/8b20d8a3e54c47fea3189138d76ae85c/users/8e1eb1866f5b459bbf81d0e9aa95e1a0/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:29.970341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0e344-769d-4d6f-a5e4-346a8fd7a849 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:29.970341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-60c0e344-769d-4d6f-a5e4-346a8fd7a849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:29.970969 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 889/1748] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:29.975942 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26786f8-f69c-42b1-9e3b-a3ef442d317f None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:29.976300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26786f8-f69c-42b1-9e3b-a3ef442d317f None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:29.976638 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26786f8-f69c-42b1-9e3b-a3ef442d317f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:29.985899 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0e344-769d-4d6f-a5e4-346a8fd7a849 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:29.992910 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf8706-d15d-4978-b3e5-aeb686b382b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ebc95c1b3284c1d8321900cf442a811', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:29.995006 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf8706-d15d-4978-b3e5-aeb686b382b7 service placement] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:29.995841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf8706-d15d-4978-b3e5-aeb686b382b7 service placement] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:29.996199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf8706-d15d-4978-b3e5-aeb686b382b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:30.013985 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-c26786f8-f69c-42b1-9e3b-a3ef442d317f None None] MFA Rules not processed for user `8e1eb1866f5b459bbf81d0e9aa95e1a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:30.018062 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c26786f8-f69c-42b1-9e3b-a3ef442d317f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:30.071517 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf8706-d15d-4978-b3e5-aeb686b382b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:30.074612 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf8706-d15d-4978-b3e5-aeb686b382b7 service placement] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:30.099981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 860/1749] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:30.243070 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 890/1750] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:30.258468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf8706-d15d-4978-b3e5-aeb686b382b7 service placement] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:30.263507 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ffdf8706-d15d-4978-b3e5-aeb686b382b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:30.370116 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf8706-d15d-4978-b3e5-aeb686b382b7 service placement] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:30.389759 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec410191-508e-413a-b15e-c45db958089d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:30.390634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec410191-508e-413a-b15e-c45db958089d service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:30.390923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec410191-508e-413a-b15e-c45db958089d service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:30.391199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec410191-508e-413a-b15e-c45db958089d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:30.490650 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec410191-508e-413a-b15e-c45db958089d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:30.493808 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec410191-508e-413a-b15e-c45db958089d service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:30.517975 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 861/1751] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:31.395222 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:32.835393 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26786f8-f69c-42b1-9e3b-a3ef442d317f None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:32.872288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26786f8-f69c-42b1-9e3b-a3ef442d317f None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:32.889766 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e296c14-7715-47c8-a2b3-772999c963d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:32.893559 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e296c14-7715-47c8-a2b3-772999c963d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:32.896666 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e296c14-7715-47c8-a2b3-772999c963d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:32.897469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e296c14-7715-47c8-a2b3-772999c963d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:32.940952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e296c14-7715-47c8-a2b3-772999c963d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:32.944494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e296c14-7715-47c8-a2b3-772999c963d0 service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:32.973055 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 891/1752] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:33.685157 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b795c1-8e0c-4b35-a031-c70ce4e5e09f None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:33.685779 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b795c1-8e0c-4b35-a031-c70ce4e5e09f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:33.685955 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b795c1-8e0c-4b35-a031-c70ce4e5e09f None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:33.687815 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 862/1753] 10.222.0.45 () {54 vars in 921 bytes} [Thu Jun 2 19:23:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:23:33.715454 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a845bf2-59d5-4f29-a10f-1ceb3461455f None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:33.716165 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a845bf2-59d5-4f29-a10f-1ceb3461455f None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:33.716858 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a845bf2-59d5-4f29-a10f-1ceb3461455f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:33.773775 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-5a845bf2-59d5-4f29-a10f-1ceb3461455f None None] MFA Rules not processed for user `575f61ef70314f86b5d9dad3ba1b3aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:33.779208 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5a845bf2-59d5-4f29-a10f-1ceb3461455f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:33.871789 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19efd4e-3d26-499c-899d-fc1f7ccae9d7 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:33.872453 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19efd4e-3d26-499c-899d-fc1f7ccae9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:33.873265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19efd4e-3d26-499c-899d-fc1f7ccae9d7 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:33.876137 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 863/1754] 10.222.0.45 () {54 vars in 921 bytes} [Thu Jun 2 19:23:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:23:33.941997 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bfd82-23bf-4f55-aabb-dfdc4996671f None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:33.943125 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bfd82-23bf-4f55-aabb-dfdc4996671f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:33.943948 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bfd82-23bf-4f55-aabb-dfdc4996671f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:33.998452 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-502bfd82-23bf-4f55-aabb-dfdc4996671f None None] MFA Rules not processed for user `3ebc95c1b3284c1d8321900cf442a811`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:34.002279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 892/1755] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jun 2 19:23:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:34.007134 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-502bfd82-23bf-4f55-aabb-dfdc4996671f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:34.020451 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a845bf2-59d5-4f29-a10f-1ceb3461455f None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:34.026160 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5a845bf2-59d5-4f29-a10f-1ceb3461455f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:34.028587 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 864/1756] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jun 2 19:23:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:34.045552 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bfd82-23bf-4f55-aabb-dfdc4996671f None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:34.048333 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-502bfd82-23bf-4f55-aabb-dfdc4996671f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:34.054992 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a845bf2-59d5-4f29-a10f-1ceb3461455f None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:34.077278 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bfd82-23bf-4f55-aabb-dfdc4996671f None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:34.079038 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc1cad-cdef-4cd8-8a7a-ca3181c998d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:34.081497 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc1cad-cdef-4cd8-8a7a-ca3181c998d3 service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:34.081860 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc1cad-cdef-4cd8-8a7a-ca3181c998d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:34.083250 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc1cad-cdef-4cd8-8a7a-ca3181c998d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:34.090709 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb98623-da4b-4644-83d8-329c30452374 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ebc95c1b3284c1d8321900cf442a811', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:34.091574 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb98623-da4b-4644-83d8-329c30452374 service placement] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:34.093181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb98623-da4b-4644-83d8-329c30452374 service placement] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:34.094446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb98623-da4b-4644-83d8-329c30452374 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:34.104392 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc1cad-cdef-4cd8-8a7a-ca3181c998d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:34.106689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc1cad-cdef-4cd8-8a7a-ca3181c998d3 service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:34.117494 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb98623-da4b-4644-83d8-329c30452374 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:34.121239 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb98623-da4b-4644-83d8-329c30452374 service placement] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:34.122782 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 893/1757] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:23:34.140241 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 865/1758] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:23:34.222295 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc1cad-cdef-4cd8-8a7a-ca3181c998d3 service nova] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:34.231259 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-43fc1cad-cdef-4cd8-8a7a-ca3181c998d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:34.314035 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:34.402234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc1cad-cdef-4cd8-8a7a-ca3181c998d3 service nova] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:34.410507 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc901f4-99e4-46af-bddb-631fbf0cf850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:34.422840 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc901f4-99e4-46af-bddb-631fbf0cf850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:34.422840 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc901f4-99e4-46af-bddb-631fbf0cf850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:34.422840 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc901f4-99e4-46af-bddb-631fbf0cf850 admin admin] PATH_INFO: `/v3/users/4905cef89e384a4285fc28c9f1e924a5` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:34.422840 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc901f4-99e4-46af-bddb-631fbf0cf850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4905cef89e384a4285fc28c9f1e924a5)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:34.422840 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc901f4-99e4-46af-bddb-631fbf0cf850 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:34.578686 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae65566-27f3-4bc9-8596-e6c15e8b60d4 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:34.579343 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae65566-27f3-4bc9-8596-e6c15e8b60d4 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:34.579848 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae65566-27f3-4bc9-8596-e6c15e8b60d4 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:34.581524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 866/1759] 10.222.0.45 () {54 vars in 921 bytes} [Thu Jun 2 19:23:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:23:34.601620 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ebf36-bbc1-4acf-8c88-64fd78697797 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:34.602286 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ebf36-bbc1-4acf-8c88-64fd78697797 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:34.602720 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ebf36-bbc1-4acf-8c88-64fd78697797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:34.614621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-3dc901f4-99e4-46af-bddb-631fbf0cf850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4905cef89e384a4285fc28c9f1e924a5'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:34.634345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-3dc901f4-99e4-46af-bddb-631fbf0cf850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4905cef89e384a4285fc28c9f1e924a5'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:34.643516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-3dc901f4-99e4-46af-bddb-631fbf0cf850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4905cef89e384a4285fc28c9f1e924a5'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:34.647988 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-3dc901f4-99e4-46af-bddb-631fbf0cf850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4905cef89e384a4285fc28c9f1e924a5'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:34.660146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-3dc901f4-99e4-46af-bddb-631fbf0cf850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4905cef89e384a4285fc28c9f1e924a5'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:34.666910 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-4e7ebf36-bbc1-4acf-8c88-64fd78697797 None None] MFA Rules not processed for user `575f61ef70314f86b5d9dad3ba1b3aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:34.669930 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4e7ebf36-bbc1-4acf-8c88-64fd78697797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:34.696137 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 867/1760] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jun 2 19:23:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:34.728493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ebf36-bbc1-4acf-8c88-64fd78697797 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:34.730355 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4e7ebf36-bbc1-4acf-8c88-64fd78697797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:34.756147 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ebf36-bbc1-4acf-8c88-64fd78697797 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:34.773927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea645925-64e9-46dd-a683-6792d73a90c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:34.776185 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea645925-64e9-46dd-a683-6792d73a90c5 service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:34.776801 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea645925-64e9-46dd-a683-6792d73a90c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:34.780684 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea645925-64e9-46dd-a683-6792d73a90c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:34.814696 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 894/1761] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:23:34 2022] DELETE /identity/v3/users/4905cef89e384a4285fc28c9f1e924a5 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:34.827494 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea645925-64e9-46dd-a683-6792d73a90c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:34.829638 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea645925-64e9-46dd-a683-6792d73a90c5 service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:34.857059 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 868/1762] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:35.757198 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc901f4-99e4-46af-bddb-631fbf0cf850 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:35.759489 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-3dc901f4-99e4-46af-bddb-631fbf0cf850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:35.951332 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc901f4-99e4-46af-bddb-631fbf0cf850 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:35.972443 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d01372-1714-40a7-bbf9-1afb7210f67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:35.973435 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d01372-1714-40a7-bbf9-1afb7210f67e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:36.017191 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d01372-1714-40a7-bbf9-1afb7210f67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:36.017191 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d01372-1714-40a7-bbf9-1afb7210f67e admin admin] PATH_INFO: `/v3/projects/b9033eadc805452e9718596b47f12a32` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:36.017191 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d01372-1714-40a7-bbf9-1afb7210f67e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9033eadc805452e9718596b47f12a32)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:36.017191 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d01372-1714-40a7-bbf9-1afb7210f67e admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:36.184901 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:36.193176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-32d01372-1714-40a7-bbf9-1afb7210f67e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9033eadc805452e9718596b47f12a32', 'request_id': 'req-32d01372-1714-40a7-bbf9-1afb7210f67e'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:36.219010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ba26c-8a13-4a25-89b2-501a75d884fd None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:36.219737 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ba26c-8a13-4a25-89b2-501a75d884fd None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:36.219737 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ba26c-8a13-4a25-89b2-501a75d884fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:36.243709 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-dc2ba26c-8a13-4a25-89b2-501a75d884fd None None] MFA Rules not processed for user `35658a179ed84e2d949312d9bde201a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:36.245310 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-dc2ba26c-8a13-4a25-89b2-501a75d884fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:36.317689 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 869/1763] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:23:36.405515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-32d01372-1714-40a7-bbf9-1afb7210f67e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9033eadc805452e9718596b47f12a32', 'request_id': 'req-32d01372-1714-40a7-bbf9-1afb7210f67e'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:36.420408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-32d01372-1714-40a7-bbf9-1afb7210f67e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9033eadc805452e9718596b47f12a32', 'request_id': 'req-32d01372-1714-40a7-bbf9-1afb7210f67e'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:36.436199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-32d01372-1714-40a7-bbf9-1afb7210f67e admin admin] The token cache is being invalidate because project b9033eadc805452e9718596b47f12a32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:23:36.436500 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-32d01372-1714-40a7-bbf9-1afb7210f67e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:36.437355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-32d01372-1714-40a7-bbf9-1afb7210f67e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:36.445847 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 895/1764] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:23:35 2022] DELETE /identity/v3/projects/b9033eadc805452e9718596b47f12a32 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:36.446048 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ba26c-8a13-4a25-89b2-501a75d884fd None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:36.617522 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ba26c-8a13-4a25-89b2-501a75d884fd None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:36.629945 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bfbca-82a0-4b1b-b714-362d2bf036e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:36.630821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bfbca-82a0-4b1b-b714-362d2bf036e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:36.631285 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bfbca-82a0-4b1b-b714-362d2bf036e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:36.631696 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bfbca-82a0-4b1b-b714-362d2bf036e5 admin admin] PATH_INFO: `/v3/users/7ff644774fef4c309ee0c31399eeeed7` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:36.633368 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bfbca-82a0-4b1b-b714-362d2bf036e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ff644774fef4c309ee0c31399eeeed7)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:36.635638 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bfbca-82a0-4b1b-b714-362d2bf036e5 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:36.939203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-dd8bfbca-82a0-4b1b-b714-362d2bf036e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ff644774fef4c309ee0c31399eeeed7'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:36.951793 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:36.954223 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-dd8bfbca-82a0-4b1b-b714-362d2bf036e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ff644774fef4c309ee0c31399eeeed7'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:36.954961 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-dd8bfbca-82a0-4b1b-b714-362d2bf036e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ff644774fef4c309ee0c31399eeeed7'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:36.955580 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-dd8bfbca-82a0-4b1b-b714-362d2bf036e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ff644774fef4c309ee0c31399eeeed7'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:36.970077 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-dd8bfbca-82a0-4b1b-b714-362d2bf036e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ff644774fef4c309ee0c31399eeeed7'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:37.082594 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 870/1765] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:23:36 2022] DELETE /identity/v3/users/7ff644774fef4c309ee0c31399eeeed7 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:37.588153 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d01372-1714-40a7-bbf9-1afb7210f67e admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:37.589696 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-32d01372-1714-40a7-bbf9-1afb7210f67e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:37.603776 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d01372-1714-40a7-bbf9-1afb7210f67e admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:37.715376 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92830f4c-ca6e-4a5e-b76a-3b575ba3aa51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:37.716404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92830f4c-ca6e-4a5e-b76a-3b575ba3aa51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:37.716748 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92830f4c-ca6e-4a5e-b76a-3b575ba3aa51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:37.717092 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92830f4c-ca6e-4a5e-b76a-3b575ba3aa51 admin admin] PATH_INFO: `/v3/projects/5cbb09db03224b9883581916b32c0c10` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:37.723534 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92830f4c-ca6e-4a5e-b76a-3b575ba3aa51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cbb09db03224b9883581916b32c0c10)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:37.730643 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92830f4c-ca6e-4a5e-b76a-3b575ba3aa51 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:37.970861 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-92830f4c-ca6e-4a5e-b76a-3b575ba3aa51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cbb09db03224b9883581916b32c0c10', 'request_id': 'req-92830f4c-ca6e-4a5e-b76a-3b575ba3aa51'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:38.117911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-92830f4c-ca6e-4a5e-b76a-3b575ba3aa51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cbb09db03224b9883581916b32c0c10', 'request_id': 'req-92830f4c-ca6e-4a5e-b76a-3b575ba3aa51'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:38.137692 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-92830f4c-ca6e-4a5e-b76a-3b575ba3aa51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cbb09db03224b9883581916b32c0c10', 'request_id': 'req-92830f4c-ca6e-4a5e-b76a-3b575ba3aa51'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:38.193449 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-92830f4c-ca6e-4a5e-b76a-3b575ba3aa51 admin admin] The token cache is being invalidate because project 5cbb09db03224b9883581916b32c0c10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:23:38.193829 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-92830f4c-ca6e-4a5e-b76a-3b575ba3aa51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:38.195631 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-92830f4c-ca6e-4a5e-b76a-3b575ba3aa51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:38.198160 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 896/1766] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:23:37 2022] DELETE /identity/v3/projects/5cbb09db03224b9883581916b32c0c10 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:38.206538 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ccdda-59fc-4071-92f3-8df42f206c2f None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:38.207475 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ccdda-59fc-4071-92f3-8df42f206c2f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:38.207868 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ccdda-59fc-4071-92f3-8df42f206c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:38.245014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-6c3ccdda-59fc-4071-92f3-8df42f206c2f None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:38.252052 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6c3ccdda-59fc-4071-92f3-8df42f206c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:38.457024 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 871/1767] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:38.466108 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb45cf8-3b33-4227-bd79-97a4698cb2a8 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:38.466890 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb45cf8-3b33-4227-bd79-97a4698cb2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:38.467608 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb45cf8-3b33-4227-bd79-97a4698cb2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:38.550046 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-1eb45cf8-3b33-4227-bd79-97a4698cb2a8 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:38.555400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-1eb45cf8-3b33-4227-bd79-97a4698cb2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:38.588023 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 897/1768] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:38.592286 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ccdda-59fc-4071-92f3-8df42f206c2f None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:38.606775 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ccdda-59fc-4071-92f3-8df42f206c2f None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:38.620456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9880f-655e-47c0-a6e3-47a1a40980fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:38.621296 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9880f-655e-47c0-a6e3-47a1a40980fd admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:38.625106 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9880f-655e-47c0-a6e3-47a1a40980fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:38.625947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9880f-655e-47c0-a6e3-47a1a40980fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:38.628755 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9880f-655e-47c0-a6e3-47a1a40980fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:23:38.628755 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9880f-655e-47c0-a6e3-47a1a40980fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:38.631374 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9880f-655e-47c0-a6e3-47a1a40980fd admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:38.646445 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 872/1769] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:23:38.651377 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb45cf8-3b33-4227-bd79-97a4698cb2a8 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:38.662816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb45cf8-3b33-4227-bd79-97a4698cb2a8 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:38.668347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e73c2-b0bc-4a3e-971f-ab3c546e3493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:38.669358 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e73c2-b0bc-4a3e-971f-ab3c546e3493 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:38.669802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e73c2-b0bc-4a3e-971f-ab3c546e3493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:38.670079 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e73c2-b0bc-4a3e-971f-ab3c546e3493 admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:38.670779 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e73c2-b0bc-4a3e-971f-ab3c546e3493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:38.673093 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e73c2-b0bc-4a3e-971f-ab3c546e3493 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:38.809068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 898/1770] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:23:38 2022] POST /identity/v3/projects => generated 365 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:38.812900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9880f-655e-47c0-a6e3-47a1a40980fd admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:38.828034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9880f-655e-47c0-a6e3-47a1a40980fd admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:39.053081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbcbee-cea9-4e03-83c7-83c4186ee5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:39.055782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbcbee-cea9-4e03-83c7-83c4186ee5ea admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:39.056468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbcbee-cea9-4e03-83c7-83c4186ee5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:39.057625 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbcbee-cea9-4e03-83c7-83c4186ee5ea admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:39.058270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbcbee-cea9-4e03-83c7-83c4186ee5ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:39.063943 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbcbee-cea9-4e03-83c7-83c4186ee5ea admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:39.236773 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e73c2-b0bc-4a3e-971f-ab3c546e3493 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:39.246039 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 873/1771] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:23:38 2022] POST /identity/v3/users => generated 283 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:39.263772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e73c2-b0bc-4a3e-971f-ab3c546e3493 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:39.273788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b49e85-5485-43f6-9f00-61c3882e0696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:39.274499 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b49e85-5485-43f6-9f00-61c3882e0696 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:39.274780 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b49e85-5485-43f6-9f00-61c3882e0696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:39.275050 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b49e85-5485-43f6-9f00-61c3882e0696 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:39.275790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b49e85-5485-43f6-9f00-61c3882e0696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:39.279451 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b49e85-5485-43f6-9f00-61c3882e0696 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:39.298213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 899/1772] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:23:39.302656 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbcbee-cea9-4e03-83c7-83c4186ee5ea admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:39.319242 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbcbee-cea9-4e03-83c7-83c4186ee5ea admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:39.333699 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a63cf5-06ed-47d7-a4ec-00826f1cda2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:39.334529 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a63cf5-06ed-47d7-a4ec-00826f1cda2d admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:39.334840 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a63cf5-06ed-47d7-a4ec-00826f1cda2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:39.335333 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a63cf5-06ed-47d7-a4ec-00826f1cda2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:39.341143 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a63cf5-06ed-47d7-a4ec-00826f1cda2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:39.341143 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a63cf5-06ed-47d7-a4ec-00826f1cda2d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:39.366249 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 874/1773] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:23:39.371159 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b49e85-5485-43f6-9f00-61c3882e0696 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:39.382020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b49e85-5485-43f6-9f00-61c3882e0696 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:39.387534 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92198fd7-977a-438e-b955-f873dec02f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:39.388723 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92198fd7-977a-438e-b955-f873dec02f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:39.389165 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92198fd7-977a-438e-b955-f873dec02f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:39.389740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92198fd7-977a-438e-b955-f873dec02f76 admin admin] PATH_INFO: `/v3/projects/bf7204e6c6404ffcbd23021991b8eb7f/users/0368e6c3d4c843e3a4c4a2ea4d028df5/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:39.419769 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92198fd7-977a-438e-b955-f873dec02f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf7204e6c6404ffcbd23021991b8eb7f, user_id=0368e6c3d4c843e3a4c4a2ea4d028df5, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:39.423783 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92198fd7-977a-438e-b955-f873dec02f76 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:39.545539 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:39.568592 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3539d4-2ea0-43d6-822a-92d5d37f2e48 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:39.568886 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3539d4-2ea0-43d6-822a-92d5d37f2e48 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:39.569164 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3539d4-2ea0-43d6-822a-92d5d37f2e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:39.572321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 900/1774] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:23:39 2022] PUT /identity/v3/projects/bf7204e6c6404ffcbd23021991b8eb7f/users/0368e6c3d4c843e3a4c4a2ea4d028df5/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:39.650814 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-cc3539d4-2ea0-43d6-822a-92d5d37f2e48 None None] MFA Rules not processed for user `0368e6c3d4c843e3a4c4a2ea4d028df5`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:39.653156 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-cc3539d4-2ea0-43d6-822a-92d5d37f2e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:39.684538 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92198fd7-977a-438e-b955-f873dec02f76 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:39.686849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-92198fd7-977a-438e-b955-f873dec02f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:39.731156 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:39.860417 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92198fd7-977a-438e-b955-f873dec02f76 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:39.868602 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 875/1775] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:39.876196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3539d4-2ea0-43d6-822a-92d5d37f2e48 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:39.885969 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aed764-443d-4ddd-a363-173441855cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:39.888409 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aed764-443d-4ddd-a363-173441855cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:39.892848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aed764-443d-4ddd-a363-173441855cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:39.892848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aed764-443d-4ddd-a363-173441855cc6 admin admin] PATH_INFO: `/v3/users/0dc9ea39b9584aae9de9595e86fbc54c` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:39.899393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3539d4-2ea0-43d6-822a-92d5d37f2e48 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:39.902546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aed764-443d-4ddd-a363-173441855cc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc9ea39b9584aae9de9595e86fbc54c)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:39.904763 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aed764-443d-4ddd-a363-173441855cc6 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:39.908324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25c5cf-0416-429e-9a7c-8f37becc1fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:39.909024 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25c5cf-0416-429e-9a7c-8f37becc1fde admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:39.909831 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25c5cf-0416-429e-9a7c-8f37becc1fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:39.910126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25c5cf-0416-429e-9a7c-8f37becc1fde admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:39.910909 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25c5cf-0416-429e-9a7c-8f37becc1fde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:39.914632 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25c5cf-0416-429e-9a7c-8f37becc1fde admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:40.148064 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 876/1776] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:23:39 2022] POST /identity/v3/projects => generated 363 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:40.154821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25c5cf-0416-429e-9a7c-8f37becc1fde admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:40.253250 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-f5aed764-443d-4ddd-a363-173441855cc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc9ea39b9584aae9de9595e86fbc54c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:40.295726 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-f5aed764-443d-4ddd-a363-173441855cc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc9ea39b9584aae9de9595e86fbc54c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:40.314735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-f5aed764-443d-4ddd-a363-173441855cc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc9ea39b9584aae9de9595e86fbc54c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:40.317011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-f5aed764-443d-4ddd-a363-173441855cc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc9ea39b9584aae9de9595e86fbc54c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:40.317897 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-f5aed764-443d-4ddd-a363-173441855cc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc9ea39b9584aae9de9595e86fbc54c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:40.377000 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25c5cf-0416-429e-9a7c-8f37becc1fde admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:40.397627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28f64f-d7be-4472-9925-20ea12bb29db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:40.399558 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28f64f-d7be-4472-9925-20ea12bb29db admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:40.399952 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28f64f-d7be-4472-9925-20ea12bb29db admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:40.400364 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28f64f-d7be-4472-9925-20ea12bb29db admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:40.401890 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28f64f-d7be-4472-9925-20ea12bb29db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:40.404590 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28f64f-d7be-4472-9925-20ea12bb29db admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:40.419840 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 901/1777] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:23:39 2022] DELETE /identity/v3/users/0dc9ea39b9584aae9de9595e86fbc54c => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:23:40.424522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccd485-6eab-48cb-87c6-b78a0a547c29 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:40.424893 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccd485-6eab-48cb-87c6-b78a0a547c29 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:40.425172 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccd485-6eab-48cb-87c6-b78a0a547c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:40.462274 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-7fccd485-6eab-48cb-87c6-b78a0a547c29 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:40.463716 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-7fccd485-6eab-48cb-87c6-b78a0a547c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:40.558435 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 877/1778] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:23:40 2022] POST /identity/v3/users => generated 288 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:40.562380 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28f64f-d7be-4472-9925-20ea12bb29db admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:40.571599 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 902/1779] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:23:40.575198 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-cf28f64f-d7be-4472-9925-20ea12bb29db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:40.586710 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccd485-6eab-48cb-87c6-b78a0a547c29 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:40.592577 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-7fccd485-6eab-48cb-87c6-b78a0a547c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:40.604479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28f64f-d7be-4472-9925-20ea12bb29db admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:40.610188 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f93d31-5979-4361-9f10-d13357fa4cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:40.610943 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f93d31-5979-4361-9f10-d13357fa4cea admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:40.611240 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f93d31-5979-4361-9f10-d13357fa4cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:40.611519 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f93d31-5979-4361-9f10-d13357fa4cea admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:40.612517 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f93d31-5979-4361-9f10-d13357fa4cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:40.614368 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f93d31-5979-4361-9f10-d13357fa4cea admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:40.627952 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 878/1780] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:23:40.633789 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f93d31-5979-4361-9f10-d13357fa4cea admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:40.648638 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f93d31-5979-4361-9f10-d13357fa4cea admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:40.654789 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a9cc2-9f9f-4221-82eb-3ba6446b785b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:40.657020 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a9cc2-9f9f-4221-82eb-3ba6446b785b admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:40.657395 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a9cc2-9f9f-4221-82eb-3ba6446b785b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:40.657743 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a9cc2-9f9f-4221-82eb-3ba6446b785b admin admin] PATH_INFO: `/v3/projects/0d29fdec801541db961ff7f27c2b4567/users/6cdfc0dae9d24aa38c9705846a0b4d52/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:40.683317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccd485-6eab-48cb-87c6-b78a0a547c29 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:40.687806 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a9cc2-9f9f-4221-82eb-3ba6446b785b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d29fdec801541db961ff7f27c2b4567, user_id=6cdfc0dae9d24aa38c9705846a0b4d52, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:40.690539 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907999a1-2573-4105-9e55-fc30e3801454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:40.690539 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907999a1-2573-4105-9e55-fc30e3801454 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:40.690539 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907999a1-2573-4105-9e55-fc30e3801454 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:40.690539 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907999a1-2573-4105-9e55-fc30e3801454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:40.691212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a9cc2-9f9f-4221-82eb-3ba6446b785b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:40.704640 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907999a1-2573-4105-9e55-fc30e3801454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:40.706680 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907999a1-2573-4105-9e55-fc30e3801454 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:40.719944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 903/1781] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:40.800564 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:40.804179 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 879/1782] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:23:40 2022] PUT /identity/v3/projects/0d29fdec801541db961ff7f27c2b4567/users/6cdfc0dae9d24aa38c9705846a0b4d52/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:23:40.810958 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907999a1-2573-4105-9e55-fc30e3801454 service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:40.818405 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907999a1-2573-4105-9e55-fc30e3801454 service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:40.896027 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b52c3-7ad9-4f4f-b1a5-7dc72e0ae53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:40.896915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b52c3-7ad9-4f4f-b1a5-7dc72e0ae53e admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:40.897317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b52c3-7ad9-4f4f-b1a5-7dc72e0ae53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:40.910753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b52c3-7ad9-4f4f-b1a5-7dc72e0ae53e admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:40.913416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b52c3-7ad9-4f4f-b1a5-7dc72e0ae53e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:40.918872 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b52c3-7ad9-4f4f-b1a5-7dc72e0ae53e admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:40.947755 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 904/1783] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:23:40.948660 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a9cc2-9f9f-4221-82eb-3ba6446b785b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:40.968207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a9cc2-9f9f-4221-82eb-3ba6446b785b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:40.985686 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe38af-701f-47c3-a11f-d17ba9265ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:40.986677 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe38af-701f-47c3-a11f-d17ba9265ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:40.986966 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe38af-701f-47c3-a11f-d17ba9265ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:40.987243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe38af-701f-47c3-a11f-d17ba9265ab6 admin admin] PATH_INFO: `/v3/projects/0d29fdec801541db961ff7f27c2b4567/users/6cdfc0dae9d24aa38c9705846a0b4d52/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:40.996759 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe38af-701f-47c3-a11f-d17ba9265ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d29fdec801541db961ff7f27c2b4567, user_id=6cdfc0dae9d24aa38c9705846a0b4d52, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:41.007149 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe38af-701f-47c3-a11f-d17ba9265ab6 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:41.055154 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 880/1784] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:23:40 2022] PUT /identity/v3/projects/0d29fdec801541db961ff7f27c2b4567/users/6cdfc0dae9d24aa38c9705846a0b4d52/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:41.069052 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f5b74-0307-4258-b85f-03b8ed3fed87 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:41.069994 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f5b74-0307-4258-b85f-03b8ed3fed87 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:41.070468 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f5b74-0307-4258-b85f-03b8ed3fed87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:41.130312 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-754f5b74-0307-4258-b85f-03b8ed3fed87 None None] MFA Rules not processed for user `6cdfc0dae9d24aa38c9705846a0b4d52`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:41.133648 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-754f5b74-0307-4258-b85f-03b8ed3fed87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:41.286906 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 905/1785] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:41 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:41.301398 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe38af-701f-47c3-a11f-d17ba9265ab6 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:41.305074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-51fe38af-701f-47c3-a11f-d17ba9265ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:41.416172 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:41.423142 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe38af-701f-47c3-a11f-d17ba9265ab6 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:41.433014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860be2ab-568c-470a-98e5-59f20382ce61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:41.433731 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860be2ab-568c-470a-98e5-59f20382ce61 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:41.434109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860be2ab-568c-470a-98e5-59f20382ce61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:41.434478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860be2ab-568c-470a-98e5-59f20382ce61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:41.445683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860be2ab-568c-470a-98e5-59f20382ce61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:41.447258 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860be2ab-568c-470a-98e5-59f20382ce61 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:41.462074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 881/1786] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:41 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:41.736707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f5b74-0307-4258-b85f-03b8ed3fed87 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:41.750897 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f5b74-0307-4258-b85f-03b8ed3fed87 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:41.755034 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f0ee1-dfd4-45c2-9511-9e3c857b066c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:41.755959 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f0ee1-dfd4-45c2-9511-9e3c857b066c service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:41.760127 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f0ee1-dfd4-45c2-9511-9e3c857b066c service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:41.760711 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f0ee1-dfd4-45c2-9511-9e3c857b066c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:41.762952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-282f0ee1-dfd4-45c2-9511-9e3c857b066c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:41.864698 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f0ee1-dfd4-45c2-9511-9e3c857b066c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:41.866470 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f0ee1-dfd4-45c2-9511-9e3c857b066c service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:41.877734 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 906/1787] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:41 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:23:42.091711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860be2ab-568c-470a-98e5-59f20382ce61 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:42.095252 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-860be2ab-568c-470a-98e5-59f20382ce61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:42.247280 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860be2ab-568c-470a-98e5-59f20382ce61 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:42.253548 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e30ef-35cd-4704-8912-7b2eb49a6d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:42.254783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e30ef-35cd-4704-8912-7b2eb49a6d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:42.255069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e30ef-35cd-4704-8912-7b2eb49a6d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:42.255555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e30ef-35cd-4704-8912-7b2eb49a6d9a admin admin] PATH_INFO: `/v3/projects/adc4e4dd7cdd4524a7e2e43b8b98cb83` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:42.271290 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e30ef-35cd-4704-8912-7b2eb49a6d9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=adc4e4dd7cdd4524a7e2e43b8b98cb83)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:42.274280 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e30ef-35cd-4704-8912-7b2eb49a6d9a admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:42.492997 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b09e30ef-35cd-4704-8912-7b2eb49a6d9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adc4e4dd7cdd4524a7e2e43b8b98cb83', 'request_id': 'req-b09e30ef-35cd-4704-8912-7b2eb49a6d9a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:42.515708 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b09e30ef-35cd-4704-8912-7b2eb49a6d9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adc4e4dd7cdd4524a7e2e43b8b98cb83', 'request_id': 'req-b09e30ef-35cd-4704-8912-7b2eb49a6d9a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:42.617237 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b09e30ef-35cd-4704-8912-7b2eb49a6d9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adc4e4dd7cdd4524a7e2e43b8b98cb83', 'request_id': 'req-b09e30ef-35cd-4704-8912-7b2eb49a6d9a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:42.635232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b09e30ef-35cd-4704-8912-7b2eb49a6d9a admin admin] The token cache is being invalidate because project adc4e4dd7cdd4524a7e2e43b8b98cb83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:23:42.635523 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b09e30ef-35cd-4704-8912-7b2eb49a6d9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:42.636444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b09e30ef-35cd-4704-8912-7b2eb49a6d9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:42.638640 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 882/1788] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:23:42 2022] DELETE /identity/v3/projects/adc4e4dd7cdd4524a7e2e43b8b98cb83 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:42.645176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f0ee1-dfd4-45c2-9511-9e3c857b066c service cinder] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:42.662196 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f0ee1-dfd4-45c2-9511-9e3c857b066c service cinder] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:42.739083 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1bc2b6-e3f8-47c5-921b-a9e519d6d8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:42.740770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bc2b6-e3f8-47c5-921b-a9e519d6d8fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:42.741129 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bc2b6-e3f8-47c5-921b-a9e519d6d8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:42.744161 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bc2b6-e3f8-47c5-921b-a9e519d6d8fd admin admin] PATH_INFO: `/v3/users/8e1eb1866f5b459bbf81d0e9aa95e1a0` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:42.746851 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1bc2b6-e3f8-47c5-921b-a9e519d6d8fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e1eb1866f5b459bbf81d0e9aa95e1a0)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:42.750878 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1bc2b6-e3f8-47c5-921b-a9e519d6d8fd admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:43.064445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-ec1bc2b6-e3f8-47c5-921b-a9e519d6d8fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e1eb1866f5b459bbf81d0e9aa95e1a0'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:43.111128 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-ec1bc2b6-e3f8-47c5-921b-a9e519d6d8fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e1eb1866f5b459bbf81d0e9aa95e1a0'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:43.135926 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-ec1bc2b6-e3f8-47c5-921b-a9e519d6d8fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e1eb1866f5b459bbf81d0e9aa95e1a0'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:43.137414 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-ec1bc2b6-e3f8-47c5-921b-a9e519d6d8fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e1eb1866f5b459bbf81d0e9aa95e1a0'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:43.139129 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-ec1bc2b6-e3f8-47c5-921b-a9e519d6d8fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e1eb1866f5b459bbf81d0e9aa95e1a0'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:43.207600 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:43.223965 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 907/1789] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:23:42 2022] DELETE /identity/v3/users/8e1eb1866f5b459bbf81d0e9aa95e1a0 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:44.204571 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e30ef-35cd-4704-8912-7b2eb49a6d9a admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:44.206302 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b09e30ef-35cd-4704-8912-7b2eb49a6d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:44.231228 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e30ef-35cd-4704-8912-7b2eb49a6d9a admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:44.306443 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74fe3aa-9104-4c3e-a588-2a439892f2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:44.307376 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fe3aa-9104-4c3e-a588-2a439892f2bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:44.307762 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fe3aa-9104-4c3e-a588-2a439892f2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:44.308559 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fe3aa-9104-4c3e-a588-2a439892f2bc admin admin] PATH_INFO: `/v3/projects/8b20d8a3e54c47fea3189138d76ae85c` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:44.309984 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74fe3aa-9104-4c3e-a588-2a439892f2bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b20d8a3e54c47fea3189138d76ae85c)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:44.311887 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74fe3aa-9104-4c3e-a588-2a439892f2bc admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:44.337804 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:44.537641 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b74fe3aa-9104-4c3e-a588-2a439892f2bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b20d8a3e54c47fea3189138d76ae85c', 'request_id': 'req-b74fe3aa-9104-4c3e-a588-2a439892f2bc'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:44.561240 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b74fe3aa-9104-4c3e-a588-2a439892f2bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b20d8a3e54c47fea3189138d76ae85c', 'request_id': 'req-b74fe3aa-9104-4c3e-a588-2a439892f2bc'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:44.667350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b74fe3aa-9104-4c3e-a588-2a439892f2bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b20d8a3e54c47fea3189138d76ae85c', 'request_id': 'req-b74fe3aa-9104-4c3e-a588-2a439892f2bc'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:44.690725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b74fe3aa-9104-4c3e-a588-2a439892f2bc admin admin] The token cache is being invalidate because project 8b20d8a3e54c47fea3189138d76ae85c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:23:44.691028 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b74fe3aa-9104-4c3e-a588-2a439892f2bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:44.691698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b74fe3aa-9104-4c3e-a588-2a439892f2bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:44.693336 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 883/1790] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:23:44 2022] DELETE /identity/v3/projects/8b20d8a3e54c47fea3189138d76ae85c => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:44.699862 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb7163-b64b-4605-b520-75f664d9798f None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:44.700440 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb7163-b64b-4605-b520-75f664d9798f None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:44.700440 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb7163-b64b-4605-b520-75f664d9798f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:44.733761 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-1bdb7163-b64b-4605-b520-75f664d9798f None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:44.735264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-1bdb7163-b64b-4605-b520-75f664d9798f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:44.828611 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:44.860246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272e6c9-20b9-4d2e-b231-de7aed2dc2e6 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:44.860246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272e6c9-20b9-4d2e-b231-de7aed2dc2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:44.860246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272e6c9-20b9-4d2e-b231-de7aed2dc2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:44.861160 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 908/1791] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:44.877588 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-6272e6c9-20b9-4d2e-b231-de7aed2dc2e6 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:44.878922 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6272e6c9-20b9-4d2e-b231-de7aed2dc2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:44.889660 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 884/1792] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:23:44.894676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb7163-b64b-4605-b520-75f664d9798f None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:44.905630 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb7163-b64b-4605-b520-75f664d9798f None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:44.911224 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead1b97-324b-4455-a698-e1e2d662e28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:44.911910 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead1b97-324b-4455-a698-e1e2d662e28d admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:44.912230 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead1b97-324b-4455-a698-e1e2d662e28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:44.912488 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead1b97-324b-4455-a698-e1e2d662e28d admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:44.913244 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead1b97-324b-4455-a698-e1e2d662e28d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:23:44.913849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead1b97-324b-4455-a698-e1e2d662e28d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:44.915733 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead1b97-324b-4455-a698-e1e2d662e28d admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:44.929892 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 909/1793] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:23:44.934501 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272e6c9-20b9-4d2e-b231-de7aed2dc2e6 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:44.950489 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272e6c9-20b9-4d2e-b231-de7aed2dc2e6 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:44.956045 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f2e29-352a-496f-a59c-f3bf370a1872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:44.956777 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f2e29-352a-496f-a59c-f3bf370a1872 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:44.957040 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f2e29-352a-496f-a59c-f3bf370a1872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:44.957316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f2e29-352a-496f-a59c-f3bf370a1872 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:44.958047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f2e29-352a-496f-a59c-f3bf370a1872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:44.960253 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f2e29-352a-496f-a59c-f3bf370a1872 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:45.125659 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 885/1794] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:23:44 2022] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:45.127725 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead1b97-324b-4455-a698-e1e2d662e28d admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:45.141523 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead1b97-324b-4455-a698-e1e2d662e28d admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:45.227570 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22441a22-a494-4cf0-9f2c-960ab313f513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:45.228749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22441a22-a494-4cf0-9f2c-960ab313f513 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:45.229241 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22441a22-a494-4cf0-9f2c-960ab313f513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:45.229839 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22441a22-a494-4cf0-9f2c-960ab313f513 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:45.239370 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22441a22-a494-4cf0-9f2c-960ab313f513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:45.239370 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22441a22-a494-4cf0-9f2c-960ab313f513 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:45.321699 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 910/1795] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:23:45 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:45.326470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f2e29-352a-496f-a59c-f3bf370a1872 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:45.339936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f2e29-352a-496f-a59c-f3bf370a1872 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:45.351722 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b85e54-bb6b-4648-8a4d-09edba0a35f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:45.352672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b85e54-bb6b-4648-8a4d-09edba0a35f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:45.358914 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b85e54-bb6b-4648-8a4d-09edba0a35f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:45.358914 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b85e54-bb6b-4648-8a4d-09edba0a35f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:45.358914 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b85e54-bb6b-4648-8a4d-09edba0a35f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:45.358914 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b85e54-bb6b-4648-8a4d-09edba0a35f4 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:45.374792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 886/1796] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:23:45.375662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22441a22-a494-4cf0-9f2c-960ab313f513 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:45.388347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22441a22-a494-4cf0-9f2c-960ab313f513 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:45.394127 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0be160-28dc-4595-9972-939bb76c8b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:45.394847 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0be160-28dc-4595-9972-939bb76c8b4a admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:45.395130 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0be160-28dc-4595-9972-939bb76c8b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:45.395406 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0be160-28dc-4595-9972-939bb76c8b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:45.396282 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0be160-28dc-4595-9972-939bb76c8b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:45.399247 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0be160-28dc-4595-9972-939bb76c8b4a admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:45.424037 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 911/1797] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:23:45.428297 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b85e54-bb6b-4648-8a4d-09edba0a35f4 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:45.439652 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b85e54-bb6b-4648-8a4d-09edba0a35f4 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:45.445617 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9a7c8-d45c-4771-bb4f-931fe5987a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:45.446789 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9a7c8-d45c-4771-bb4f-931fe5987a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:45.447069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9a7c8-d45c-4771-bb4f-931fe5987a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:45.447345 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9a7c8-d45c-4771-bb4f-931fe5987a99 admin admin] PATH_INFO: `/v3/projects/7f177af06fc24bdc818b2623faf89893/users/cea811e113184f2f8313461d53116270/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:45.464654 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9a7c8-d45c-4771-bb4f-931fe5987a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f177af06fc24bdc818b2623faf89893, user_id=cea811e113184f2f8313461d53116270, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:45.467408 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9a7c8-d45c-4771-bb4f-931fe5987a99 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:45.556166 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 887/1798] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:23:45 2022] PUT /identity/v3/projects/7f177af06fc24bdc818b2623faf89893/users/cea811e113184f2f8313461d53116270/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:23:45.566033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4934712-14cb-463f-88ba-82c0de6ee0f4 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:45.566190 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4934712-14cb-463f-88ba-82c0de6ee0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:45.566477 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4934712-14cb-463f-88ba-82c0de6ee0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:45.609745 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-c4934712-14cb-463f-88ba-82c0de6ee0f4 None None] MFA Rules not processed for user `cea811e113184f2f8313461d53116270`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:45.611369 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c4934712-14cb-463f-88ba-82c0de6ee0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:45.810703 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 912/1799] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:45.811392 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9a7c8-d45c-4771-bb4f-931fe5987a99 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:46.009946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9a7c8-d45c-4771-bb4f-931fe5987a99 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:46.017864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baefccf-9aed-47f3-8d14-06689e987b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:46.019898 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baefccf-9aed-47f3-8d14-06689e987b0f admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:46.020836 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baefccf-9aed-47f3-8d14-06689e987b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:46.021334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baefccf-9aed-47f3-8d14-06689e987b0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:46.024199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baefccf-9aed-47f3-8d14-06689e987b0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:46.026402 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baefccf-9aed-47f3-8d14-06689e987b0f admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:46.174770 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 888/1800] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:23:45 2022] POST /identity/v3/projects => generated 379 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:46.175716 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4934712-14cb-463f-88ba-82c0de6ee0f4 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:46.204029 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4934712-14cb-463f-88ba-82c0de6ee0f4 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:46.319421 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6a9b5-f3e6-44d6-a1e2-441221e4b428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:46.320785 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6a9b5-f3e6-44d6-a1e2-441221e4b428 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:46.321076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6a9b5-f3e6-44d6-a1e2-441221e4b428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:46.321357 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6a9b5-f3e6-44d6-a1e2-441221e4b428 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:46.322078 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6a9b5-f3e6-44d6-a1e2-441221e4b428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:46.324634 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6a9b5-f3e6-44d6-a1e2-441221e4b428 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:46.362861 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baefccf-9aed-47f3-8d14-06689e987b0f admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:46.364683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5baefccf-9aed-47f3-8d14-06689e987b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:46.377900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baefccf-9aed-47f3-8d14-06689e987b0f admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:46.383624 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b12876-1f7c-4a45-ab7e-6ccc541424f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:46.385422 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b12876-1f7c-4a45-ab7e-6ccc541424f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:46.385732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b12876-1f7c-4a45-ab7e-6ccc541424f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:46.386095 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b12876-1f7c-4a45-ab7e-6ccc541424f2 admin admin] PATH_INFO: `/v3/users/0368e6c3d4c843e3a4c4a2ea4d028df5` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:46.387569 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b12876-1f7c-4a45-ab7e-6ccc541424f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0368e6c3d4c843e3a4c4a2ea4d028df5)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:46.389829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b12876-1f7c-4a45-ab7e-6ccc541424f2 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:46.453221 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 913/1801] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:23:46 2022] POST /identity/v3/users => generated 296 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:23:46.458659 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6a9b5-f3e6-44d6-a1e2-441221e4b428 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:46.471950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6a9b5-f3e6-44d6-a1e2-441221e4b428 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:46.477707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7327a-5e6e-47ac-a831-90ebbd09ba18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:46.478733 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7327a-5e6e-47ac-a831-90ebbd09ba18 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:46.479631 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7327a-5e6e-47ac-a831-90ebbd09ba18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:46.480800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7327a-5e6e-47ac-a831-90ebbd09ba18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:46.482038 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7327a-5e6e-47ac-a831-90ebbd09ba18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:46.484191 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7327a-5e6e-47ac-a831-90ebbd09ba18 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:46.504968 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 914/1802] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:23:46.509999 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7327a-5e6e-47ac-a831-90ebbd09ba18 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:46.521994 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7327a-5e6e-47ac-a831-90ebbd09ba18 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:46.528203 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec29c02-a793-4267-be47-41d6c93f1d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:46.529135 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec29c02-a793-4267-be47-41d6c93f1d65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:46.529420 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec29c02-a793-4267-be47-41d6c93f1d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:46.529694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec29c02-a793-4267-be47-41d6c93f1d65 admin admin] PATH_INFO: `/v3/projects/2d6d6a6cd2e24629bb92d60f37bed83f/users/f24437cbce7849f4a92cfa05ba8ee511/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:46.549545 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec29c02-a793-4267-be47-41d6c93f1d65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d6d6a6cd2e24629bb92d60f37bed83f, user_id=f24437cbce7849f4a92cfa05ba8ee511, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:46.553986 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec29c02-a793-4267-be47-41d6c93f1d65 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:46.599895 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-19b12876-1f7c-4a45-ab7e-6ccc541424f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0368e6c3d4c843e3a4c4a2ea4d028df5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:46.607670 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-19b12876-1f7c-4a45-ab7e-6ccc541424f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0368e6c3d4c843e3a4c4a2ea4d028df5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:46.608674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-19b12876-1f7c-4a45-ab7e-6ccc541424f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0368e6c3d4c843e3a4c4a2ea4d028df5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:46.609505 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-19b12876-1f7c-4a45-ab7e-6ccc541424f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0368e6c3d4c843e3a4c4a2ea4d028df5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:46.625035 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-19b12876-1f7c-4a45-ab7e-6ccc541424f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0368e6c3d4c843e3a4c4a2ea4d028df5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:46.680351 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 915/1803] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:23:46 2022] PUT /identity/v3/projects/2d6d6a6cd2e24629bb92d60f37bed83f/users/f24437cbce7849f4a92cfa05ba8ee511/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:46.688589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec29c02-a793-4267-be47-41d6c93f1d65 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:46.690234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-dec29c02-a793-4267-be47-41d6c93f1d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:46.710742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 889/1804] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:23:46 2022] DELETE /identity/v3/users/0368e6c3d4c843e3a4c4a2ea4d028df5 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:23:46.737555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e836ac-3524-45bf-ac02-e8685a5c19eb None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:46.738208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e836ac-3524-45bf-ac02-e8685a5c19eb None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:46.738801 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e836ac-3524-45bf-ac02-e8685a5c19eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:46.765890 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-92e836ac-3524-45bf-ac02-e8685a5c19eb None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:46.767119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-92e836ac-3524-45bf-ac02-e8685a5c19eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:46.777396 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec29c02-a793-4267-be47-41d6c93f1d65 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:46.833049 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 890/1805] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:46.840149 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e836ac-3524-45bf-ac02-e8685a5c19eb None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:46.841362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-92e836ac-3524-45bf-ac02-e8685a5c19eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:46.847770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309d4e9-351a-4a7e-b040-579b177f51c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:46.848298 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309d4e9-351a-4a7e-b040-579b177f51c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:46.848447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309d4e9-351a-4a7e-b040-579b177f51c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:46.848696 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309d4e9-351a-4a7e-b040-579b177f51c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:46.849589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309d4e9-351a-4a7e-b040-579b177f51c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:46.851871 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309d4e9-351a-4a7e-b040-579b177f51c3 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:46.865201 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 916/1806] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:23:46.872289 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309d4e9-351a-4a7e-b040-579b177f51c3 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:46.888764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309d4e9-351a-4a7e-b040-579b177f51c3 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:46.898154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad07ad-4de6-4f3a-859f-f6989eff47e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:46.899583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad07ad-4de6-4f3a-859f-f6989eff47e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:46.899931 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad07ad-4de6-4f3a-859f-f6989eff47e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:46.900252 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad07ad-4de6-4f3a-859f-f6989eff47e6 admin admin] PATH_INFO: `/v3/projects/2d6d6a6cd2e24629bb92d60f37bed83f/users/f24437cbce7849f4a92cfa05ba8ee511/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:46.902745 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad07ad-4de6-4f3a-859f-f6989eff47e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d6d6a6cd2e24629bb92d60f37bed83f, user_id=f24437cbce7849f4a92cfa05ba8ee511, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:46.906470 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad07ad-4de6-4f3a-859f-f6989eff47e6 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:46.918423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e836ac-3524-45bf-ac02-e8685a5c19eb None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:46.950412 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 917/1807] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:23:46 2022] PUT /identity/v3/projects/2d6d6a6cd2e24629bb92d60f37bed83f/users/f24437cbce7849f4a92cfa05ba8ee511/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:23:46.961774 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf23e6-3d1f-47ac-a081-6b2b3ca6b421 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:46.962299 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf23e6-3d1f-47ac-a081-6b2b3ca6b421 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:46.962735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf23e6-3d1f-47ac-a081-6b2b3ca6b421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:46.988084 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e84771-7b63-4e0d-84d9-71e67a86d5e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:46.988767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e84771-7b63-4e0d-84d9-71e67a86d5e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:46.989049 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e84771-7b63-4e0d-84d9-71e67a86d5e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:46.989322 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e84771-7b63-4e0d-84d9-71e67a86d5e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:47.017034 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-b4bf23e6-3d1f-47ac-a081-6b2b3ca6b421 None None] MFA Rules not processed for user `f24437cbce7849f4a92cfa05ba8ee511`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:47.021434 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-b4bf23e6-3d1f-47ac-a081-6b2b3ca6b421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:47.097106 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e84771-7b63-4e0d-84d9-71e67a86d5e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:47.099030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e84771-7b63-4e0d-84d9-71e67a86d5e2 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:47.119101 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 891/1808] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:23:47.156197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 918/1809] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:47.169275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e84771-7b63-4e0d-84d9-71e67a86d5e2 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:47.172380 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-33e84771-7b63-4e0d-84d9-71e67a86d5e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:47.196226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:47.324554 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e84771-7b63-4e0d-84d9-71e67a86d5e2 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:47.328812 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82957d65-8ead-4993-8e6b-a48436ac1469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:47.329692 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82957d65-8ead-4993-8e6b-a48436ac1469 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:47.330260 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82957d65-8ead-4993-8e6b-a48436ac1469 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:47.330260 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82957d65-8ead-4993-8e6b-a48436ac1469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:47.344233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:47.346199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82957d65-8ead-4993-8e6b-a48436ac1469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:47.348641 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82957d65-8ead-4993-8e6b-a48436ac1469 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:47.371696 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 892/1810] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:47 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:48.435303 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf23e6-3d1f-47ac-a081-6b2b3ca6b421 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:48.437574 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-b4bf23e6-3d1f-47ac-a081-6b2b3ca6b421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:48.474483 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf23e6-3d1f-47ac-a081-6b2b3ca6b421 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:48.504268 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb836129-39aa-4080-9a27-0ed58d23dbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:48.505326 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb836129-39aa-4080-9a27-0ed58d23dbea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:48.505726 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb836129-39aa-4080-9a27-0ed58d23dbea admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:48.506102 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb836129-39aa-4080-9a27-0ed58d23dbea admin admin] PATH_INFO: `/v3/projects/bf7204e6c6404ffcbd23021991b8eb7f` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:48.508633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb836129-39aa-4080-9a27-0ed58d23dbea admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf7204e6c6404ffcbd23021991b8eb7f)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:48.512691 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb836129-39aa-4080-9a27-0ed58d23dbea admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:48.521458 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82957d65-8ead-4993-8e6b-a48436ac1469 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:48.547634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82957d65-8ead-4993-8e6b-a48436ac1469 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:48.555875 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742eade-1bc0-43ae-afcc-60f6df331141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:48.557842 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742eade-1bc0-43ae-afcc-60f6df331141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:48.558757 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742eade-1bc0-43ae-afcc-60f6df331141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:48.559348 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742eade-1bc0-43ae-afcc-60f6df331141 admin admin] PATH_INFO: `/v3/users/cea811e113184f2f8313461d53116270` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:48.561444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742eade-1bc0-43ae-afcc-60f6df331141 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cea811e113184f2f8313461d53116270)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:48.565060 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742eade-1bc0-43ae-afcc-60f6df331141 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:48.743966 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-eb836129-39aa-4080-9a27-0ed58d23dbea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf7204e6c6404ffcbd23021991b8eb7f', 'request_id': 'req-eb836129-39aa-4080-9a27-0ed58d23dbea'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:48.840531 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-eb836129-39aa-4080-9a27-0ed58d23dbea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf7204e6c6404ffcbd23021991b8eb7f', 'request_id': 'req-eb836129-39aa-4080-9a27-0ed58d23dbea'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:48.850075 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-eb836129-39aa-4080-9a27-0ed58d23dbea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf7204e6c6404ffcbd23021991b8eb7f', 'request_id': 'req-eb836129-39aa-4080-9a27-0ed58d23dbea'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:48.857552 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c742eade-1bc0-43ae-afcc-60f6df331141 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cea811e113184f2f8313461d53116270'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:48.872562 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c742eade-1bc0-43ae-afcc-60f6df331141 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cea811e113184f2f8313461d53116270'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:48.885213 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c742eade-1bc0-43ae-afcc-60f6df331141 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cea811e113184f2f8313461d53116270'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:48.885213 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c742eade-1bc0-43ae-afcc-60f6df331141 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cea811e113184f2f8313461d53116270'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:48.885526 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-eb836129-39aa-4080-9a27-0ed58d23dbea admin admin] The token cache is being invalidate because project bf7204e6c6404ffcbd23021991b8eb7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:23:48.885526 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-eb836129-39aa-4080-9a27-0ed58d23dbea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:48.885526 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-eb836129-39aa-4080-9a27-0ed58d23dbea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:48.905816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 919/1811] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:23:48 2022] DELETE /identity/v3/projects/bf7204e6c6404ffcbd23021991b8eb7f => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:48.907340 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb836129-39aa-4080-9a27-0ed58d23dbea admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:48.907705 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c742eade-1bc0-43ae-afcc-60f6df331141 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cea811e113184f2f8313461d53116270'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:48.916846 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-eb836129-39aa-4080-9a27-0ed58d23dbea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:48.997610 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 893/1812] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:23:48 2022] DELETE /identity/v3/users/cea811e113184f2f8313461d53116270 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:23:49.009860 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b5772-d1b8-4a9f-a639-84b803515ddf None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:49.010937 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b5772-d1b8-4a9f-a639-84b803515ddf None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:49.011725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b5772-d1b8-4a9f-a639-84b803515ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:49.058021 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-9a1b5772-d1b8-4a9f-a639-84b803515ddf None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:49.059318 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9a1b5772-d1b8-4a9f-a639-84b803515ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:49.104385 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb836129-39aa-4080-9a27-0ed58d23dbea admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:49.196270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 894/1813] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:49.210824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b5772-d1b8-4a9f-a639-84b803515ddf None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:49.213484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9a1b5772-d1b8-4a9f-a639-84b803515ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:49.213879 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c688a-7f60-4c15-b2a3-ee01d2249238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:49.215120 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c688a-7f60-4c15-b2a3-ee01d2249238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:49.215678 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c688a-7f60-4c15-b2a3-ee01d2249238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:49.215971 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c688a-7f60-4c15-b2a3-ee01d2249238 admin admin] PATH_INFO: `/v3/users/6cdfc0dae9d24aa38c9705846a0b4d52` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:49.217315 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c688a-7f60-4c15-b2a3-ee01d2249238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cdfc0dae9d24aa38c9705846a0b4d52)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:49.219516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c688a-7f60-4c15-b2a3-ee01d2249238 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:49.292663 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b5772-d1b8-4a9f-a639-84b803515ddf None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:49.296755 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26849c2-d583-492e-8c16-1a976f7133cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:49.297423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26849c2-d583-492e-8c16-1a976f7133cc service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:49.297709 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26849c2-d583-492e-8c16-1a976f7133cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:49.297984 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26849c2-d583-492e-8c16-1a976f7133cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:49.310555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26849c2-d583-492e-8c16-1a976f7133cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:49.312179 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26849c2-d583-492e-8c16-1a976f7133cc service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:49.325405 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 895/1814] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:23:49.499075 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:49.514944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-fd8c688a-7f60-4c15-b2a3-ee01d2249238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cdfc0dae9d24aa38c9705846a0b4d52'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:49.528010 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-fd8c688a-7f60-4c15-b2a3-ee01d2249238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cdfc0dae9d24aa38c9705846a0b4d52'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:49.539174 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-fd8c688a-7f60-4c15-b2a3-ee01d2249238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cdfc0dae9d24aa38c9705846a0b4d52'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:49.539174 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-fd8c688a-7f60-4c15-b2a3-ee01d2249238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cdfc0dae9d24aa38c9705846a0b4d52'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:49.539174 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-fd8c688a-7f60-4c15-b2a3-ee01d2249238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cdfc0dae9d24aa38c9705846a0b4d52'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:49.626003 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 920/1815] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:23:48 2022] DELETE /identity/v3/users/6cdfc0dae9d24aa38c9705846a0b4d52 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:49.785036 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26849c2-d583-492e-8c16-1a976f7133cc service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:49.787039 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d26849c2-d583-492e-8c16-1a976f7133cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:49.807921 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26849c2-d583-492e-8c16-1a976f7133cc service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:49.877788 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091ac5e-5bd9-4a66-83a9-c21995731465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:49.878684 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091ac5e-5bd9-4a66-83a9-c21995731465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:49.878963 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091ac5e-5bd9-4a66-83a9-c21995731465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:49.879236 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091ac5e-5bd9-4a66-83a9-c21995731465 admin admin] PATH_INFO: `/v3/users/3e216b852ef14dbdbad59f71e6aa3aaf` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:49.880544 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0091ac5e-5bd9-4a66-83a9-c21995731465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e216b852ef14dbdbad59f71e6aa3aaf)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:49.883424 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0091ac5e-5bd9-4a66-83a9-c21995731465 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:49.960072 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:50.070225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c688a-7f60-4c15-b2a3-ee01d2249238 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:50.071984 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-fd8c688a-7f60-4c15-b2a3-ee01d2249238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:50.089738 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c688a-7f60-4c15-b2a3-ee01d2249238 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:50.095089 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c7204-3322-4f55-99d3-e28edae235fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:50.096183 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c7204-3322-4f55-99d3-e28edae235fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:50.096472 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c7204-3322-4f55-99d3-e28edae235fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:50.096830 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c7204-3322-4f55-99d3-e28edae235fd admin admin] PATH_INFO: `/v3/projects/7f177af06fc24bdc818b2623faf89893` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:50.098043 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c7204-3322-4f55-99d3-e28edae235fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f177af06fc24bdc818b2623faf89893)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:50.100087 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c7204-3322-4f55-99d3-e28edae235fd admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:50.173208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0091ac5e-5bd9-4a66-83a9-c21995731465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e216b852ef14dbdbad59f71e6aa3aaf'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:50.181768 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0091ac5e-5bd9-4a66-83a9-c21995731465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e216b852ef14dbdbad59f71e6aa3aaf'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:50.182613 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0091ac5e-5bd9-4a66-83a9-c21995731465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e216b852ef14dbdbad59f71e6aa3aaf'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:50.183732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0091ac5e-5bd9-4a66-83a9-c21995731465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e216b852ef14dbdbad59f71e6aa3aaf'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:50.198423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0091ac5e-5bd9-4a66-83a9-c21995731465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e216b852ef14dbdbad59f71e6aa3aaf'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:50.300806 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cb8c7204-3322-4f55-99d3-e28edae235fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f177af06fc24bdc818b2623faf89893', 'request_id': 'req-cb8c7204-3322-4f55-99d3-e28edae235fd'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:50.326867 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 896/1816] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:23:49 2022] DELETE /identity/v3/users/3e216b852ef14dbdbad59f71e6aa3aaf => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:50.331269 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a718b-4829-4f26-ad64-7949c9509ccf None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:50.331614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a718b-4829-4f26-ad64-7949c9509ccf None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:50.331925 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a718b-4829-4f26-ad64-7949c9509ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:50.351704 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-c47a718b-4829-4f26-ad64-7949c9509ccf None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:50.353165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c47a718b-4829-4f26-ad64-7949c9509ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:50.421972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 897/1817] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:23:50.432579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a718b-4829-4f26-ad64-7949c9509ccf None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:50.434252 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c47a718b-4829-4f26-ad64-7949c9509ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:50.446285 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cb8c7204-3322-4f55-99d3-e28edae235fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f177af06fc24bdc818b2623faf89893', 'request_id': 'req-cb8c7204-3322-4f55-99d3-e28edae235fd'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:50.453375 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cb8c7204-3322-4f55-99d3-e28edae235fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f177af06fc24bdc818b2623faf89893', 'request_id': 'req-cb8c7204-3322-4f55-99d3-e28edae235fd'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:50.465744 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cb8c7204-3322-4f55-99d3-e28edae235fd admin admin] The token cache is being invalidate because project 7f177af06fc24bdc818b2623faf89893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:23:50.466117 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cb8c7204-3322-4f55-99d3-e28edae235fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:50.466957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cb8c7204-3322-4f55-99d3-e28edae235fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:50.473153 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 921/1818] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:23:50 2022] DELETE /identity/v3/projects/7f177af06fc24bdc818b2623faf89893 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:23:50.473153 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c7204-3322-4f55-99d3-e28edae235fd admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:50.474315 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-cb8c7204-3322-4f55-99d3-e28edae235fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:50.496844 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a718b-4829-4f26-ad64-7949c9509ccf None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:50.501027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ee91c-3b57-4d72-b4a0-ad221890398f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:50.501982 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ee91c-3b57-4d72-b4a0-ad221890398f service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:50.502308 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ee91c-3b57-4d72-b4a0-ad221890398f service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:50.502525 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ee91c-3b57-4d72-b4a0-ad221890398f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:50.504743 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6e9ee91c-3b57-4d72-b4a0-ad221890398f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:50.517575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ee91c-3b57-4d72-b4a0-ad221890398f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:50.519013 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ee91c-3b57-4d72-b4a0-ad221890398f service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:50.531699 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 898/1819] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:23:50.532847 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ee91c-3b57-4d72-b4a0-ad221890398f service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:50.534196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6e9ee91c-3b57-4d72-b4a0-ad221890398f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:50.548172 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ee91c-3b57-4d72-b4a0-ad221890398f service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:50.557003 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b147a-19f4-4b84-bc51-0c02b2e99728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:50.557265 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c7204-3322-4f55-99d3-e28edae235fd admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:50.562968 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c261d5-f133-4e7b-8925-e62fb04502bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:50.564238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c261d5-f133-4e7b-8925-e62fb04502bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:50.564523 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c261d5-f133-4e7b-8925-e62fb04502bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:50.564802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c261d5-f133-4e7b-8925-e62fb04502bf admin admin] PATH_INFO: `/v3/projects/0d29fdec801541db961ff7f27c2b4567` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:50.566244 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c261d5-f133-4e7b-8925-e62fb04502bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d29fdec801541db961ff7f27c2b4567)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:50.568406 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c261d5-f133-4e7b-8925-e62fb04502bf admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:50.569145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b147a-19f4-4b84-bc51-0c02b2e99728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:50.569441 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b147a-19f4-4b84-bc51-0c02b2e99728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:50.569759 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b147a-19f4-4b84-bc51-0c02b2e99728 admin admin] PATH_INFO: `/v3/users/f24437cbce7849f4a92cfa05ba8ee511` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:50.572797 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b147a-19f4-4b84-bc51-0c02b2e99728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f24437cbce7849f4a92cfa05ba8ee511)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:50.584959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b147a-19f4-4b84-bc51-0c02b2e99728 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:50.708869 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-85c261d5-f133-4e7b-8925-e62fb04502bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d29fdec801541db961ff7f27c2b4567', 'request_id': 'req-85c261d5-f133-4e7b-8925-e62fb04502bf'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:50.812067 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-85c261d5-f133-4e7b-8925-e62fb04502bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d29fdec801541db961ff7f27c2b4567', 'request_id': 'req-85c261d5-f133-4e7b-8925-e62fb04502bf'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:50.819878 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-85c261d5-f133-4e7b-8925-e62fb04502bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d29fdec801541db961ff7f27c2b4567', 'request_id': 'req-85c261d5-f133-4e7b-8925-e62fb04502bf'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:50.827878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7c5b147a-19f4-4b84-bc51-0c02b2e99728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f24437cbce7849f4a92cfa05ba8ee511'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:50.832914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-85c261d5-f133-4e7b-8925-e62fb04502bf admin admin] The token cache is being invalidate because project 0d29fdec801541db961ff7f27c2b4567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:23:50.833555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-85c261d5-f133-4e7b-8925-e62fb04502bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:50.834222 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-85c261d5-f133-4e7b-8925-e62fb04502bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:50.835970 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7c5b147a-19f4-4b84-bc51-0c02b2e99728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f24437cbce7849f4a92cfa05ba8ee511'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:50.836389 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 922/1820] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:23:50 2022] DELETE /identity/v3/projects/0d29fdec801541db961ff7f27c2b4567 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:50.836701 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7c5b147a-19f4-4b84-bc51-0c02b2e99728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f24437cbce7849f4a92cfa05ba8ee511'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:50.837349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7c5b147a-19f4-4b84-bc51-0c02b2e99728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f24437cbce7849f4a92cfa05ba8ee511'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:50.846012 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790acfdd-bc3b-429f-853d-70e757bddef4 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:50.846012 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790acfdd-bc3b-429f-853d-70e757bddef4 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:50.846012 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790acfdd-bc3b-429f-853d-70e757bddef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:50.863399 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-790acfdd-bc3b-429f-853d-70e757bddef4 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:50.864652 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-790acfdd-bc3b-429f-853d-70e757bddef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:50.865105 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7c5b147a-19f4-4b84-bc51-0c02b2e99728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f24437cbce7849f4a92cfa05ba8ee511'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:50.924126 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 923/1821] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:50.933689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cce43-3f78-4a38-84ca-6d064ec7ec61 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:50.934135 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cce43-3f78-4a38-84ca-6d064ec7ec61 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:50.934483 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cce43-3f78-4a38-84ca-6d064ec7ec61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:50.955862 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-492cce43-3f78-4a38-84ca-6d064ec7ec61 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:50.957163 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-492cce43-3f78-4a38-84ca-6d064ec7ec61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:50.965150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 899/1822] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:23:50 2022] DELETE /identity/v3/users/f24437cbce7849f4a92cfa05ba8ee511 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:50.988054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 924/1823] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:23:50.991379 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b147a-19f4-4b84-bc51-0c02b2e99728 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:51.075392 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b147a-19f4-4b84-bc51-0c02b2e99728 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:51.083501 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f00aaf-55fc-4e07-b38b-0acc8d42466f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:51.084696 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f00aaf-55fc-4e07-b38b-0acc8d42466f admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:51.085201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f00aaf-55fc-4e07-b38b-0acc8d42466f admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:51.086231 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f00aaf-55fc-4e07-b38b-0acc8d42466f admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:51.087651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f00aaf-55fc-4e07-b38b-0acc8d42466f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:23:51.088218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f00aaf-55fc-4e07-b38b-0acc8d42466f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:51.091557 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f00aaf-55fc-4e07-b38b-0acc8d42466f admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:51.112153 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cce43-3f78-4a38-84ca-6d064ec7ec61 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:51.115455 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-492cce43-3f78-4a38-84ca-6d064ec7ec61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:51.133229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 900/1824] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:23:51.141600 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f00aaf-55fc-4e07-b38b-0acc8d42466f admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:51.156689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cce43-3f78-4a38-84ca-6d064ec7ec61 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:51.171888 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbaef1-13cc-4904-b6e1-c96b13f57ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:51.173614 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbaef1-13cc-4904-b6e1-c96b13f57ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:51.174019 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbaef1-13cc-4904-b6e1-c96b13f57ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:51.174339 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbaef1-13cc-4904-b6e1-c96b13f57ec9 admin admin] PATH_INFO: `/v3/projects/a0f3e0548c674c84b4ca68e0a806c41d` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:51.177516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbaef1-13cc-4904-b6e1-c96b13f57ec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0f3e0548c674c84b4ca68e0a806c41d)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:51.180112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f00aaf-55fc-4e07-b38b-0acc8d42466f admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:51.181415 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbaef1-13cc-4904-b6e1-c96b13f57ec9 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:51.188070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26fe3a-44e5-4833-8465-c3dba421af28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:51.189142 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26fe3a-44e5-4833-8465-c3dba421af28 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:51.189607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26fe3a-44e5-4833-8465-c3dba421af28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:51.190209 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26fe3a-44e5-4833-8465-c3dba421af28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:51.191237 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26fe3a-44e5-4833-8465-c3dba421af28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:51.194259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26fe3a-44e5-4833-8465-c3dba421af28 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:51.364692 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 901/1825] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:23:51 2022] POST /identity/v3/projects => generated 387 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:51.370415 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26fe3a-44e5-4833-8465-c3dba421af28 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:51.423957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-d1bbaef1-13cc-4904-b6e1-c96b13f57ec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0f3e0548c674c84b4ca68e0a806c41d', 'request_id': 'req-d1bbaef1-13cc-4904-b6e1-c96b13f57ec9'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:51.468884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26fe3a-44e5-4833-8465-c3dba421af28 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:51.514079 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-d1bbaef1-13cc-4904-b6e1-c96b13f57ec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0f3e0548c674c84b4ca68e0a806c41d', 'request_id': 'req-d1bbaef1-13cc-4904-b6e1-c96b13f57ec9'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:51.525361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-d1bbaef1-13cc-4904-b6e1-c96b13f57ec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0f3e0548c674c84b4ca68e0a806c41d', 'request_id': 'req-d1bbaef1-13cc-4904-b6e1-c96b13f57ec9'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:51.542686 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-d1bbaef1-13cc-4904-b6e1-c96b13f57ec9 admin admin] The token cache is being invalidate because project a0f3e0548c674c84b4ca68e0a806c41d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:23:51.543185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-d1bbaef1-13cc-4904-b6e1-c96b13f57ec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:51.544062 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-d1bbaef1-13cc-4904-b6e1-c96b13f57ec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:51.546909 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 925/1826] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:23:51 2022] DELETE /identity/v3/projects/a0f3e0548c674c84b4ca68e0a806c41d => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:23:51.551189 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbaef1-13cc-4904-b6e1-c96b13f57ec9 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:51.554140 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-d1bbaef1-13cc-4904-b6e1-c96b13f57ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:51.568456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b77a5-5b0b-49e6-9ab2-e20b16bea616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:51.569393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b77a5-5b0b-49e6-9ab2-e20b16bea616 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:51.570394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b77a5-5b0b-49e6-9ab2-e20b16bea616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:51.570820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b77a5-5b0b-49e6-9ab2-e20b16bea616 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:51.572692 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b77a5-5b0b-49e6-9ab2-e20b16bea616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:51.575016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b77a5-5b0b-49e6-9ab2-e20b16bea616 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:51.654872 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbaef1-13cc-4904-b6e1-c96b13f57ec9 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:51.665529 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dd9cf-c0ac-479a-9c28-d3eef24dcec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:51.666985 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dd9cf-c0ac-479a-9c28-d3eef24dcec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:51.667644 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dd9cf-c0ac-479a-9c28-d3eef24dcec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:51.668163 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dd9cf-c0ac-479a-9c28-d3eef24dcec0 admin admin] PATH_INFO: `/v3/users/835a226dd4b34f4a913705742813eb2c` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:51.670798 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622dd9cf-c0ac-479a-9c28-d3eef24dcec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=835a226dd4b34f4a913705742813eb2c)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:51.673733 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622dd9cf-c0ac-479a-9c28-d3eef24dcec0 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:51.722664 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 902/1827] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:23:51 2022] POST /identity/v3/users => generated 294 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:51.726574 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b77a5-5b0b-49e6-9ab2-e20b16bea616 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:51.728456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-434b77a5-5b0b-49e6-9ab2-e20b16bea616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:51.740276 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b77a5-5b0b-49e6-9ab2-e20b16bea616 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:51.745436 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49c4f6-c188-4769-8065-0b2449e26c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:51.748050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49c4f6-c188-4769-8065-0b2449e26c8c admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:51.748050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49c4f6-c188-4769-8065-0b2449e26c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:51.748050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49c4f6-c188-4769-8065-0b2449e26c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:51.748050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49c4f6-c188-4769-8065-0b2449e26c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:51.748958 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49c4f6-c188-4769-8065-0b2449e26c8c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:51.759384 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 903/1828] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:23:51.763397 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49c4f6-c188-4769-8065-0b2449e26c8c admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:51.773614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49c4f6-c188-4769-8065-0b2449e26c8c admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:51.778430 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e30f7-66cc-4d36-a5fe-3d5ac67a4b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:51.779176 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e30f7-66cc-4d36-a5fe-3d5ac67a4b50 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:51.781235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e30f7-66cc-4d36-a5fe-3d5ac67a4b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:51.781235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e30f7-66cc-4d36-a5fe-3d5ac67a4b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:51.781235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e30f7-66cc-4d36-a5fe-3d5ac67a4b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:51.782245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e30f7-66cc-4d36-a5fe-3d5ac67a4b50 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:51.793510 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 904/1829] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:23:51.798685 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e30f7-66cc-4d36-a5fe-3d5ac67a4b50 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:51.808809 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e30f7-66cc-4d36-a5fe-3d5ac67a4b50 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:51.817713 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de66a5d-d0e8-4d72-a7cd-e174b558be8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:51.822825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de66a5d-d0e8-4d72-a7cd-e174b558be8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:51.822825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de66a5d-d0e8-4d72-a7cd-e174b558be8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:51.822825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de66a5d-d0e8-4d72-a7cd-e174b558be8d admin admin] PATH_INFO: `/v3/projects/cc9f34d3e9df49059b0f5a74fbda8714/users/710293d8def64dd3a15137210e1c825c/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:51.850709 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de66a5d-d0e8-4d72-a7cd-e174b558be8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc9f34d3e9df49059b0f5a74fbda8714, user_id=710293d8def64dd3a15137210e1c825c, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:51.862763 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de66a5d-d0e8-4d72-a7cd-e174b558be8d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:51.911269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-622dd9cf-c0ac-479a-9c28-d3eef24dcec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '835a226dd4b34f4a913705742813eb2c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:51.926558 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-622dd9cf-c0ac-479a-9c28-d3eef24dcec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '835a226dd4b34f4a913705742813eb2c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:51.932200 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:51.939249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-622dd9cf-c0ac-479a-9c28-d3eef24dcec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '835a226dd4b34f4a913705742813eb2c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:51.940113 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-622dd9cf-c0ac-479a-9c28-d3eef24dcec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '835a226dd4b34f4a913705742813eb2c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:51.941405 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-622dd9cf-c0ac-479a-9c28-d3eef24dcec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '835a226dd4b34f4a913705742813eb2c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:52.032101 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 926/1830] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:23:51 2022] DELETE /identity/v3/users/835a226dd4b34f4a913705742813eb2c => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:52.033253 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dd9cf-c0ac-479a-9c28-d3eef24dcec0 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:52.044101 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 905/1831] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:23:51 2022] PUT /identity/v3/projects/cc9f34d3e9df49059b0f5a74fbda8714/users/710293d8def64dd3a15137210e1c825c/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:23:52.046181 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-622dd9cf-c0ac-479a-9c28-d3eef24dcec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:52.054875 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edd15c-6c9b-4a90-b8a7-8c1d3723243c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:52.055147 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edd15c-6c9b-4a90-b8a7-8c1d3723243c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:52.056550 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edd15c-6c9b-4a90-b8a7-8c1d3723243c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:52.093630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-d4edd15c-6c9b-4a90-b8a7-8c1d3723243c None None] MFA Rules not processed for user `710293d8def64dd3a15137210e1c825c`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:52.095684 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d4edd15c-6c9b-4a90-b8a7-8c1d3723243c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:52.140704 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dd9cf-c0ac-479a-9c28-d3eef24dcec0 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:52.152955 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ddaee-9517-4d15-923e-64775cab2bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:52.153892 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ddaee-9517-4d15-923e-64775cab2bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:52.154577 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ddaee-9517-4d15-923e-64775cab2bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:52.154887 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ddaee-9517-4d15-923e-64775cab2bf4 admin admin] PATH_INFO: `/v3/projects/2d6d6a6cd2e24629bb92d60f37bed83f` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:52.156586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ddaee-9517-4d15-923e-64775cab2bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d6d6a6cd2e24629bb92d60f37bed83f)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:52.159450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ddaee-9517-4d15-923e-64775cab2bf4 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:52.224545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 906/1832] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:52.227828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edd15c-6c9b-4a90-b8a7-8c1d3723243c None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:52.232884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d4edd15c-6c9b-4a90-b8a7-8c1d3723243c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:52.247807 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edd15c-6c9b-4a90-b8a7-8c1d3723243c None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:52.252948 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3aff09-bb30-4399-9db8-f2a66a898af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:52.253653 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aff09-bb30-4399-9db8-f2a66a898af9 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:52.253922 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aff09-bb30-4399-9db8-f2a66a898af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:52.254208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aff09-bb30-4399-9db8-f2a66a898af9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:52.254908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3aff09-bb30-4399-9db8-f2a66a898af9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:52.256920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3aff09-bb30-4399-9db8-f2a66a898af9 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:52.324715 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-ec6ddaee-9517-4d15-923e-64775cab2bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d6d6a6cd2e24629bb92d60f37bed83f', 'request_id': 'req-ec6ddaee-9517-4d15-923e-64775cab2bf4'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:52.371195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 907/1833] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:23:52 2022] POST /identity/v3/projects => generated 387 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:52.376441 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3aff09-bb30-4399-9db8-f2a66a898af9 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:52.411978 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-ec6ddaee-9517-4d15-923e-64775cab2bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d6d6a6cd2e24629bb92d60f37bed83f', 'request_id': 'req-ec6ddaee-9517-4d15-923e-64775cab2bf4'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:52.433437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-ec6ddaee-9517-4d15-923e-64775cab2bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d6d6a6cd2e24629bb92d60f37bed83f', 'request_id': 'req-ec6ddaee-9517-4d15-923e-64775cab2bf4'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:52.462416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-ec6ddaee-9517-4d15-923e-64775cab2bf4 admin admin] The token cache is being invalidate because project 2d6d6a6cd2e24629bb92d60f37bed83f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:23:52.462968 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-ec6ddaee-9517-4d15-923e-64775cab2bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:52.464215 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-ec6ddaee-9517-4d15-923e-64775cab2bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:52.467369 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 927/1834] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:23:52 2022] DELETE /identity/v3/projects/2d6d6a6cd2e24629bb92d60f37bed83f => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:52.472315 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3faf73-be32-43c2-8777-1948c26f5e3d None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:52.472794 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3faf73-be32-43c2-8777-1948c26f5e3d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:52.473230 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3faf73-be32-43c2-8777-1948c26f5e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:52.481818 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3aff09-bb30-4399-9db8-f2a66a898af9 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:52.488956 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df9db8-3d96-4fb6-b086-df64a114b5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:52.489976 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df9db8-3d96-4fb6-b086-df64a114b5e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:52.490550 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df9db8-3d96-4fb6-b086-df64a114b5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:52.491290 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df9db8-3d96-4fb6-b086-df64a114b5e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:52.492801 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df9db8-3d96-4fb6-b086-df64a114b5e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:52.498459 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df9db8-3d96-4fb6-b086-df64a114b5e3 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:52.514313 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-3b3faf73-be32-43c2-8777-1948c26f5e3d None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:52.515640 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-3b3faf73-be32-43c2-8777-1948c26f5e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:52.528160 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 928/1835] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:52.539119 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1097c58-caf1-4878-b57d-73735173fb1d None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:52.539572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1097c58-caf1-4878-b57d-73735173fb1d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:52.540145 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1097c58-caf1-4878-b57d-73735173fb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:52.569512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-b1097c58-caf1-4878-b57d-73735173fb1d None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:52.571216 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-b1097c58-caf1-4878-b57d-73735173fb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:52.595414 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 929/1836] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:52.607509 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1097c58-caf1-4878-b57d-73735173fb1d None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:52.629973 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 908/1837] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:23:52 2022] POST /identity/v3/users => generated 294 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:52.634991 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df9db8-3d96-4fb6-b086-df64a114b5e3 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:52.637714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-73df9db8-3d96-4fb6-b086-df64a114b5e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:52.645656 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1097c58-caf1-4878-b57d-73735173fb1d None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:52.657673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df9db8-3d96-4fb6-b086-df64a114b5e3 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:52.660797 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47cfd6f-8f71-4af3-b1d2-799fd4960ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:52.662373 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cfd6f-8f71-4af3-b1d2-799fd4960ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:52.662373 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cfd6f-8f71-4af3-b1d2-799fd4960ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:52.662891 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cfd6f-8f71-4af3-b1d2-799fd4960ea7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:52.665554 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47cfd6f-8f71-4af3-b1d2-799fd4960ea7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:23:52.667630 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47cfd6f-8f71-4af3-b1d2-799fd4960ea7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:52.682422 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5463f2-487b-48b8-b855-c95f34698be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:52.682601 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47cfd6f-8f71-4af3-b1d2-799fd4960ea7 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:52.682765 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5463f2-487b-48b8-b855-c95f34698be8 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:52.682765 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5463f2-487b-48b8-b855-c95f34698be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:52.682765 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5463f2-487b-48b8-b855-c95f34698be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:52.682765 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5463f2-487b-48b8-b855-c95f34698be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:52.682765 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5463f2-487b-48b8-b855-c95f34698be8 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:52.703159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 909/1838] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:23:52.706706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5463f2-487b-48b8-b855-c95f34698be8 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:52.712941 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 930/1839] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:23:52.716256 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47cfd6f-8f71-4af3-b1d2-799fd4960ea7 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:52.720791 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5463f2-487b-48b8-b855-c95f34698be8 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:52.733796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47cfd6f-8f71-4af3-b1d2-799fd4960ea7 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:52.739969 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394209c-09c5-40d4-8538-961066556809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:52.741340 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394209c-09c5-40d4-8538-961066556809 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:52.742244 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394209c-09c5-40d4-8538-961066556809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:52.742594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394209c-09c5-40d4-8538-961066556809 admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:52.743746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394209c-09c5-40d4-8538-961066556809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:52.745197 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330eae12-da32-4d4c-94b2-3c5fe97397f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:52.747540 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394209c-09c5-40d4-8538-961066556809 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:52.748936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330eae12-da32-4d4c-94b2-3c5fe97397f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:52.756712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330eae12-da32-4d4c-94b2-3c5fe97397f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:52.756712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330eae12-da32-4d4c-94b2-3c5fe97397f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:52.757941 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330eae12-da32-4d4c-94b2-3c5fe97397f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:52.760122 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330eae12-da32-4d4c-94b2-3c5fe97397f5 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:52.789159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 910/1840] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:23:52.797292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330eae12-da32-4d4c-94b2-3c5fe97397f5 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:52.813770 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330eae12-da32-4d4c-94b2-3c5fe97397f5 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:52.819300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85fe57-9587-49fb-a0ef-55d13ef946c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:52.820711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85fe57-9587-49fb-a0ef-55d13ef946c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:52.821141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85fe57-9587-49fb-a0ef-55d13ef946c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:52.821559 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85fe57-9587-49fb-a0ef-55d13ef946c0 admin admin] PATH_INFO: `/v3/projects/45e61fd706b74427bbd0372c05254a76/users/5e2fa74edc5d4f428d3f5e4966fbe6cf/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:52.847317 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85fe57-9587-49fb-a0ef-55d13ef946c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45e61fd706b74427bbd0372c05254a76, user_id=5e2fa74edc5d4f428d3f5e4966fbe6cf, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:52.850241 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85fe57-9587-49fb-a0ef-55d13ef946c0 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:52.876921 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 931/1841] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:23:52 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:52.878186 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394209c-09c5-40d4-8538-961066556809 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:52.880238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-7394209c-09c5-40d4-8538-961066556809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:52.939302 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 911/1842] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:23:52 2022] PUT /identity/v3/projects/45e61fd706b74427bbd0372c05254a76/users/5e2fa74edc5d4f428d3f5e4966fbe6cf/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:52.949071 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85fe57-9587-49fb-a0ef-55d13ef946c0 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:52.976432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394209c-09c5-40d4-8538-961066556809 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:53.019258 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85fe57-9587-49fb-a0ef-55d13ef946c0 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:53.023945 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895442f5-8194-4b1a-8349-8075c1349e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:53.024662 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895442f5-8194-4b1a-8349-8075c1349e8f admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:53.024941 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895442f5-8194-4b1a-8349-8075c1349e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:53.025210 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895442f5-8194-4b1a-8349-8075c1349e8f admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:53.025892 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895442f5-8194-4b1a-8349-8075c1349e8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:53.027796 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895442f5-8194-4b1a-8349-8075c1349e8f admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:53.044327 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a48b8-17b0-4620-89c2-2d86346fb23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:53.045194 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a48b8-17b0-4620-89c2-2d86346fb23c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:53.045477 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a48b8-17b0-4620-89c2-2d86346fb23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:53.045750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a48b8-17b0-4620-89c2-2d86346fb23c admin admin] PATH_INFO: `/v3/projects/13dc5e971b374fb5a175f27c21690137` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:53.046939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a48b8-17b0-4620-89c2-2d86346fb23c admin admin] RBAC: Authorizing `identity:delete_project(project_id=13dc5e971b374fb5a175f27c21690137)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:53.048892 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a48b8-17b0-4620-89c2-2d86346fb23c admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:53.189440 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 912/1843] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:23:52 2022] POST /identity/v3/users => generated 287 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:53.191691 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de566af0-9101-4ac8-9b78-7bf9c6dd452e None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:53.192222 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de566af0-9101-4ac8-9b78-7bf9c6dd452e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:53.192728 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de566af0-9101-4ac8-9b78-7bf9c6dd452e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:53.223143 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-de566af0-9101-4ac8-9b78-7bf9c6dd452e None None] MFA Rules not processed for user `5e2fa74edc5d4f428d3f5e4966fbe6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:53.224506 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-de566af0-9101-4ac8-9b78-7bf9c6dd452e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:53.242693 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-ba7a48b8-17b0-4620-89c2-2d86346fb23c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13dc5e971b374fb5a175f27c21690137', 'request_id': 'req-ba7a48b8-17b0-4620-89c2-2d86346fb23c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:53.295592 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 913/1844] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:53.296633 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de566af0-9101-4ac8-9b78-7bf9c6dd452e None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:53.307419 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de566af0-9101-4ac8-9b78-7bf9c6dd452e None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:53.359408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-ba7a48b8-17b0-4620-89c2-2d86346fb23c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13dc5e971b374fb5a175f27c21690137', 'request_id': 'req-ba7a48b8-17b0-4620-89c2-2d86346fb23c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:53.365424 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a03b0c-4bcf-4188-9e96-4504c4dee028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:53.366241 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a03b0c-4bcf-4188-9e96-4504c4dee028 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:53.366648 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a03b0c-4bcf-4188-9e96-4504c4dee028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:53.366800 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-ba7a48b8-17b0-4620-89c2-2d86346fb23c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13dc5e971b374fb5a175f27c21690137', 'request_id': 'req-ba7a48b8-17b0-4620-89c2-2d86346fb23c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:53.367101 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a03b0c-4bcf-4188-9e96-4504c4dee028 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:53.368153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a03b0c-4bcf-4188-9e96-4504c4dee028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:53.369903 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a03b0c-4bcf-4188-9e96-4504c4dee028 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:53.380061 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-ba7a48b8-17b0-4620-89c2-2d86346fb23c admin admin] The token cache is being invalidate because project 13dc5e971b374fb5a175f27c21690137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:23:53.380344 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-ba7a48b8-17b0-4620-89c2-2d86346fb23c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:53.381031 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-ba7a48b8-17b0-4620-89c2-2d86346fb23c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:53.381143 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 914/1845] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:23:53.382000 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a03b0c-4bcf-4188-9e96-4504c4dee028 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:53.385523 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 932/1846] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:23:52 2022] DELETE /identity/v3/projects/13dc5e971b374fb5a175f27c21690137 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:53.386383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a48b8-17b0-4620-89c2-2d86346fb23c admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:53.387933 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-ba7a48b8-17b0-4620-89c2-2d86346fb23c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:53.393124 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a03b0c-4bcf-4188-9e96-4504c4dee028 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:53.398964 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80038638-1353-4363-b125-23c7ddc482de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:53.400158 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80038638-1353-4363-b125-23c7ddc482de admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:53.400548 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80038638-1353-4363-b125-23c7ddc482de admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:53.400824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80038638-1353-4363-b125-23c7ddc482de admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:53.401738 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a48b8-17b0-4620-89c2-2d86346fb23c admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:53.401892 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80038638-1353-4363-b125-23c7ddc482de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:53.403931 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80038638-1353-4363-b125-23c7ddc482de admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:53.408310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68b6f6-39ad-4bd1-9c68-ae8f638a99e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:53.409464 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68b6f6-39ad-4bd1-9c68-ae8f638a99e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:53.410042 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68b6f6-39ad-4bd1-9c68-ae8f638a99e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:53.410508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68b6f6-39ad-4bd1-9c68-ae8f638a99e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:53.411614 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68b6f6-39ad-4bd1-9c68-ae8f638a99e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:53.415165 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68b6f6-39ad-4bd1-9c68-ae8f638a99e3 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:53.435146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 933/1847] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:23:53.435146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0dd2a-523b-4567-92b7-5f857de4b431 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:53.435146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0dd2a-523b-4567-92b7-5f857de4b431 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:53.435146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0dd2a-523b-4567-92b7-5f857de4b431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:53.455016 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-a1d0dd2a-523b-4567-92b7-5f857de4b431 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:53.456228 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-a1d0dd2a-523b-4567-92b7-5f857de4b431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:53.464894 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 934/1848] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:53.465701 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0dd2a-523b-4567-92b7-5f857de4b431 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:53.476058 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0dd2a-523b-4567-92b7-5f857de4b431 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:53.482047 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343ac49-c1b0-44b6-9c59-72e3b95b2b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:53.482953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343ac49-c1b0-44b6-9c59-72e3b95b2b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:53.483252 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343ac49-c1b0-44b6-9c59-72e3b95b2b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:53.483576 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343ac49-c1b0-44b6-9c59-72e3b95b2b95 admin admin] PATH_INFO: `/v3/projects/33fafedbd8e641588884554063403a51/users/7b9b819e522144dbb780cbc3843f88c8/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:53.505386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343ac49-c1b0-44b6-9c59-72e3b95b2b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33fafedbd8e641588884554063403a51, user_id=7b9b819e522144dbb780cbc3843f88c8, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:53.508099 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343ac49-c1b0-44b6-9c59-72e3b95b2b95 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:53.549930 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 915/1849] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:23:53 2022] POST /identity/v3/projects => generated 387 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:53.551460 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60896cd-387f-4c9f-a450-3e159d153dd0 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:53.551744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60896cd-387f-4c9f-a450-3e159d153dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:53.552046 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60896cd-387f-4c9f-a450-3e159d153dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:53.570274 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f60896cd-387f-4c9f-a450-3e159d153dd0 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:53.571486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f60896cd-387f-4c9f-a450-3e159d153dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:53.634144 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 916/1850] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:53.634942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60896cd-387f-4c9f-a450-3e159d153dd0 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:53.636404 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f60896cd-387f-4c9f-a450-3e159d153dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:53.642037 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 935/1851] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:23:53 2022] PUT /identity/v3/projects/33fafedbd8e641588884554063403a51/users/7b9b819e522144dbb780cbc3843f88c8/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:53.642940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343ac49-c1b0-44b6-9c59-72e3b95b2b95 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:53.648532 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:53.657872 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60896cd-387f-4c9f-a450-3e159d153dd0 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:53.744732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef84665-8835-46e9-9c08-6aa135aaff2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:53.745882 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef84665-8835-46e9-9c08-6aa135aaff2b admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:53.746384 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef84665-8835-46e9-9c08-6aa135aaff2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:53.746871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef84665-8835-46e9-9c08-6aa135aaff2b admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:53.748182 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef84665-8835-46e9-9c08-6aa135aaff2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:53.749916 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343ac49-c1b0-44b6-9c59-72e3b95b2b95 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:53.751339 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef84665-8835-46e9-9c08-6aa135aaff2b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:53.755770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994c67f-7d96-4945-a527-189e2037ac59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:53.756497 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994c67f-7d96-4945-a527-189e2037ac59 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:53.756776 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994c67f-7d96-4945-a527-189e2037ac59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:53.757736 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994c67f-7d96-4945-a527-189e2037ac59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:53.758635 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994c67f-7d96-4945-a527-189e2037ac59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:23:53.758947 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994c67f-7d96-4945-a527-189e2037ac59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:53.760652 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994c67f-7d96-4945-a527-189e2037ac59 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:53.780768 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 936/1852] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:23:53.782251 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0ba9e-0ae5-48e1-9253-4669380e5cbe None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:53.782539 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0ba9e-0ae5-48e1-9253-4669380e5cbe None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:53.782815 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0ba9e-0ae5-48e1-9253-4669380e5cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:53.805523 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-20d0ba9e-0ae5-48e1-9253-4669380e5cbe None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:53.808355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-20d0ba9e-0ae5-48e1-9253-4669380e5cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:53.814968 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 937/1853] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:53.816235 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0ba9e-0ae5-48e1-9253-4669380e5cbe None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:53.828673 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0ba9e-0ae5-48e1-9253-4669380e5cbe None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:53.836820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc42b3e-8f54-4ab8-a993-37d1d8fb4ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:53.838188 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc42b3e-8f54-4ab8-a993-37d1d8fb4ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:53.838188 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc42b3e-8f54-4ab8-a993-37d1d8fb4ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:53.838188 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc42b3e-8f54-4ab8-a993-37d1d8fb4ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:53.838743 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc42b3e-8f54-4ab8-a993-37d1d8fb4ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:53.840769 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc42b3e-8f54-4ab8-a993-37d1d8fb4ad2 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:53.880486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 917/1854] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:23:53 2022] POST /identity/v3/users => generated 300 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:53.881683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef84665-8835-46e9-9c08-6aa135aaff2b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:53.884973 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-eef84665-8835-46e9-9c08-6aa135aaff2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:53.953140 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 938/1855] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:23:53 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:53.953140 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc42b3e-8f54-4ab8-a993-37d1d8fb4ad2 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:53.993671 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef84665-8835-46e9-9c08-6aa135aaff2b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:54.071378 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07914989-5d12-4222-abe4-5942c25c40ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:54.073103 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914989-5d12-4222-abe4-5942c25c40ba service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:54.073579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914989-5d12-4222-abe4-5942c25c40ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:54.074034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914989-5d12-4222-abe4-5942c25c40ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:54.087194 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07914989-5d12-4222-abe4-5942c25c40ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:54.089148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07914989-5d12-4222-abe4-5942c25c40ba service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:54.093935 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc42b3e-8f54-4ab8-a993-37d1d8fb4ad2 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:54.099595 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d631b-e078-4de0-b9a1-bc9b6551821e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:54.100404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d631b-e078-4de0-b9a1-bc9b6551821e admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:54.101203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 918/1856] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:54.102034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07914989-5d12-4222-abe4-5942c25c40ba service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:54.104416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d631b-e078-4de0-b9a1-bc9b6551821e admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:54.104915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d631b-e078-4de0-b9a1-bc9b6551821e admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:54.105878 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d631b-e078-4de0-b9a1-bc9b6551821e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:54.109730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d631b-e078-4de0-b9a1-bc9b6551821e admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:54.115839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07914989-5d12-4222-abe4-5942c25c40ba service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:54.121593 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e4c49-793a-44d2-bcc6-bdba91d64dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:54.122270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e4c49-793a-44d2-bcc6-bdba91d64dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:54.122553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e4c49-793a-44d2-bcc6-bdba91d64dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:54.122827 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e4c49-793a-44d2-bcc6-bdba91d64dd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:54.123528 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e4c49-793a-44d2-bcc6-bdba91d64dd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:54.125500 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e4c49-793a-44d2-bcc6-bdba91d64dd3 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:54.129757 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 939/1857] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:23:54.131175 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d631b-e078-4de0-b9a1-bc9b6551821e admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:54.142011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d631b-e078-4de0-b9a1-bc9b6551821e admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:54.147144 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b67c13-2a7f-406d-9ead-cc24a61b728c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:54.148088 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b67c13-2a7f-406d-9ead-cc24a61b728c admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:54.148371 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b67c13-2a7f-406d-9ead-cc24a61b728c admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:54.148647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b67c13-2a7f-406d-9ead-cc24a61b728c admin admin] PATH_INFO: `/v3/projects/21000c6247494335b15c7a5498f9d71a/users/7014dbe2ba3945c1b3f1a0b9229466cd/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:54.164504 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b67c13-2a7f-406d-9ead-cc24a61b728c admin admin] RBAC: Authorizing `identity:create_grant(project_id=21000c6247494335b15c7a5498f9d71a, user_id=7014dbe2ba3945c1b3f1a0b9229466cd, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:54.173969 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b67c13-2a7f-406d-9ead-cc24a61b728c admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:54.275135 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 940/1858] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:23:54 2022] PUT /identity/v3/projects/21000c6247494335b15c7a5498f9d71a/users/7014dbe2ba3945c1b3f1a0b9229466cd/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:54.275346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 919/1859] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:23:54 2022] POST /identity/v3/users => generated 287 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:54.279037 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b67c13-2a7f-406d-9ead-cc24a61b728c admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:54.279464 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e4c49-793a-44d2-bcc6-bdba91d64dd3 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:54.290384 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e4c49-793a-44d2-bcc6-bdba91d64dd3 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:54.351466 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b67c13-2a7f-406d-9ead-cc24a61b728c admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:54.356675 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddb315-f5e0-4173-9ac0-e8b55e64a0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:54.357078 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ab5df-be37-4b71-b22c-549518645538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:54.357382 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddb315-f5e0-4173-9ac0-e8b55e64a0dc admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:54.357941 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddb315-f5e0-4173-9ac0-e8b55e64a0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:54.358059 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddb315-f5e0-4173-9ac0-e8b55e64a0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:54.358716 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddb315-f5e0-4173-9ac0-e8b55e64a0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:54.358864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ab5df-be37-4b71-b22c-549518645538 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:54.359626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ab5df-be37-4b71-b22c-549518645538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:54.360085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ab5df-be37-4b71-b22c-549518645538 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:54.360390 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddb315-f5e0-4173-9ac0-e8b55e64a0dc admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:54.361510 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ab5df-be37-4b71-b22c-549518645538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:54.364035 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ab5df-be37-4b71-b22c-549518645538 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:54.369637 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:54.376940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 941/1860] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:23:54.378329 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 920/1861] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:23:54.382141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddb315-f5e0-4173-9ac0-e8b55e64a0dc admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:54.382447 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ab5df-be37-4b71-b22c-549518645538 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:54.393352 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddb315-f5e0-4173-9ac0-e8b55e64a0dc admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:54.394912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ab5df-be37-4b71-b22c-549518645538 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:54.400307 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bfe4c-cc8f-42ae-96e3-022b8224b42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:54.401454 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bfe4c-cc8f-42ae-96e3-022b8224b42e admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:54.401454 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bfe4c-cc8f-42ae-96e3-022b8224b42e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:54.406301 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bfe4c-cc8f-42ae-96e3-022b8224b42e admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:54.406404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ef731-b316-489b-bb63-eb6c7480ba72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:54.406525 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bfe4c-cc8f-42ae-96e3-022b8224b42e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:54.406612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ef731-b316-489b-bb63-eb6c7480ba72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:54.406612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ef731-b316-489b-bb63-eb6c7480ba72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:54.406783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bfe4c-cc8f-42ae-96e3-022b8224b42e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:54.406865 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ef731-b316-489b-bb63-eb6c7480ba72 admin admin] PATH_INFO: `/v3/projects/21000c6247494335b15c7a5498f9d71a/users/7014dbe2ba3945c1b3f1a0b9229466cd/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:54.407892 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ef731-b316-489b-bb63-eb6c7480ba72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21000c6247494335b15c7a5498f9d71a, user_id=7014dbe2ba3945c1b3f1a0b9229466cd, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:54.410861 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ef731-b316-489b-bb63-eb6c7480ba72 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:54.417067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 921/1862] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:23:54.421408 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bfe4c-cc8f-42ae-96e3-022b8224b42e admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:54.434811 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 942/1863] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:23:54 2022] PUT /identity/v3/projects/21000c6247494335b15c7a5498f9d71a/users/7014dbe2ba3945c1b3f1a0b9229466cd/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:23:54.436177 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55806d49-f6ab-4e1d-b884-1c1197036619 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:54.438805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55806d49-f6ab-4e1d-b884-1c1197036619 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:54.438805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55806d49-f6ab-4e1d-b884-1c1197036619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:54.439116 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bfe4c-cc8f-42ae-96e3-022b8224b42e admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:54.473228 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-55806d49-f6ab-4e1d-b884-1c1197036619 None None] MFA Rules not processed for user `7014dbe2ba3945c1b3f1a0b9229466cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:54.473228 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-55806d49-f6ab-4e1d-b884-1c1197036619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:54.528011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcdfe5-f84f-4544-ab93-ae5f1cea77b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:54.529033 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcdfe5-f84f-4544-ab93-ae5f1cea77b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:54.529381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcdfe5-f84f-4544-ab93-ae5f1cea77b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:54.529730 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcdfe5-f84f-4544-ab93-ae5f1cea77b8 admin admin] PATH_INFO: `/v3/projects/4ad2f081de5c4c1e855e5c6d15475412/users/de064bc337064d39a145b45134755df8/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:54.549603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcdfe5-f84f-4544-ab93-ae5f1cea77b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ad2f081de5c4c1e855e5c6d15475412, user_id=de064bc337064d39a145b45134755df8, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:54.552571 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcdfe5-f84f-4544-ab93-ae5f1cea77b8 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:54.573728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 943/1864] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:54.584865 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55806d49-f6ab-4e1d-b884-1c1197036619 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:54.586844 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-55806d49-f6ab-4e1d-b884-1c1197036619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:54.654712 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55806d49-f6ab-4e1d-b884-1c1197036619 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:54.659014 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa48001-d897-4b54-bfd7-7dfc72e760b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:54.659690 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa48001-d897-4b54-bfd7-7dfc72e760b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:54.660173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa48001-d897-4b54-bfd7-7dfc72e760b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:54.660479 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa48001-d897-4b54-bfd7-7dfc72e760b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:54.669841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 922/1865] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:23:54 2022] PUT /identity/v3/projects/4ad2f081de5c4c1e855e5c6d15475412/users/de064bc337064d39a145b45134755df8/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:54.678435 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa48001-d897-4b54-bfd7-7dfc72e760b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:54.682107 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa48001-d897-4b54-bfd7-7dfc72e760b2 service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:54.700189 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda5513-6f23-4393-a394-1956bb9776f5 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:54.700189 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda5513-6f23-4393-a394-1956bb9776f5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:54.700189 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda5513-6f23-4393-a394-1956bb9776f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:54.702256 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 944/1866] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:23:54.772561 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-4bda5513-6f23-4393-a394-1956bb9776f5 None None] MFA Rules not processed for user `de064bc337064d39a145b45134755df8`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:54.774457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4bda5513-6f23-4393-a394-1956bb9776f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:54.917877 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 923/1867] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:54.920838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa48001-d897-4b54-bfd7-7dfc72e760b2 service cinder] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:54.949212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa48001-d897-4b54-bfd7-7dfc72e760b2 service cinder] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:55.058928 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0d487-a803-46b1-88d9-5c3436cd0980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:55.059621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0d487-a803-46b1-88d9-5c3436cd0980 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:55.059909 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0d487-a803-46b1-88d9-5c3436cd0980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:55.060244 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0d487-a803-46b1-88d9-5c3436cd0980 admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:55.060970 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0d487-a803-46b1-88d9-5c3436cd0980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:55.062957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0d487-a803-46b1-88d9-5c3436cd0980 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:55.180997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 945/1868] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:23:54 2022] POST /identity/v3/projects => generated 371 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:23:55.193052 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda5513-6f23-4393-a394-1956bb9776f5 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:55.216346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda5513-6f23-4393-a394-1956bb9776f5 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:55.306969 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:55.356730 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c4465-c40d-4b9a-bc01-cb7cc3a0e2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:55.359899 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c4465-c40d-4b9a-bc01-cb7cc3a0e2cd admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:55.361209 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c4465-c40d-4b9a-bc01-cb7cc3a0e2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:55.361592 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c4465-c40d-4b9a-bc01-cb7cc3a0e2cd admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:55.362353 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c4465-c40d-4b9a-bc01-cb7cc3a0e2cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:55.364391 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c4465-c40d-4b9a-bc01-cb7cc3a0e2cd admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:55.534991 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 924/1869] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:23:55 2022] POST /identity/v3/users => generated 292 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:23:55.539182 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0d487-a803-46b1-88d9-5c3436cd0980 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:55.549930 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0d487-a803-46b1-88d9-5c3436cd0980 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:55.555561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ad9e3-e182-457e-a45e-96fe2c18fb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:55.556283 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ad9e3-e182-457e-a45e-96fe2c18fb57 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:55.556565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ad9e3-e182-457e-a45e-96fe2c18fb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:55.556842 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ad9e3-e182-457e-a45e-96fe2c18fb57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:55.557571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ad9e3-e182-457e-a45e-96fe2c18fb57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:55.559167 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ad9e3-e182-457e-a45e-96fe2c18fb57 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:55.571066 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 946/1870] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:23:55.575516 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c4465-c40d-4b9a-bc01-cb7cc3a0e2cd admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:55.586022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c4465-c40d-4b9a-bc01-cb7cc3a0e2cd admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:55.590653 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f4455-50de-4c8d-96b8-745edc4f854c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:55.591542 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f4455-50de-4c8d-96b8-745edc4f854c admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:55.591826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f4455-50de-4c8d-96b8-745edc4f854c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:55.592138 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f4455-50de-4c8d-96b8-745edc4f854c admin admin] PATH_INFO: `/v3/projects/62869e5cdf0148c39084ac32783e96dc/users/bf30849e9a3b4071b54aec3b692c3f5c/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:55.615548 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f4455-50de-4c8d-96b8-745edc4f854c admin admin] RBAC: Authorizing `identity:create_grant(project_id=62869e5cdf0148c39084ac32783e96dc, user_id=bf30849e9a3b4071b54aec3b692c3f5c, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:55.618312 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f4455-50de-4c8d-96b8-745edc4f854c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:55.708926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 925/1871] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:23:55 2022] PUT /identity/v3/projects/62869e5cdf0148c39084ac32783e96dc/users/bf30849e9a3b4071b54aec3b692c3f5c/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:55.713429 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ad9e3-e182-457e-a45e-96fe2c18fb57 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:55.723767 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ad9e3-e182-457e-a45e-96fe2c18fb57 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:55.804146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297023b-f75d-40ec-b3ca-ffdf4e74213e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:55.804952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297023b-f75d-40ec-b3ca-ffdf4e74213e admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:55.805254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297023b-f75d-40ec-b3ca-ffdf4e74213e admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:55.806039 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297023b-f75d-40ec-b3ca-ffdf4e74213e admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:55.806441 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297023b-f75d-40ec-b3ca-ffdf4e74213e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:55.808078 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297023b-f75d-40ec-b3ca-ffdf4e74213e admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:55.825466 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0aeb7-8395-47b3-8017-fa3242c163fd None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:55.825770 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0aeb7-8395-47b3-8017-fa3242c163fd None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:55.828450 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0aeb7-8395-47b3-8017-fa3242c163fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:55.829630 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 947/1872] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:23:55.830591 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297023b-f75d-40ec-b3ca-ffdf4e74213e admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:55.842076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297023b-f75d-40ec-b3ca-ffdf4e74213e admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:55.847295 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849f55b-d9cd-4d3e-97cc-54538b9e2148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:55.848278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849f55b-d9cd-4d3e-97cc-54538b9e2148 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:55.848561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849f55b-d9cd-4d3e-97cc-54538b9e2148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:55.848840 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849f55b-d9cd-4d3e-97cc-54538b9e2148 admin admin] PATH_INFO: `/v3/projects/62869e5cdf0148c39084ac32783e96dc/users/bf30849e9a3b4071b54aec3b692c3f5c/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:55.851434 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849f55b-d9cd-4d3e-97cc-54538b9e2148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62869e5cdf0148c39084ac32783e96dc, user_id=bf30849e9a3b4071b54aec3b692c3f5c, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:55.854036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849f55b-d9cd-4d3e-97cc-54538b9e2148 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:55.879034 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 948/1873] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:23:55 2022] PUT /identity/v3/projects/62869e5cdf0148c39084ac32783e96dc/users/bf30849e9a3b4071b54aec3b692c3f5c/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:55.879239 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-74c0aeb7-8395-47b3-8017-fa3242c163fd None None] MFA Rules not processed for user `7b9b819e522144dbb780cbc3843f88c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:55.879239 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-74c0aeb7-8395-47b3-8017-fa3242c163fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:55.881083 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0bfd5-a9dd-4daa-912a-962a2f99adec None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:55.882822 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0bfd5-a9dd-4daa-912a-962a2f99adec None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:55.882822 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0bfd5-a9dd-4daa-912a-962a2f99adec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:55.915870 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-abc0bfd5-a9dd-4daa-912a-962a2f99adec None None] MFA Rules not processed for user `bf30849e9a3b4071b54aec3b692c3f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:55.917244 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-abc0bfd5-a9dd-4daa-912a-962a2f99adec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:55.960034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 926/1874] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:23:55.971007 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0aeb7-8395-47b3-8017-fa3242c163fd None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:56.012538 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 949/1875] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:55 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:23:56.034238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0aeb7-8395-47b3-8017-fa3242c163fd None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:56.038173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447fa4b9-462d-4a92-80f8-0e489dbf4c9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:56.039376 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fa4b9-462d-4a92-80f8-0e489dbf4c9c service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:56.039681 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fa4b9-462d-4a92-80f8-0e489dbf4c9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:56.039983 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fa4b9-462d-4a92-80f8-0e489dbf4c9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:56.049523 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447fa4b9-462d-4a92-80f8-0e489dbf4c9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:56.050856 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447fa4b9-462d-4a92-80f8-0e489dbf4c9c service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:56.062123 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 927/1876] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:56.151354 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0bfd5-a9dd-4daa-912a-962a2f99adec None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:56.152959 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-abc0bfd5-a9dd-4daa-912a-962a2f99adec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:56.191863 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0bfd5-a9dd-4daa-912a-962a2f99adec None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:56.191863 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598ce4c-45fe-4c9c-a741-aecdaab15abc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:56.191863 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598ce4c-45fe-4c9c-a741-aecdaab15abc service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:56.191863 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598ce4c-45fe-4c9c-a741-aecdaab15abc service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:56.192339 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598ce4c-45fe-4c9c-a741-aecdaab15abc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:56.192339 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598ce4c-45fe-4c9c-a741-aecdaab15abc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:56.192339 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598ce4c-45fe-4c9c-a741-aecdaab15abc service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:56.200102 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 950/1877] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:56 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:56.251828 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:57.091809 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:57.138413 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447fa4b9-462d-4a92-80f8-0e489dbf4c9c service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:57.148587 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447fa4b9-462d-4a92-80f8-0e489dbf4c9c service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:57.152639 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9f85f-6688-4249-b874-e92ec6c602ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:57.153329 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9f85f-6688-4249-b874-e92ec6c602ca service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:57.153685 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9f85f-6688-4249-b874-e92ec6c602ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:57.153956 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9f85f-6688-4249-b874-e92ec6c602ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:57.156554 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c4b9f85f-6688-4249-b874-e92ec6c602ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:57.221909 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b9f85f-6688-4249-b874-e92ec6c602ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:57.223370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b9f85f-6688-4249-b874-e92ec6c602ca service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:57.233220 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 928/1878] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:58.420608 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598ce4c-45fe-4c9c-a741-aecdaab15abc service cinder] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:58.517061 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598ce4c-45fe-4c9c-a741-aecdaab15abc service cinder] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:58.522877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e685cd-9607-4e43-aeaf-9ff1598c6d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:58.523823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e685cd-9607-4e43-aeaf-9ff1598c6d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:58.524141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e685cd-9607-4e43-aeaf-9ff1598c6d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:58.524422 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e685cd-9607-4e43-aeaf-9ff1598c6d48 admin admin] PATH_INFO: `/v3/users/de064bc337064d39a145b45134755df8` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:58.525763 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e685cd-9607-4e43-aeaf-9ff1598c6d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de064bc337064d39a145b45134755df8)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:58.527782 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e685cd-9607-4e43-aeaf-9ff1598c6d48 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:58.553000 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b413f-6c1e-4a3c-9144-3fb970e9cb04 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:58.553601 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b413f-6c1e-4a3c-9144-3fb970e9cb04 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:58.553721 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b413f-6c1e-4a3c-9144-3fb970e9cb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:58.577803 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-a68b413f-6c1e-4a3c-9144-3fb970e9cb04 None None] MFA Rules not processed for user `7b9b819e522144dbb780cbc3843f88c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:58.579288 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a68b413f-6c1e-4a3c-9144-3fb970e9cb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:58.592829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 929/1879] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:23:58.779182 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-72e685cd-9607-4e43-aeaf-9ff1598c6d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de064bc337064d39a145b45134755df8'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:58.802451 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-72e685cd-9607-4e43-aeaf-9ff1598c6d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de064bc337064d39a145b45134755df8'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:58.813699 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-72e685cd-9607-4e43-aeaf-9ff1598c6d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de064bc337064d39a145b45134755df8'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:58.818932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-72e685cd-9607-4e43-aeaf-9ff1598c6d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de064bc337064d39a145b45134755df8'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:58.820969 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-72e685cd-9607-4e43-aeaf-9ff1598c6d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de064bc337064d39a145b45134755df8'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:58.920249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 951/1880] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:23:58 2022] DELETE /identity/v3/users/de064bc337064d39a145b45134755df8 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:58.927105 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a078d-d8d4-4cb3-ab01-cfbed2d7eceb None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:58.927564 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a078d-d8d4-4cb3-ab01-cfbed2d7eceb None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:58.928007 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a078d-d8d4-4cb3-ab01-cfbed2d7eceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:58.964804 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-811a078d-d8d4-4cb3-ab01-cfbed2d7eceb None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:58.969405 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-811a078d-d8d4-4cb3-ab01-cfbed2d7eceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:59.104243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 930/1881] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:59.128064 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e685cd-9607-4e43-aeaf-9ff1598c6d48 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:59.130955 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-72e685cd-9607-4e43-aeaf-9ff1598c6d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:59.278470 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e685cd-9607-4e43-aeaf-9ff1598c6d48 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:59.286041 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230fdbe-d7b1-4799-9879-12fd29d6e009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:59.287689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230fdbe-d7b1-4799-9879-12fd29d6e009 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:59.289099 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230fdbe-d7b1-4799-9879-12fd29d6e009 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:59.289674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230fdbe-d7b1-4799-9879-12fd29d6e009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:59.318009 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230fdbe-d7b1-4799-9879-12fd29d6e009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:59.322867 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230fdbe-d7b1-4799-9879-12fd29d6e009 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:59.342686 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 952/1882] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:23:59.417787 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:59.709698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:59.978859 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a078d-d8d4-4cb3-ab01-cfbed2d7eceb None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:59.980370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-811a078d-d8d4-4cb3-ab01-cfbed2d7eceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:00.010869 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a078d-d8d4-4cb3-ab01-cfbed2d7eceb None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:00.031738 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb5e37-a8f8-49ff-be93-ee2fb05ad6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:00.032850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb5e37-a8f8-49ff-be93-ee2fb05ad6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:00.033172 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb5e37-a8f8-49ff-be93-ee2fb05ad6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:00.033502 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb5e37-a8f8-49ff-be93-ee2fb05ad6a9 admin admin] PATH_INFO: `/v3/projects/4ad2f081de5c4c1e855e5c6d15475412` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:00.034931 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb5e37-a8f8-49ff-be93-ee2fb05ad6a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ad2f081de5c4c1e855e5c6d15475412)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:00.037247 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb5e37-a8f8-49ff-be93-ee2fb05ad6a9 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:00.180244 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-76cb5e37-a8f8-49ff-be93-ee2fb05ad6a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ad2f081de5c4c1e855e5c6d15475412', 'request_id': 'req-76cb5e37-a8f8-49ff-be93-ee2fb05ad6a9'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:00.187532 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-76cb5e37-a8f8-49ff-be93-ee2fb05ad6a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ad2f081de5c4c1e855e5c6d15475412', 'request_id': 'req-76cb5e37-a8f8-49ff-be93-ee2fb05ad6a9'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:00.268635 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-76cb5e37-a8f8-49ff-be93-ee2fb05ad6a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ad2f081de5c4c1e855e5c6d15475412', 'request_id': 'req-76cb5e37-a8f8-49ff-be93-ee2fb05ad6a9'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:00.291942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-76cb5e37-a8f8-49ff-be93-ee2fb05ad6a9 admin admin] The token cache is being invalidate because project 4ad2f081de5c4c1e855e5c6d15475412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:24:00.292375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-76cb5e37-a8f8-49ff-be93-ee2fb05ad6a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:00.293143 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-76cb5e37-a8f8-49ff-be93-ee2fb05ad6a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:00.299365 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230fdbe-d7b1-4799-9879-12fd29d6e009 service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:00.300624 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 931/1883] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:23:59 2022] DELETE /identity/v3/projects/4ad2f081de5c4c1e855e5c6d15475412 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:00.321643 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230fdbe-d7b1-4799-9879-12fd29d6e009 service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:00.399101 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc57496-6895-46cf-86a2-6e4d595ad365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:00.400712 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc57496-6895-46cf-86a2-6e4d595ad365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:00.401301 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc57496-6895-46cf-86a2-6e4d595ad365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:00.401766 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc57496-6895-46cf-86a2-6e4d595ad365 admin admin] PATH_INFO: `/v3/users/bf30849e9a3b4071b54aec3b692c3f5c` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:00.403688 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc57496-6895-46cf-86a2-6e4d595ad365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf30849e9a3b4071b54aec3b692c3f5c)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:00.405930 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc57496-6895-46cf-86a2-6e4d595ad365 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:00.627885 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-2dc57496-6895-46cf-86a2-6e4d595ad365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf30849e9a3b4071b54aec3b692c3f5c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:00.651850 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-2dc57496-6895-46cf-86a2-6e4d595ad365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf30849e9a3b4071b54aec3b692c3f5c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:00.660986 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-2dc57496-6895-46cf-86a2-6e4d595ad365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf30849e9a3b4071b54aec3b692c3f5c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:00.662501 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-2dc57496-6895-46cf-86a2-6e4d595ad365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf30849e9a3b4071b54aec3b692c3f5c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:00.663325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-2dc57496-6895-46cf-86a2-6e4d595ad365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf30849e9a3b4071b54aec3b692c3f5c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:00.729400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 953/1884] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:24:00 2022] DELETE /identity/v3/users/bf30849e9a3b4071b54aec3b692c3f5c => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:00.937484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:01.361330 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:01.404472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb5e37-a8f8-49ff-be93-ee2fb05ad6a9 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:01.404652 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-76cb5e37-a8f8-49ff-be93-ee2fb05ad6a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:01.419310 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb5e37-a8f8-49ff-be93-ee2fb05ad6a9 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:01.496128 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86860779-9230-4839-856a-8a2a1db4ec48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:01.499293 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86860779-9230-4839-856a-8a2a1db4ec48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:01.499293 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86860779-9230-4839-856a-8a2a1db4ec48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:01.499293 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86860779-9230-4839-856a-8a2a1db4ec48 admin admin] PATH_INFO: `/v3/projects/62869e5cdf0148c39084ac32783e96dc` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:01.499293 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86860779-9230-4839-856a-8a2a1db4ec48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62869e5cdf0148c39084ac32783e96dc)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:01.509677 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86860779-9230-4839-856a-8a2a1db4ec48 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:01.697106 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-86860779-9230-4839-856a-8a2a1db4ec48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62869e5cdf0148c39084ac32783e96dc', 'request_id': 'req-86860779-9230-4839-856a-8a2a1db4ec48'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:01.704650 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-86860779-9230-4839-856a-8a2a1db4ec48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62869e5cdf0148c39084ac32783e96dc', 'request_id': 'req-86860779-9230-4839-856a-8a2a1db4ec48'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:01.880510 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-86860779-9230-4839-856a-8a2a1db4ec48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62869e5cdf0148c39084ac32783e96dc', 'request_id': 'req-86860779-9230-4839-856a-8a2a1db4ec48'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:01.908858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-86860779-9230-4839-856a-8a2a1db4ec48 admin admin] The token cache is being invalidate because project 62869e5cdf0148c39084ac32783e96dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:24:01.910208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-86860779-9230-4839-856a-8a2a1db4ec48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:01.911763 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-86860779-9230-4839-856a-8a2a1db4ec48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:01.917522 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 932/1885] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:24:01 2022] DELETE /identity/v3/projects/62869e5cdf0148c39084ac32783e96dc => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:01.927439 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622158e-585a-4766-841b-3a5012bd0c62 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:01.936988 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622158e-585a-4766-841b-3a5012bd0c62 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:01.936988 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622158e-585a-4766-841b-3a5012bd0c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:01.972494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-d622158e-585a-4766-841b-3a5012bd0c62 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:01.974629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-d622158e-585a-4766-841b-3a5012bd0c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:02.073115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 954/1886] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:02.080742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd09b77-7aaf-438f-be0e-8fbb4d4e5b58 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:02.086566 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd09b77-7aaf-438f-be0e-8fbb4d4e5b58 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:02.086566 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd09b77-7aaf-438f-be0e-8fbb4d4e5b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:02.104612 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-1dd09b77-7aaf-438f-be0e-8fbb4d4e5b58 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:02.105865 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1dd09b77-7aaf-438f-be0e-8fbb4d4e5b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:02.122255 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 933/1887] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:02.126869 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622158e-585a-4766-841b-3a5012bd0c62 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:02.139431 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622158e-585a-4766-841b-3a5012bd0c62 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:02.157569 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993405ad-09d6-405e-b821-da20d83146fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:02.158263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993405ad-09d6-405e-b821-da20d83146fb admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:02.158552 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993405ad-09d6-405e-b821-da20d83146fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:02.158834 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993405ad-09d6-405e-b821-da20d83146fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:02.159579 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993405ad-09d6-405e-b821-da20d83146fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:24:02.159944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993405ad-09d6-405e-b821-da20d83146fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:02.161547 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993405ad-09d6-405e-b821-da20d83146fb admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:02.189801 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:02.190869 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 955/1888] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:24:02.195321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd09b77-7aaf-438f-be0e-8fbb4d4e5b58 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:02.207648 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd09b77-7aaf-438f-be0e-8fbb4d4e5b58 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:02.214590 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e14c74-4d55-41c9-84c5-9afee519672f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:02.215687 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e14c74-4d55-41c9-84c5-9afee519672f admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:02.215976 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e14c74-4d55-41c9-84c5-9afee519672f admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:02.216289 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e14c74-4d55-41c9-84c5-9afee519672f admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:02.217009 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e14c74-4d55-41c9-84c5-9afee519672f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:02.219082 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e14c74-4d55-41c9-84c5-9afee519672f admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:02.363657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 934/1889] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:24:02 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:24:02.368166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993405ad-09d6-405e-b821-da20d83146fb admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:02.378768 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993405ad-09d6-405e-b821-da20d83146fb admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:02.474207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017c7d2-d046-4ec3-a1ab-3d582f6f86d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:02.475234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017c7d2-d046-4ec3-a1ab-3d582f6f86d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:02.475526 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017c7d2-d046-4ec3-a1ab-3d582f6f86d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:02.475860 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017c7d2-d046-4ec3-a1ab-3d582f6f86d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:02.477145 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017c7d2-d046-4ec3-a1ab-3d582f6f86d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:02.479591 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017c7d2-d046-4ec3-a1ab-3d582f6f86d9 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:02.618615 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 956/1890] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:24:02 2022] POST /identity/v3/users => generated 294 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:24:02.619953 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e14c74-4d55-41c9-84c5-9afee519672f admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:02.631898 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e14c74-4d55-41c9-84c5-9afee519672f admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:02.645179 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc555f-26f8-491e-87ce-47f61812be3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:02.645867 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc555f-26f8-491e-87ce-47f61812be3c admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:02.646153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc555f-26f8-491e-87ce-47f61812be3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:02.646432 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc555f-26f8-491e-87ce-47f61812be3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:02.647168 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc555f-26f8-491e-87ce-47f61812be3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:02.649474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc555f-26f8-491e-87ce-47f61812be3c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:02.686839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 935/1891] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:24:02.687953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017c7d2-d046-4ec3-a1ab-3d582f6f86d9 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:02.709145 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017c7d2-d046-4ec3-a1ab-3d582f6f86d9 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:02.725018 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acefedf-ec39-480b-a5b2-4e6cb0c5e703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:02.726370 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acefedf-ec39-480b-a5b2-4e6cb0c5e703 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:02.726584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acefedf-ec39-480b-a5b2-4e6cb0c5e703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:02.726868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acefedf-ec39-480b-a5b2-4e6cb0c5e703 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:02.727669 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acefedf-ec39-480b-a5b2-4e6cb0c5e703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:02.729924 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acefedf-ec39-480b-a5b2-4e6cb0c5e703 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:02.782208 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 957/1892] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:24:02.784224 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc555f-26f8-491e-87ce-47f61812be3c admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:02.807252 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc555f-26f8-491e-87ce-47f61812be3c admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:02.817098 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e93fb-b371-4a25-aea1-56c8dce10e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:02.818409 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e93fb-b371-4a25-aea1-56c8dce10e9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:02.820515 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e93fb-b371-4a25-aea1-56c8dce10e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:02.821649 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e93fb-b371-4a25-aea1-56c8dce10e9d admin admin] PATH_INFO: `/v3/projects/da075a1372d94603a02896a474f7e0ab/users/afc43e82e5b24fc6b0986d79920f6571/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:02.851105 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e93fb-b371-4a25-aea1-56c8dce10e9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=da075a1372d94603a02896a474f7e0ab, user_id=afc43e82e5b24fc6b0986d79920f6571, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:02.854321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e93fb-b371-4a25-aea1-56c8dce10e9d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:02.943899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:02.978534 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 936/1893] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:24:02 2022] PUT /identity/v3/projects/da075a1372d94603a02896a474f7e0ab/users/afc43e82e5b24fc6b0986d79920f6571/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:24:03.001936 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0097cb-5cc8-4e59-94fd-8296264ed365 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:03.002231 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0097cb-5cc8-4e59-94fd-8296264ed365 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:03.002548 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0097cb-5cc8-4e59-94fd-8296264ed365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:03.045075 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-5f0097cb-5cc8-4e59-94fd-8296264ed365 None None] MFA Rules not processed for user `afc43e82e5b24fc6b0986d79920f6571`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:03.046482 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5f0097cb-5cc8-4e59-94fd-8296264ed365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:03.161754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 958/1894] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:03.168127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e93fb-b371-4a25-aea1-56c8dce10e9d admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:03.180124 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:03.251311 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e93fb-b371-4a25-aea1-56c8dce10e9d admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:03.262319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cacc9-089e-4b4e-a7bc-d9d980f5b2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:03.263913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cacc9-089e-4b4e-a7bc-d9d980f5b2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:03.264294 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cacc9-089e-4b4e-a7bc-d9d980f5b2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:03.264660 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cacc9-089e-4b4e-a7bc-d9d980f5b2b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:03.265565 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cacc9-089e-4b4e-a7bc-d9d980f5b2b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:03.268788 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cacc9-089e-4b4e-a7bc-d9d980f5b2b4 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:03.410650 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 937/1895] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:24:03 2022] POST /identity/v3/projects => generated 385 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:24:03.412384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0097cb-5cc8-4e59-94fd-8296264ed365 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:03.425661 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0097cb-5cc8-4e59-94fd-8296264ed365 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:03.495015 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12477ecb-620f-4a40-88d2-b1fd372317b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:03.495841 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12477ecb-620f-4a40-88d2-b1fd372317b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:03.496315 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12477ecb-620f-4a40-88d2-b1fd372317b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:03.496719 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12477ecb-620f-4a40-88d2-b1fd372317b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:03.497570 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12477ecb-620f-4a40-88d2-b1fd372317b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:03.499720 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12477ecb-620f-4a40-88d2-b1fd372317b4 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:03.604308 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 959/1896] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:24:03 2022] POST /identity/v3/users => generated 299 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:24:03.609588 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cacc9-089e-4b4e-a7bc-d9d980f5b2b4 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:03.622983 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cacc9-089e-4b4e-a7bc-d9d980f5b2b4 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:03.628951 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49721aea-a511-4253-b0a9-80425a6949c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:03.629793 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49721aea-a511-4253-b0a9-80425a6949c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:03.630204 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49721aea-a511-4253-b0a9-80425a6949c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:03.630561 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49721aea-a511-4253-b0a9-80425a6949c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:03.631420 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49721aea-a511-4253-b0a9-80425a6949c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:03.633644 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49721aea-a511-4253-b0a9-80425a6949c1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:03.651275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 938/1897] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:24:03.651894 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12477ecb-620f-4a40-88d2-b1fd372317b4 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:03.665142 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12477ecb-620f-4a40-88d2-b1fd372317b4 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:03.671151 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4479d-4433-49f9-a67e-2ba97a5d5816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:03.672850 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4479d-4433-49f9-a67e-2ba97a5d5816 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:03.673318 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4479d-4433-49f9-a67e-2ba97a5d5816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:03.673885 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4479d-4433-49f9-a67e-2ba97a5d5816 admin admin] PATH_INFO: `/v3/projects/9d62ffb68c024401946b1c58bc7c6e64/users/e8ada4a44c9e406594b0655eab9e637f/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:03.698486 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4479d-4433-49f9-a67e-2ba97a5d5816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d62ffb68c024401946b1c58bc7c6e64, user_id=e8ada4a44c9e406594b0655eab9e637f, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:03.701421 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4479d-4433-49f9-a67e-2ba97a5d5816 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:03.812480 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49721aea-a511-4253-b0a9-80425a6949c1 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:03.815437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 960/1898] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:24:03 2022] PUT /identity/v3/projects/9d62ffb68c024401946b1c58bc7c6e64/users/e8ada4a44c9e406594b0655eab9e637f/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:24:03.845743 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49721aea-a511-4253-b0a9-80425a6949c1 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:04.016491 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20460c76-5945-4ae8-b910-6ff9ff3a7379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:04.017739 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20460c76-5945-4ae8-b910-6ff9ff3a7379 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:04.018203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20460c76-5945-4ae8-b910-6ff9ff3a7379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:04.018659 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20460c76-5945-4ae8-b910-6ff9ff3a7379 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:04.019612 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20460c76-5945-4ae8-b910-6ff9ff3a7379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:04.021517 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20460c76-5945-4ae8-b910-6ff9ff3a7379 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:04.037595 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4479d-4433-49f9-a67e-2ba97a5d5816 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:04.044040 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 939/1899] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:24:04.055811 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4479d-4433-49f9-a67e-2ba97a5d5816 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:04.062522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e895a-b54c-47ac-af74-b7422df2c500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:04.065624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e895a-b54c-47ac-af74-b7422df2c500 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:04.066701 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e895a-b54c-47ac-af74-b7422df2c500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:04.086400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e895a-b54c-47ac-af74-b7422df2c500 admin admin] PATH_INFO: `/v3/projects/9d62ffb68c024401946b1c58bc7c6e64/users/e8ada4a44c9e406594b0655eab9e637f/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:04.086400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e895a-b54c-47ac-af74-b7422df2c500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d62ffb68c024401946b1c58bc7c6e64, user_id=e8ada4a44c9e406594b0655eab9e637f, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:04.089311 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e895a-b54c-47ac-af74-b7422df2c500 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:04.121045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 961/1900] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:24:04 2022] PUT /identity/v3/projects/9d62ffb68c024401946b1c58bc7c6e64/users/e8ada4a44c9e406594b0655eab9e637f/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:04.123148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee3a32-c39d-4cfe-b240-7a1d48e4b161 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:04.127867 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee3a32-c39d-4cfe-b240-7a1d48e4b161 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:04.127867 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee3a32-c39d-4cfe-b240-7a1d48e4b161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:04.163447 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-e4ee3a32-c39d-4cfe-b240-7a1d48e4b161 None None] MFA Rules not processed for user `e8ada4a44c9e406594b0655eab9e637f`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:04.164724 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e4ee3a32-c39d-4cfe-b240-7a1d48e4b161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:04.235823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:04.273708 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 940/1901] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:04.278920 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e895a-b54c-47ac-af74-b7422df2c500 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:04.289707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-305e895a-b54c-47ac-af74-b7422df2c500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:04.297204 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee3a32-c39d-4cfe-b240-7a1d48e4b161 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:04.299077 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e4ee3a32-c39d-4cfe-b240-7a1d48e4b161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:04.367911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e895a-b54c-47ac-af74-b7422df2c500 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:04.393145 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070df4a0-5349-48ac-be1f-8b5239ddb314 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:04.398370 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070df4a0-5349-48ac-be1f-8b5239ddb314 service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:04.398822 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070df4a0-5349-48ac-be1f-8b5239ddb314 service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:04.399597 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070df4a0-5349-48ac-be1f-8b5239ddb314 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:04.401674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee3a32-c39d-4cfe-b240-7a1d48e4b161 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:04.406519 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bbaa7-dd3d-4504-b438-3769e92de94b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:04.407245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bbaa7-dd3d-4504-b438-3769e92de94b service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:04.407534 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bbaa7-dd3d-4504-b438-3769e92de94b service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:04.407857 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bbaa7-dd3d-4504-b438-3769e92de94b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:04.411182 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-070df4a0-5349-48ac-be1f-8b5239ddb314 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:04.421169 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93bbaa7-dd3d-4504-b438-3769e92de94b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:04.423528 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93bbaa7-dd3d-4504-b438-3769e92de94b service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:04.438654 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 941/1902] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:24:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:24:04.445451 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:04.515443 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070df4a0-5349-48ac-be1f-8b5239ddb314 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:04.516723 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070df4a0-5349-48ac-be1f-8b5239ddb314 service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:04.549570 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 962/1903] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:24:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:24:05.034184 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:05.320304 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:05.670464 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:05.960565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:06.188339 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bbaa7-dd3d-4504-b438-3769e92de94b service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:06.329933 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bbaa7-dd3d-4504-b438-3769e92de94b service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:06.336311 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c43fbe-f7a2-45d2-b173-7f27a2559eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:06.337634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c43fbe-f7a2-45d2-b173-7f27a2559eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:06.338094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c43fbe-f7a2-45d2-b173-7f27a2559eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:06.338516 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c43fbe-f7a2-45d2-b173-7f27a2559eb5 admin admin] PATH_INFO: `/v3/users/afc43e82e5b24fc6b0986d79920f6571` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:06.340698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c43fbe-f7a2-45d2-b173-7f27a2559eb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afc43e82e5b24fc6b0986d79920f6571)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:06.343491 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c43fbe-f7a2-45d2-b173-7f27a2559eb5 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:06.595430 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c1c43fbe-f7a2-45d2-b173-7f27a2559eb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afc43e82e5b24fc6b0986d79920f6571'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:06.612589 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c1c43fbe-f7a2-45d2-b173-7f27a2559eb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afc43e82e5b24fc6b0986d79920f6571'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:06.613477 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c1c43fbe-f7a2-45d2-b173-7f27a2559eb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afc43e82e5b24fc6b0986d79920f6571'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:06.613994 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c1c43fbe-f7a2-45d2-b173-7f27a2559eb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afc43e82e5b24fc6b0986d79920f6571'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:06.634508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c1c43fbe-f7a2-45d2-b173-7f27a2559eb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afc43e82e5b24fc6b0986d79920f6571'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:06.706909 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:06.712754 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 942/1904] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:24:06 2022] DELETE /identity/v3/users/afc43e82e5b24fc6b0986d79920f6571 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:06.717109 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f7a62-1f9f-4f77-b8b6-2a712ab7632d None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:06.717526 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f7a62-1f9f-4f77-b8b6-2a712ab7632d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:06.717905 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f7a62-1f9f-4f77-b8b6-2a712ab7632d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:06.742870 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-d37f7a62-1f9f-4f77-b8b6-2a712ab7632d None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:06.744627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-d37f7a62-1f9f-4f77-b8b6-2a712ab7632d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:06.838982 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 963/1905] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:06.861414 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c43fbe-f7a2-45d2-b173-7f27a2559eb5 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:06.863331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c1c43fbe-f7a2-45d2-b173-7f27a2559eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:06.967851 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c43fbe-f7a2-45d2-b173-7f27a2559eb5 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:06.972305 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627224d9-da75-4d66-9354-473e08d6ba26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:06.976360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627224d9-da75-4d66-9354-473e08d6ba26 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:06.976360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627224d9-da75-4d66-9354-473e08d6ba26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:06.976360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627224d9-da75-4d66-9354-473e08d6ba26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:06.985956 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627224d9-da75-4d66-9354-473e08d6ba26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:06.988187 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627224d9-da75-4d66-9354-473e08d6ba26 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:07.002386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 943/1906] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:24:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:24:07.731418 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:08.171296 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:08.375147 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f7a62-1f9f-4f77-b8b6-2a712ab7632d None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:08.378254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-d37f7a62-1f9f-4f77-b8b6-2a712ab7632d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:08.411481 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f7a62-1f9f-4f77-b8b6-2a712ab7632d None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:08.428646 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55333c-f07a-41cc-a0d1-f0ef6ee88481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:08.430321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55333c-f07a-41cc-a0d1-f0ef6ee88481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:08.430667 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55333c-f07a-41cc-a0d1-f0ef6ee88481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:08.431367 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55333c-f07a-41cc-a0d1-f0ef6ee88481 admin admin] PATH_INFO: `/v3/projects/da075a1372d94603a02896a474f7e0ab` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:08.434101 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55333c-f07a-41cc-a0d1-f0ef6ee88481 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da075a1372d94603a02896a474f7e0ab)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:08.438259 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55333c-f07a-41cc-a0d1-f0ef6ee88481 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:08.580394 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-bb55333c-f07a-41cc-a0d1-f0ef6ee88481 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da075a1372d94603a02896a474f7e0ab', 'request_id': 'req-bb55333c-f07a-41cc-a0d1-f0ef6ee88481'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:08.714116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-bb55333c-f07a-41cc-a0d1-f0ef6ee88481 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da075a1372d94603a02896a474f7e0ab', 'request_id': 'req-bb55333c-f07a-41cc-a0d1-f0ef6ee88481'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:08.722431 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-bb55333c-f07a-41cc-a0d1-f0ef6ee88481 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da075a1372d94603a02896a474f7e0ab', 'request_id': 'req-bb55333c-f07a-41cc-a0d1-f0ef6ee88481'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:08.738469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-bb55333c-f07a-41cc-a0d1-f0ef6ee88481 admin admin] The token cache is being invalidate because project da075a1372d94603a02896a474f7e0ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:24:08.739104 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-bb55333c-f07a-41cc-a0d1-f0ef6ee88481 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:08.739670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-bb55333c-f07a-41cc-a0d1-f0ef6ee88481 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:08.741742 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 964/1907] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:24:08 2022] DELETE /identity/v3/projects/da075a1372d94603a02896a474f7e0ab => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:08.746083 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627224d9-da75-4d66-9354-473e08d6ba26 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:08.756069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627224d9-da75-4d66-9354-473e08d6ba26 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:08.864908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee1348-1dbb-4b97-9660-8534f321d587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:08.866360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee1348-1dbb-4b97-9660-8534f321d587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:08.866879 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee1348-1dbb-4b97-9660-8534f321d587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:08.867072 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee1348-1dbb-4b97-9660-8534f321d587 admin admin] PATH_INFO: `/v3/users/e8ada4a44c9e406594b0655eab9e637f` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:08.869863 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee1348-1dbb-4b97-9660-8534f321d587 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8ada4a44c9e406594b0655eab9e637f)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:08.872959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee1348-1dbb-4b97-9660-8534f321d587 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:09.099082 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3fee1348-1dbb-4b97-9660-8534f321d587 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8ada4a44c9e406594b0655eab9e637f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:09.106598 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3fee1348-1dbb-4b97-9660-8534f321d587 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8ada4a44c9e406594b0655eab9e637f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:09.107552 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3fee1348-1dbb-4b97-9660-8534f321d587 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8ada4a44c9e406594b0655eab9e637f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:09.108334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3fee1348-1dbb-4b97-9660-8534f321d587 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8ada4a44c9e406594b0655eab9e637f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:09.144210 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3fee1348-1dbb-4b97-9660-8534f321d587 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8ada4a44c9e406594b0655eab9e637f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:09.265850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 944/1908] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:24:08 2022] DELETE /identity/v3/users/e8ada4a44c9e406594b0655eab9e637f => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:24:09.343113 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:09.435175 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:09.561139 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55333c-f07a-41cc-a0d1-f0ef6ee88481 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:09.567318 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-bb55333c-f07a-41cc-a0d1-f0ef6ee88481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:09.583257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55333c-f07a-41cc-a0d1-f0ef6ee88481 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:09.671034 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5978b9-1bdf-4710-91a5-86b06e62509a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:09.674442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5978b9-1bdf-4710-91a5-86b06e62509a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:09.674994 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5978b9-1bdf-4710-91a5-86b06e62509a admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:09.675392 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5978b9-1bdf-4710-91a5-86b06e62509a admin admin] PATH_INFO: `/v3/users/710293d8def64dd3a15137210e1c825c` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:09.686633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5978b9-1bdf-4710-91a5-86b06e62509a admin admin] RBAC: Authorizing `identity:delete_user(user_id=710293d8def64dd3a15137210e1c825c)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:09.688745 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5978b9-1bdf-4710-91a5-86b06e62509a admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:09.882149 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cb5978b9-1bdf-4710-91a5-86b06e62509a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '710293d8def64dd3a15137210e1c825c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:09.909197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cb5978b9-1bdf-4710-91a5-86b06e62509a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '710293d8def64dd3a15137210e1c825c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:09.937230 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cb5978b9-1bdf-4710-91a5-86b06e62509a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '710293d8def64dd3a15137210e1c825c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:09.938083 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cb5978b9-1bdf-4710-91a5-86b06e62509a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '710293d8def64dd3a15137210e1c825c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:09.939001 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cb5978b9-1bdf-4710-91a5-86b06e62509a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '710293d8def64dd3a15137210e1c825c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:10.047894 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 965/1909] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:24:09 2022] DELETE /identity/v3/users/710293d8def64dd3a15137210e1c825c => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:24:10.055195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399b42f-830a-44e8-9ed3-f485be568d86 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:10.055713 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399b42f-830a-44e8-9ed3-f485be568d86 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:10.056809 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399b42f-830a-44e8-9ed3-f485be568d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:10.093560 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-c399b42f-830a-44e8-9ed3-f485be568d86 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:10.094966 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c399b42f-830a-44e8-9ed3-f485be568d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:10.232733 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 945/1910] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:10.247615 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5978b9-1bdf-4710-91a5-86b06e62509a admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:10.249242 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-cb5978b9-1bdf-4710-91a5-86b06e62509a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:10.303728 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399b42f-830a-44e8-9ed3-f485be568d86 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:10.305681 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c399b42f-830a-44e8-9ed3-f485be568d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:10.324106 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399b42f-830a-44e8-9ed3-f485be568d86 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:10.328523 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5978b9-1bdf-4710-91a5-86b06e62509a admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:10.331623 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4e91a-2940-4fcd-b60c-6435806faf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:10.332645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4e91a-2940-4fcd-b60c-6435806faf74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:10.333023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4e91a-2940-4fcd-b60c-6435806faf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:10.333394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4e91a-2940-4fcd-b60c-6435806faf74 admin admin] PATH_INFO: `/v3/projects/9d62ffb68c024401946b1c58bc7c6e64` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:10.333945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef63d4-eb72-44ad-86cc-32c14da63724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:10.335838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef63d4-eb72-44ad-86cc-32c14da63724 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:10.336833 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4e91a-2940-4fcd-b60c-6435806faf74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d62ffb68c024401946b1c58bc7c6e64)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:10.337334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef63d4-eb72-44ad-86cc-32c14da63724 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:10.338678 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef63d4-eb72-44ad-86cc-32c14da63724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:10.349777 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4e91a-2940-4fcd-b60c-6435806faf74 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:10.352465 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef63d4-eb72-44ad-86cc-32c14da63724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:10.354243 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef63d4-eb72-44ad-86cc-32c14da63724 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:10.365389 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 966/1911] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:24:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:24:10.455445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef63d4-eb72-44ad-86cc-32c14da63724 service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:10.458379 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-1eef63d4-eb72-44ad-86cc-32c14da63724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:10.480919 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef63d4-eb72-44ad-86cc-32c14da63724 service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:10.488732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-54c4e91a-2940-4fcd-b60c-6435806faf74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d62ffb68c024401946b1c58bc7c6e64', 'request_id': 'req-54c4e91a-2940-4fcd-b60c-6435806faf74'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:10.495966 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-54c4e91a-2940-4fcd-b60c-6435806faf74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d62ffb68c024401946b1c58bc7c6e64', 'request_id': 'req-54c4e91a-2940-4fcd-b60c-6435806faf74'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:10.527383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:10.547067 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3cd14-7024-42b8-9cd3-d5dd65585830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:10.547956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3cd14-7024-42b8-9cd3-d5dd65585830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:10.548278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3cd14-7024-42b8-9cd3-d5dd65585830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:10.548554 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3cd14-7024-42b8-9cd3-d5dd65585830 admin admin] PATH_INFO: `/v3/users/f5c4899799c445e0bd331745d0ba1380` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:10.549812 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3cd14-7024-42b8-9cd3-d5dd65585830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5c4899799c445e0bd331745d0ba1380)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:10.551743 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3cd14-7024-42b8-9cd3-d5dd65585830 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:10.571799 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-54c4e91a-2940-4fcd-b60c-6435806faf74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d62ffb68c024401946b1c58bc7c6e64', 'request_id': 'req-54c4e91a-2940-4fcd-b60c-6435806faf74'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:10.587275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-54c4e91a-2940-4fcd-b60c-6435806faf74 admin admin] The token cache is being invalidate because project 9d62ffb68c024401946b1c58bc7c6e64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:24:10.587673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-54c4e91a-2940-4fcd-b60c-6435806faf74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:10.588481 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-54c4e91a-2940-4fcd-b60c-6435806faf74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:10.592109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 946/1912] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:24:10 2022] DELETE /identity/v3/projects/9d62ffb68c024401946b1c58bc7c6e64 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:24:10.597894 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b6b67-9b7b-4bb5-983f-44590aa9f335 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:10.598317 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b6b67-9b7b-4bb5-983f-44590aa9f335 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:10.598694 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b6b67-9b7b-4bb5-983f-44590aa9f335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:10.636239 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-0c7b6b67-9b7b-4bb5-983f-44590aa9f335 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:10.640400 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0c7b6b67-9b7b-4bb5-983f-44590aa9f335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:10.655116 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 947/1913] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:24:10.663231 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5d857-1487-4aa0-ba42-0fffadcba643 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:10.663514 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5d857-1487-4aa0-ba42-0fffadcba643 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:10.663785 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5d857-1487-4aa0-ba42-0fffadcba643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:10.684550 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-62f5d857-1487-4aa0-ba42-0fffadcba643 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:10.685775 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-62f5d857-1487-4aa0-ba42-0fffadcba643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:10.696297 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 948/1914] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:24:10.700720 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5d857-1487-4aa0-ba42-0fffadcba643 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:10.704153 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4bc3cd14-7024-42b8-9cd3-d5dd65585830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5c4899799c445e0bd331745d0ba1380'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:10.711168 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5d857-1487-4aa0-ba42-0fffadcba643 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:10.720484 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4bc3cd14-7024-42b8-9cd3-d5dd65585830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5c4899799c445e0bd331745d0ba1380'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:10.726337 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43b818-f5d6-4664-a9a2-facfbdb752a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:10.727035 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43b818-f5d6-4664-a9a2-facfbdb752a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:10.727323 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43b818-f5d6-4664-a9a2-facfbdb752a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:10.727608 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43b818-f5d6-4664-a9a2-facfbdb752a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:10.728682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43b818-f5d6-4664-a9a2-facfbdb752a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:24:10.728682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43b818-f5d6-4664-a9a2-facfbdb752a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:10.729344 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4bc3cd14-7024-42b8-9cd3-d5dd65585830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5c4899799c445e0bd331745d0ba1380'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:10.730101 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4bc3cd14-7024-42b8-9cd3-d5dd65585830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5c4899799c445e0bd331745d0ba1380'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:10.730416 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43b818-f5d6-4664-a9a2-facfbdb752a8 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:10.730840 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4bc3cd14-7024-42b8-9cd3-d5dd65585830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5c4899799c445e0bd331745d0ba1380'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:10.744912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 949/1915] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:24:10.751635 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43b818-f5d6-4664-a9a2-facfbdb752a8 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:10.758215 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0c43b818-f5d6-4664-a9a2-facfbdb752a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:10.771144 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43b818-f5d6-4664-a9a2-facfbdb752a8 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:10.775792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb000b-aea7-48fa-b1a5-47280994c766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:10.776475 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb000b-aea7-48fa-b1a5-47280994c766 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:10.776767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb000b-aea7-48fa-b1a5-47280994c766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:10.777027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb000b-aea7-48fa-b1a5-47280994c766 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:10.777706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb000b-aea7-48fa-b1a5-47280994c766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:10.779622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb000b-aea7-48fa-b1a5-47280994c766 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:10.811211 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 967/1916] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:24:10 2022] DELETE /identity/v3/users/f5c4899799c445e0bd331745d0ba1380 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:10.836056 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3cd14-7024-42b8-9cd3-d5dd65585830 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:10.837676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-4bc3cd14-7024-42b8-9cd3-d5dd65585830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:10.882837 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 950/1917] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:24:10 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:24:10.886562 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb000b-aea7-48fa-b1a5-47280994c766 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:10.927602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3cd14-7024-42b8-9cd3-d5dd65585830 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:10.959498 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb000b-aea7-48fa-b1a5-47280994c766 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:10.965393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc4928-5636-474c-9217-af96878f9841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:10.966253 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc4928-5636-474c-9217-af96878f9841 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:10.966609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc4928-5636-474c-9217-af96878f9841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:10.966894 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc4928-5636-474c-9217-af96878f9841 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:10.967601 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc4928-5636-474c-9217-af96878f9841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:10.970104 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc4928-5636-474c-9217-af96878f9841 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:11.006982 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f174d1-9642-4d34-939d-bbe204920644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:11.007871 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f174d1-9642-4d34-939d-bbe204920644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:11.008213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f174d1-9642-4d34-939d-bbe204920644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:11.008496 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f174d1-9642-4d34-939d-bbe204920644 admin admin] PATH_INFO: `/v3/projects/cc9f34d3e9df49059b0f5a74fbda8714` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:11.009752 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f174d1-9642-4d34-939d-bbe204920644 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc9f34d3e9df49059b0f5a74fbda8714)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:11.011730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f174d1-9642-4d34-939d-bbe204920644 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:11.085704 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 951/1918] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:24:10 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:24:11.086771 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc4928-5636-474c-9217-af96878f9841 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:11.096800 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc4928-5636-474c-9217-af96878f9841 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:11.102275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd5b5f-b8f9-4e93-87df-c4833c062ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:11.102946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd5b5f-b8f9-4e93-87df-c4833c062ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:11.103226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd5b5f-b8f9-4e93-87df-c4833c062ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:11.103503 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd5b5f-b8f9-4e93-87df-c4833c062ed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:11.104277 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd5b5f-b8f9-4e93-87df-c4833c062ed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:11.105876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd5b5f-b8f9-4e93-87df-c4833c062ed8 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:11.120211 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 952/1919] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:24:11.121133 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd5b5f-b8f9-4e93-87df-c4833c062ed8 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:11.124193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-31fd5b5f-b8f9-4e93-87df-c4833c062ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:11.134222 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-17f174d1-9642-4d34-939d-bbe204920644 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc9f34d3e9df49059b0f5a74fbda8714', 'request_id': 'req-17f174d1-9642-4d34-939d-bbe204920644'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:11.143624 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd5b5f-b8f9-4e93-87df-c4833c062ed8 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:11.199437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-17f174d1-9642-4d34-939d-bbe204920644 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc9f34d3e9df49059b0f5a74fbda8714', 'request_id': 'req-17f174d1-9642-4d34-939d-bbe204920644'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:11.205966 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-17f174d1-9642-4d34-939d-bbe204920644 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc9f34d3e9df49059b0f5a74fbda8714', 'request_id': 'req-17f174d1-9642-4d34-939d-bbe204920644'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:11.209458 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811f86f-7134-4452-8662-774b4f779c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:11.210812 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811f86f-7134-4452-8662-774b4f779c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:11.211270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811f86f-7134-4452-8662-774b4f779c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:11.211566 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811f86f-7134-4452-8662-774b4f779c00 admin admin] PATH_INFO: `/v3/projects/f1a9171b2b994b06b502b6aff31354e4` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:11.212771 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811f86f-7134-4452-8662-774b4f779c00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1a9171b2b994b06b502b6aff31354e4)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:11.214748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811f86f-7134-4452-8662-774b4f779c00 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:11.219084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-17f174d1-9642-4d34-939d-bbe204920644 admin admin] The token cache is being invalidate because project cc9f34d3e9df49059b0f5a74fbda8714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:24:11.219369 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-17f174d1-9642-4d34-939d-bbe204920644 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:11.220175 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-17f174d1-9642-4d34-939d-bbe204920644 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:11.221866 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 968/1920] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:24:10 2022] DELETE /identity/v3/projects/cc9f34d3e9df49059b0f5a74fbda8714 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:24:11.222638 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f174d1-9642-4d34-939d-bbe204920644 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:11.224114 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-17f174d1-9642-4d34-939d-bbe204920644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:11.236952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f174d1-9642-4d34-939d-bbe204920644 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:11.241742 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751943f-d40a-4995-960d-07acbfb75462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:11.242406 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751943f-d40a-4995-960d-07acbfb75462 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:11.242687 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751943f-d40a-4995-960d-07acbfb75462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:11.242963 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751943f-d40a-4995-960d-07acbfb75462 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:11.243722 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751943f-d40a-4995-960d-07acbfb75462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:11.245162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:11.245364 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751943f-d40a-4995-960d-07acbfb75462 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:11.259687 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 969/1921] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:24:11.259687 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751943f-d40a-4995-960d-07acbfb75462 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:11.259687 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-e751943f-d40a-4995-960d-07acbfb75462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:11.271284 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751943f-d40a-4995-960d-07acbfb75462 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:11.276731 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c586b-7f0d-4217-a0d3-394dab8f6dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:11.277612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c586b-7f0d-4217-a0d3-394dab8f6dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:11.277907 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c586b-7f0d-4217-a0d3-394dab8f6dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:11.282237 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c586b-7f0d-4217-a0d3-394dab8f6dad admin admin] PATH_INFO: `/v3/users/5e2fa74edc5d4f428d3f5e4966fbe6cf` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:11.282237 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c586b-7f0d-4217-a0d3-394dab8f6dad admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e2fa74edc5d4f428d3f5e4966fbe6cf)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:11.282237 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c586b-7f0d-4217-a0d3-394dab8f6dad admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:11.343200 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3811f86f-7134-4452-8662-774b4f779c00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1a9171b2b994b06b502b6aff31354e4', 'request_id': 'req-3811f86f-7134-4452-8662-774b4f779c00'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:11.349432 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3811f86f-7134-4452-8662-774b4f779c00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1a9171b2b994b06b502b6aff31354e4', 'request_id': 'req-3811f86f-7134-4452-8662-774b4f779c00'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:11.410996 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3811f86f-7134-4452-8662-774b4f779c00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1a9171b2b994b06b502b6aff31354e4', 'request_id': 'req-3811f86f-7134-4452-8662-774b4f779c00'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:11.423077 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3811f86f-7134-4452-8662-774b4f779c00 admin admin] The token cache is being invalidate because project f1a9171b2b994b06b502b6aff31354e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:24:11.423360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3811f86f-7134-4452-8662-774b4f779c00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:11.424019 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3811f86f-7134-4452-8662-774b4f779c00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:11.425814 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 953/1922] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:24:11 2022] DELETE /identity/v3/projects/f1a9171b2b994b06b502b6aff31354e4 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:11.426343 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811f86f-7134-4452-8662-774b4f779c00 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:11.427608 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3811f86f-7134-4452-8662-774b4f779c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:11.490604 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811f86f-7134-4452-8662-774b4f779c00 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:11.495440 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde8765-2189-4d30-b005-5ead8e47b9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:11.496390 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde8765-2189-4d30-b005-5ead8e47b9b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:11.496672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde8765-2189-4d30-b005-5ead8e47b9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:11.496952 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde8765-2189-4d30-b005-5ead8e47b9b7 admin admin] PATH_INFO: `/v3/projects/2c1a924ab4244d76a7acb426b3501bf1/users/5c4d1ee372cf48ceb90fc3c83fc9e9a1/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:11.505900 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-850c586b-7f0d-4217-a0d3-394dab8f6dad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e2fa74edc5d4f428d3f5e4966fbe6cf'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:11.512820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde8765-2189-4d30-b005-5ead8e47b9b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c1a924ab4244d76a7acb426b3501bf1, user_id=5c4d1ee372cf48ceb90fc3c83fc9e9a1, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:11.515479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde8765-2189-4d30-b005-5ead8e47b9b7 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:11.529845 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-850c586b-7f0d-4217-a0d3-394dab8f6dad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e2fa74edc5d4f428d3f5e4966fbe6cf'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:11.536972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-850c586b-7f0d-4217-a0d3-394dab8f6dad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e2fa74edc5d4f428d3f5e4966fbe6cf'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:11.537622 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-850c586b-7f0d-4217-a0d3-394dab8f6dad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e2fa74edc5d4f428d3f5e4966fbe6cf'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:11.538857 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-850c586b-7f0d-4217-a0d3-394dab8f6dad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e2fa74edc5d4f428d3f5e4966fbe6cf'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:11.611852 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 954/1923] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:24:11 2022] PUT /identity/v3/projects/2c1a924ab4244d76a7acb426b3501bf1/users/5c4d1ee372cf48ceb90fc3c83fc9e9a1/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:11.614251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89d1c3-8069-4ef7-bb27-e2dbde4a85be None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:11.614809 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89d1c3-8069-4ef7-bb27-e2dbde4a85be None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:11.615308 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89d1c3-8069-4ef7-bb27-e2dbde4a85be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:11.638159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-2c89d1c3-8069-4ef7-bb27-e2dbde4a85be None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:11.639339 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2c89d1c3-8069-4ef7-bb27-e2dbde4a85be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:11.647357 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:11.659605 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 970/1924] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:24:11 2022] DELETE /identity/v3/users/5e2fa74edc5d4f428d3f5e4966fbe6cf => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:11.661444 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33ff77-95ca-439b-87a0-94c3d1f34536 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:11.661444 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33ff77-95ca-439b-87a0-94c3d1f34536 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:11.661654 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33ff77-95ca-439b-87a0-94c3d1f34536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:11.698733 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-ea33ff77-95ca-439b-87a0-94c3d1f34536 None None] MFA Rules not processed for user `5c4d1ee372cf48ceb90fc3c83fc9e9a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:11.700789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-ea33ff77-95ca-439b-87a0-94c3d1f34536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:11.728763 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 955/1925] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:11.738723 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914a21e-7042-4b79-a995-cc72cf002993 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:11.739054 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914a21e-7042-4b79-a995-cc72cf002993 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:11.739283 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914a21e-7042-4b79-a995-cc72cf002993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:11.759830 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-9914a21e-7042-4b79-a995-cc72cf002993 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:11.761065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9914a21e-7042-4b79-a995-cc72cf002993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:11.799087 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 971/1926] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:11.804987 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33ff77-95ca-439b-87a0-94c3d1f34536 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:11.809018 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-ea33ff77-95ca-439b-87a0-94c3d1f34536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:11.843303 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 956/1927] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:11.844860 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914a21e-7042-4b79-a995-cc72cf002993 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:11.854531 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914a21e-7042-4b79-a995-cc72cf002993 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:11.859774 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b79bd-0053-4e04-a7c9-b951b6f20d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:11.870084 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b79bd-0053-4e04-a7c9-b951b6f20d73 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:11.870084 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b79bd-0053-4e04-a7c9-b951b6f20d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:11.870084 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b79bd-0053-4e04-a7c9-b951b6f20d73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:11.870084 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b79bd-0053-4e04-a7c9-b951b6f20d73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:24:11.870084 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b79bd-0053-4e04-a7c9-b951b6f20d73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:11.870084 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b79bd-0053-4e04-a7c9-b951b6f20d73 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:11.877660 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 957/1928] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:24:11.882900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b79bd-0053-4e04-a7c9-b951b6f20d73 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:11.893566 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b79bd-0053-4e04-a7c9-b951b6f20d73 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:11.900307 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800fccd-41d6-47aa-afe0-c72e79048d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:11.904743 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800fccd-41d6-47aa-afe0-c72e79048d32 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:11.904743 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800fccd-41d6-47aa-afe0-c72e79048d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:11.904743 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800fccd-41d6-47aa-afe0-c72e79048d32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:11.904743 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800fccd-41d6-47aa-afe0-c72e79048d32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:11.904743 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800fccd-41d6-47aa-afe0-c72e79048d32 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:11.908361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33ff77-95ca-439b-87a0-94c3d1f34536 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:11.918319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85e64e-a8b1-449b-af3b-9b73be1df89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:11.919104 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85e64e-a8b1-449b-af3b-9b73be1df89f admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:11.919379 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85e64e-a8b1-449b-af3b-9b73be1df89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:11.919766 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85e64e-a8b1-449b-af3b-9b73be1df89f admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:11.921284 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85e64e-a8b1-449b-af3b-9b73be1df89f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:11.924114 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85e64e-a8b1-449b-af3b-9b73be1df89f admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:12.042530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 958/1929] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:24:11 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:24:12.046473 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800fccd-41d6-47aa-afe0-c72e79048d32 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:12.064232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 972/1930] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:24:11 2022] POST /identity/v3/projects => generated 375 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:24:12.071840 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85e64e-a8b1-449b-af3b-9b73be1df89f admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:12.114732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800fccd-41d6-47aa-afe0-c72e79048d32 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:12.140284 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85e64e-a8b1-449b-af3b-9b73be1df89f admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:12.146600 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6b3c4-5dd7-4071-8b68-a5e23dbfd492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:12.147260 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6b3c4-5dd7-4071-8b68-a5e23dbfd492 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:12.147498 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6b3c4-5dd7-4071-8b68-a5e23dbfd492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:12.147780 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6b3c4-5dd7-4071-8b68-a5e23dbfd492 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:12.148527 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6b3c4-5dd7-4071-8b68-a5e23dbfd492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:12.150467 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6b3c4-5dd7-4071-8b68-a5e23dbfd492 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:12.177340 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd2982-96a0-49c9-adb2-13d932b0df28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:12.178015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd2982-96a0-49c9-adb2-13d932b0df28 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:12.178295 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd2982-96a0-49c9-adb2-13d932b0df28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:12.178569 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd2982-96a0-49c9-adb2-13d932b0df28 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:12.179857 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd2982-96a0-49c9-adb2-13d932b0df28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:12.181805 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd2982-96a0-49c9-adb2-13d932b0df28 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:12.246940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 973/1931] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:24:12 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:24:12.248004 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6b3c4-5dd7-4071-8b68-a5e23dbfd492 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:12.249739 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-58c6b3c4-5dd7-4071-8b68-a5e23dbfd492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:12.262604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6b3c4-5dd7-4071-8b68-a5e23dbfd492 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:12.267668 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e06fa0-b2d8-45c8-a5d0-eee9f9761a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:12.268845 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e06fa0-b2d8-45c8-a5d0-eee9f9761a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:12.270156 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 959/1932] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:24:12 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:24:12.270257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e06fa0-b2d8-45c8-a5d0-eee9f9761a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:12.270257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e06fa0-b2d8-45c8-a5d0-eee9f9761a6f admin admin] PATH_INFO: `/v3/projects/45e61fd706b74427bbd0372c05254a76` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:12.270420 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd2982-96a0-49c9-adb2-13d932b0df28 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:12.270509 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e06fa0-b2d8-45c8-a5d0-eee9f9761a6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=45e61fd706b74427bbd0372c05254a76)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:12.272472 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e06fa0-b2d8-45c8-a5d0-eee9f9761a6f admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:12.280447 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd2982-96a0-49c9-adb2-13d932b0df28 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:12.285720 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e71416-5fd6-4998-9b59-8ae0772bd72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:12.286398 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e71416-5fd6-4998-9b59-8ae0772bd72f admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:12.287375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e71416-5fd6-4998-9b59-8ae0772bd72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:12.287375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e71416-5fd6-4998-9b59-8ae0772bd72f admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:12.287740 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e71416-5fd6-4998-9b59-8ae0772bd72f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:12.290106 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e71416-5fd6-4998-9b59-8ae0772bd72f admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:12.307947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 960/1933] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:24:12.307947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e71416-5fd6-4998-9b59-8ae0772bd72f admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:12.313214 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e71416-5fd6-4998-9b59-8ae0772bd72f admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:12.318128 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2cfb7-0d33-411a-8e6b-e5997e1111d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:12.318736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2cfb7-0d33-411a-8e6b-e5997e1111d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:12.319048 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2cfb7-0d33-411a-8e6b-e5997e1111d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:12.319288 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2cfb7-0d33-411a-8e6b-e5997e1111d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:12.320074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2cfb7-0d33-411a-8e6b-e5997e1111d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:12.321688 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2cfb7-0d33-411a-8e6b-e5997e1111d1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:12.333333 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 961/1934] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:24:12.334215 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2cfb7-0d33-411a-8e6b-e5997e1111d1 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:12.343710 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2cfb7-0d33-411a-8e6b-e5997e1111d1 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:12.348499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26deae9c-9ff0-4bd3-8fca-25c77cb8b419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:12.349369 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deae9c-9ff0-4bd3-8fca-25c77cb8b419 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:12.349722 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deae9c-9ff0-4bd3-8fca-25c77cb8b419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:12.349901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deae9c-9ff0-4bd3-8fca-25c77cb8b419 admin admin] PATH_INFO: `/v3/projects/8d8346ff285545cd842a78d8312ebe33/users/d7dbb5c760a841f4ab23ebb4fca6ea46/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:12.365917 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26deae9c-9ff0-4bd3-8fca-25c77cb8b419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d8346ff285545cd842a78d8312ebe33, user_id=d7dbb5c760a841f4ab23ebb4fca6ea46, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:12.370478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26deae9c-9ff0-4bd3-8fca-25c77cb8b419 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:12.384215 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-c8e06fa0-b2d8-45c8-a5d0-eee9f9761a6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45e61fd706b74427bbd0372c05254a76', 'request_id': 'req-c8e06fa0-b2d8-45c8-a5d0-eee9f9761a6f'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:12.456263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-c8e06fa0-b2d8-45c8-a5d0-eee9f9761a6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45e61fd706b74427bbd0372c05254a76', 'request_id': 'req-c8e06fa0-b2d8-45c8-a5d0-eee9f9761a6f'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:12.462376 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 962/1935] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:24:12 2022] PUT /identity/v3/projects/8d8346ff285545cd842a78d8312ebe33/users/d7dbb5c760a841f4ab23ebb4fca6ea46/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:12.462549 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-c8e06fa0-b2d8-45c8-a5d0-eee9f9761a6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45e61fd706b74427bbd0372c05254a76', 'request_id': 'req-c8e06fa0-b2d8-45c8-a5d0-eee9f9761a6f'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:12.463200 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26deae9c-9ff0-4bd3-8fca-25c77cb8b419 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:12.478311 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-c8e06fa0-b2d8-45c8-a5d0-eee9f9761a6f admin admin] The token cache is being invalidate because project 45e61fd706b74427bbd0372c05254a76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:24:12.478601 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-c8e06fa0-b2d8-45c8-a5d0-eee9f9761a6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:12.479286 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-c8e06fa0-b2d8-45c8-a5d0-eee9f9761a6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:12.480898 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 974/1936] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:24:12 2022] DELETE /identity/v3/projects/45e61fd706b74427bbd0372c05254a76 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:12.481689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e06fa0-b2d8-45c8-a5d0-eee9f9761a6f admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:12.483024 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c8e06fa0-b2d8-45c8-a5d0-eee9f9761a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:12.529438 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26deae9c-9ff0-4bd3-8fca-25c77cb8b419 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:12.534205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97e954-34c4-48a6-96bc-50152a0754ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:12.534875 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97e954-34c4-48a6-96bc-50152a0754ec admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:12.535157 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97e954-34c4-48a6-96bc-50152a0754ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:12.535431 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97e954-34c4-48a6-96bc-50152a0754ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:12.536223 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97e954-34c4-48a6-96bc-50152a0754ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:12.537859 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97e954-34c4-48a6-96bc-50152a0754ec admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:12.548955 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 963/1937] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:24:12.549716 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97e954-34c4-48a6-96bc-50152a0754ec admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:12.551547 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ed97e954-34c4-48a6-96bc-50152a0754ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:12.551720 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e06fa0-b2d8-45c8-a5d0-eee9f9761a6f admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:12.557561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7993c3-5ffd-49b0-bc63-942b7a444955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:12.558322 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7993c3-5ffd-49b0-bc63-942b7a444955 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:12.558527 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7993c3-5ffd-49b0-bc63-942b7a444955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:12.558797 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7993c3-5ffd-49b0-bc63-942b7a444955 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:12.559530 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7993c3-5ffd-49b0-bc63-942b7a444955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:12.561166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7993c3-5ffd-49b0-bc63-942b7a444955 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:12.565731 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97e954-34c4-48a6-96bc-50152a0754ec admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:12.570689 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ed91b-c51c-4316-9dd0-bdcc0ba40546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:12.571624 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ed91b-c51c-4316-9dd0-bdcc0ba40546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:12.571914 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ed91b-c51c-4316-9dd0-bdcc0ba40546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:12.572473 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ed91b-c51c-4316-9dd0-bdcc0ba40546 admin admin] PATH_INFO: `/v3/users/7014dbe2ba3945c1b3f1a0b9229466cd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:12.573579 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 975/1938] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:24:12.574345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7993c3-5ffd-49b0-bc63-942b7a444955 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:12.579136 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ed91b-c51c-4316-9dd0-bdcc0ba40546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7014dbe2ba3945c1b3f1a0b9229466cd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:12.579694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5f7993c3-5ffd-49b0-bc63-942b7a444955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:12.581373 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ed91b-c51c-4316-9dd0-bdcc0ba40546 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:12.594702 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7993c3-5ffd-49b0-bc63-942b7a444955 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:12.601328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b5192-aa31-4d30-be93-29682a6d0610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:12.602247 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b5192-aa31-4d30-be93-29682a6d0610 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:12.602565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b5192-aa31-4d30-be93-29682a6d0610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:12.602842 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b5192-aa31-4d30-be93-29682a6d0610 admin admin] PATH_INFO: `/v3/projects/897d4ecaf10d4a169a6802c96571be01/users/fef950327730419aa3fbdf79d681737a/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:12.619468 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b5192-aa31-4d30-be93-29682a6d0610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=897d4ecaf10d4a169a6802c96571be01, user_id=fef950327730419aa3fbdf79d681737a, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:12.622234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b5192-aa31-4d30-be93-29682a6d0610 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:12.761508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 976/1939] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:24:12 2022] PUT /identity/v3/projects/897d4ecaf10d4a169a6802c96571be01/users/fef950327730419aa3fbdf79d681737a/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:12.762329 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b5192-aa31-4d30-be93-29682a6d0610 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:12.831348 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b5192-aa31-4d30-be93-29682a6d0610 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:12.840429 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52420ac2-6544-4d3e-97ef-c8c7530e6440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:12.841958 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52420ac2-6544-4d3e-97ef-c8c7530e6440 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:12.842535 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52420ac2-6544-4d3e-97ef-c8c7530e6440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:12.842984 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52420ac2-6544-4d3e-97ef-c8c7530e6440 admin admin] PATH_INFO: `/v3/projects/8d8346ff285545cd842a78d8312ebe33/users/d7dbb5c760a841f4ab23ebb4fca6ea46/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:12.845315 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52420ac2-6544-4d3e-97ef-c8c7530e6440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d8346ff285545cd842a78d8312ebe33, user_id=d7dbb5c760a841f4ab23ebb4fca6ea46, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:12.848041 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52420ac2-6544-4d3e-97ef-c8c7530e6440 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:12.856517 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d55ed91b-c51c-4316-9dd0-bdcc0ba40546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7014dbe2ba3945c1b3f1a0b9229466cd'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:12.861052 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 977/1940] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:24:12 2022] PUT /identity/v3/projects/8d8346ff285545cd842a78d8312ebe33/users/d7dbb5c760a841f4ab23ebb4fca6ea46/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:12.862399 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14875abc-4b29-4224-b1d3-2c67bc792a80 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:12.862691 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14875abc-4b29-4224-b1d3-2c67bc792a80 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:12.862969 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14875abc-4b29-4224-b1d3-2c67bc792a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:12.876586 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d55ed91b-c51c-4316-9dd0-bdcc0ba40546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7014dbe2ba3945c1b3f1a0b9229466cd'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:12.877514 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d55ed91b-c51c-4316-9dd0-bdcc0ba40546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7014dbe2ba3945c1b3f1a0b9229466cd'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:12.878042 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d55ed91b-c51c-4316-9dd0-bdcc0ba40546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7014dbe2ba3945c1b3f1a0b9229466cd'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:12.899472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d55ed91b-c51c-4316-9dd0-bdcc0ba40546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7014dbe2ba3945c1b3f1a0b9229466cd'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:12.936457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:12.979453 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 964/1941] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:24:12 2022] DELETE /identity/v3/users/7014dbe2ba3945c1b3f1a0b9229466cd => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:12.980801 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e101c26-be83-4e13-800f-4065cca5997d None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:12.981159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e101c26-be83-4e13-800f-4065cca5997d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:12.981430 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e101c26-be83-4e13-800f-4065cca5997d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:13.014827 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-6e101c26-be83-4e13-800f-4065cca5997d None None] MFA Rules not processed for user `d7dbb5c760a841f4ab23ebb4fca6ea46`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:13.016192 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6e101c26-be83-4e13-800f-4065cca5997d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:13.037318 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-14875abc-4b29-4224-b1d3-2c67bc792a80 None None] MFA Rules not processed for user `fef950327730419aa3fbdf79d681737a`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:13.039214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-14875abc-4b29-4224-b1d3-2c67bc792a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:13.109930 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:13.112746 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 965/1942] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:13.131101 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 978/1943] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:13.133156 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e101c26-be83-4e13-800f-4065cca5997d None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:13.136174 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6e101c26-be83-4e13-800f-4065cca5997d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:13.140284 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14875abc-4b29-4224-b1d3-2c67bc792a80 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:13.142660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-14875abc-4b29-4224-b1d3-2c67bc792a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:13.234029 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14875abc-4b29-4224-b1d3-2c67bc792a80 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:13.238123 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47fa8d-7131-474d-8a0e-50b71824530a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:13.238852 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47fa8d-7131-474d-8a0e-50b71824530a service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:13.239198 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47fa8d-7131-474d-8a0e-50b71824530a service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:13.239561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47fa8d-7131-474d-8a0e-50b71824530a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:13.242015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e101c26-be83-4e13-800f-4065cca5997d None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:13.242267 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-da47fa8d-7131-474d-8a0e-50b71824530a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:13.247095 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0587c2e-2a94-4a1e-a359-abb2f47f2545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:13.247764 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0587c2e-2a94-4a1e-a359-abb2f47f2545 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:13.248129 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0587c2e-2a94-4a1e-a359-abb2f47f2545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:13.248403 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0587c2e-2a94-4a1e-a359-abb2f47f2545 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:13.249099 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0587c2e-2a94-4a1e-a359-abb2f47f2545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:13.251402 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0587c2e-2a94-4a1e-a359-abb2f47f2545 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:13.314157 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47fa8d-7131-474d-8a0e-50b71824530a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:13.315604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47fa8d-7131-474d-8a0e-50b71824530a service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:13.325918 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 979/1944] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:24:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:24:13.368181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 966/1945] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:24:13 2022] POST /identity/v3/projects => generated 377 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:24:13.369531 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47fa8d-7131-474d-8a0e-50b71824530a service cinder] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:13.394759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47fa8d-7131-474d-8a0e-50b71824530a service cinder] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:13.464446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebcf37-4e4c-4478-b216-669f30924695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:13.465125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebcf37-4e4c-4478-b216-669f30924695 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:13.465572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebcf37-4e4c-4478-b216-669f30924695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:13.466878 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebcf37-4e4c-4478-b216-669f30924695 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:13.467763 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebebcf37-4e4c-4478-b216-669f30924695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:13.469865 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebebcf37-4e4c-4478-b216-669f30924695 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:13.552931 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 980/1946] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:24:13 2022] POST /identity/v3/users => generated 295 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:24:13.555098 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0587c2e-2a94-4a1e-a359-abb2f47f2545 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:13.569406 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0587c2e-2a94-4a1e-a359-abb2f47f2545 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:13.575003 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a237d06-6ad2-44cd-92d9-2b13f9fecdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:13.575709 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a237d06-6ad2-44cd-92d9-2b13f9fecdae admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:13.576008 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a237d06-6ad2-44cd-92d9-2b13f9fecdae admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:13.576300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a237d06-6ad2-44cd-92d9-2b13f9fecdae admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:13.577144 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a237d06-6ad2-44cd-92d9-2b13f9fecdae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:13.578656 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a237d06-6ad2-44cd-92d9-2b13f9fecdae admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:13.590506 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 967/1947] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:24:13.594745 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebcf37-4e4c-4478-b216-669f30924695 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:13.604917 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebcf37-4e4c-4478-b216-669f30924695 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:13.609730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869fc84-95a6-4834-bd96-cdb3d7429f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:13.610639 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869fc84-95a6-4834-bd96-cdb3d7429f33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:13.610921 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869fc84-95a6-4834-bd96-cdb3d7429f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:13.611195 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869fc84-95a6-4834-bd96-cdb3d7429f33 admin admin] PATH_INFO: `/v3/projects/6ffaa617788b4475aa609f37bf8a35ac/users/375cd3cbec304456bd71f6d2cc3cea73/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:13.626980 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869fc84-95a6-4834-bd96-cdb3d7429f33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ffaa617788b4475aa609f37bf8a35ac, user_id=375cd3cbec304456bd71f6d2cc3cea73, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:13.629640 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869fc84-95a6-4834-bd96-cdb3d7429f33 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:13.658189 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a237d06-6ad2-44cd-92d9-2b13f9fecdae admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:13.660040 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3a237d06-6ad2-44cd-92d9-2b13f9fecdae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:13.674074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a237d06-6ad2-44cd-92d9-2b13f9fecdae admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:13.679823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83232843-8f46-45d4-936f-42fdb55128fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:13.680739 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83232843-8f46-45d4-936f-42fdb55128fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:13.681023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83232843-8f46-45d4-936f-42fdb55128fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:13.681298 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83232843-8f46-45d4-936f-42fdb55128fd admin admin] PATH_INFO: `/v3/projects/21000c6247494335b15c7a5498f9d71a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:13.691563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83232843-8f46-45d4-936f-42fdb55128fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=21000c6247494335b15c7a5498f9d71a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:13.691909 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83232843-8f46-45d4-936f-42fdb55128fd admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:13.761471 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 981/1948] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:24:13 2022] PUT /identity/v3/projects/6ffaa617788b4475aa609f37bf8a35ac/users/375cd3cbec304456bd71f6d2cc3cea73/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:13.765393 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869fc84-95a6-4834-bd96-cdb3d7429f33 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:13.834041 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869fc84-95a6-4834-bd96-cdb3d7429f33 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:13.839034 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e5308-9926-4fce-ad0b-5bb0a4956998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:13.839708 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e5308-9926-4fce-ad0b-5bb0a4956998 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:13.840011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e5308-9926-4fce-ad0b-5bb0a4956998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:13.840292 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e5308-9926-4fce-ad0b-5bb0a4956998 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:13.841021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e5308-9926-4fce-ad0b-5bb0a4956998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:13.842620 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e5308-9926-4fce-ad0b-5bb0a4956998 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:13.853629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 982/1949] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:24:13.857909 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e5308-9926-4fce-ad0b-5bb0a4956998 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:13.868825 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e5308-9926-4fce-ad0b-5bb0a4956998 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:13.884253 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-83232843-8f46-45d4-936f-42fdb55128fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21000c6247494335b15c7a5498f9d71a', 'request_id': 'req-83232843-8f46-45d4-936f-42fdb55128fd'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:13.892372 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-83232843-8f46-45d4-936f-42fdb55128fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21000c6247494335b15c7a5498f9d71a', 'request_id': 'req-83232843-8f46-45d4-936f-42fdb55128fd'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:13.935182 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57d628-db2e-455c-ad6e-06416a362ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:13.936139 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57d628-db2e-455c-ad6e-06416a362ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:13.936452 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57d628-db2e-455c-ad6e-06416a362ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:13.936732 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57d628-db2e-455c-ad6e-06416a362ea1 admin admin] PATH_INFO: `/v3/projects/6ffaa617788b4475aa609f37bf8a35ac/users/375cd3cbec304456bd71f6d2cc3cea73/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:13.938772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57d628-db2e-455c-ad6e-06416a362ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ffaa617788b4475aa609f37bf8a35ac, user_id=375cd3cbec304456bd71f6d2cc3cea73, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:13.941625 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57d628-db2e-455c-ad6e-06416a362ea1 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:13.953769 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 983/1950] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:24:13 2022] PUT /identity/v3/projects/6ffaa617788b4475aa609f37bf8a35ac/users/375cd3cbec304456bd71f6d2cc3cea73/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:24:13.963864 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f38e0-bbe0-4f39-8e0a-5d3574551703 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:13.964250 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f38e0-bbe0-4f39-8e0a-5d3574551703 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:13.964530 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f38e0-bbe0-4f39-8e0a-5d3574551703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:13.971046 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-83232843-8f46-45d4-936f-42fdb55128fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21000c6247494335b15c7a5498f9d71a', 'request_id': 'req-83232843-8f46-45d4-936f-42fdb55128fd'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:13.983666 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-83232843-8f46-45d4-936f-42fdb55128fd admin admin] The token cache is being invalidate because project 21000c6247494335b15c7a5498f9d71a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:24:13.984093 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-83232843-8f46-45d4-936f-42fdb55128fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:13.984747 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-83232843-8f46-45d4-936f-42fdb55128fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:13.986364 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 968/1951] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:24:13 2022] DELETE /identity/v3/projects/21000c6247494335b15c7a5498f9d71a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:24:13.993958 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-566f38e0-bbe0-4f39-8e0a-5d3574551703 None None] MFA Rules not processed for user `375cd3cbec304456bd71f6d2cc3cea73`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:13.995179 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-566f38e0-bbe0-4f39-8e0a-5d3574551703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:13.996150 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd0859-69b3-4f32-923c-73a80041ad47 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:13.996443 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd0859-69b3-4f32-923c-73a80041ad47 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:13.996725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd0859-69b3-4f32-923c-73a80041ad47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:14.016250 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-4cfd0859-69b3-4f32-923c-73a80041ad47 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:14.017475 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4cfd0859-69b3-4f32-923c-73a80041ad47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:14.079394 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 984/1952] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:24:14.093988 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f38e0-bbe0-4f39-8e0a-5d3574551703 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:14.096172 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-566f38e0-bbe0-4f39-8e0a-5d3574551703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:14.103481 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 969/1953] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:24:14.112515 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30185c15-6b1d-4162-a276-1c1dea5409f5 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:14.112812 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30185c15-6b1d-4162-a276-1c1dea5409f5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:14.113121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30185c15-6b1d-4162-a276-1c1dea5409f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:14.132358 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-30185c15-6b1d-4162-a276-1c1dea5409f5 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:14.133436 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-30185c15-6b1d-4162-a276-1c1dea5409f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:14.142460 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 970/1954] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:24:14.144133 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:14.146483 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30185c15-6b1d-4162-a276-1c1dea5409f5 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:14.157957 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30185c15-6b1d-4162-a276-1c1dea5409f5 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:14.163918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be896b-e173-40e2-a33a-9d1efcaa2f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:14.164860 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be896b-e173-40e2-a33a-9d1efcaa2f74 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:14.165217 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be896b-e173-40e2-a33a-9d1efcaa2f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:14.165572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be896b-e173-40e2-a33a-9d1efcaa2f74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:14.166520 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f38e0-bbe0-4f39-8e0a-5d3574551703 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:14.166995 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be896b-e173-40e2-a33a-9d1efcaa2f74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:24:14.166995 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be896b-e173-40e2-a33a-9d1efcaa2f74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:14.168884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be896b-e173-40e2-a33a-9d1efcaa2f74 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:14.171721 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379f1da-e40a-472e-bb8a-a0bcda608f6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:14.172594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379f1da-e40a-472e-bb8a-a0bcda608f6b service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:14.173090 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379f1da-e40a-472e-bb8a-a0bcda608f6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:14.173499 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379f1da-e40a-472e-bb8a-a0bcda608f6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:14.175513 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c379f1da-e40a-472e-bb8a-a0bcda608f6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:14.190092 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 971/1955] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:24:14.191726 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be896b-e173-40e2-a33a-9d1efcaa2f74 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:14.205147 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be896b-e173-40e2-a33a-9d1efcaa2f74 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:14.214635 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a15c44-ef4b-40de-9f97-d68158721cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:14.215397 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a15c44-ef4b-40de-9f97-d68158721cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:14.221917 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a15c44-ef4b-40de-9f97-d68158721cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:14.221917 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a15c44-ef4b-40de-9f97-d68158721cf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:14.221917 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a15c44-ef4b-40de-9f97-d68158721cf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:14.221917 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a15c44-ef4b-40de-9f97-d68158721cf3 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:14.245424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:14.262272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379f1da-e40a-472e-bb8a-a0bcda608f6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:14.265282 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379f1da-e40a-472e-bb8a-a0bcda608f6b service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:14.283971 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 985/1956] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:24:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:24:14.328721 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 972/1957] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:24:14 2022] POST /identity/v3/projects => generated 389 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:24:14.332865 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379f1da-e40a-472e-bb8a-a0bcda608f6b service cinder] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:14.345090 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379f1da-e40a-472e-bb8a-a0bcda608f6b service cinder] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:14.409351 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9a3a6-f701-40fb-96b4-5e9cda533016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:14.409978 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9a3a6-f701-40fb-96b4-5e9cda533016 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:14.410259 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9a3a6-f701-40fb-96b4-5e9cda533016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:14.410592 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9a3a6-f701-40fb-96b4-5e9cda533016 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:14.411328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9a3a6-f701-40fb-96b4-5e9cda533016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:14.413838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9a3a6-f701-40fb-96b4-5e9cda533016 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:14.485710 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 986/1958] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:24:14 2022] POST /identity/v3/users => generated 295 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:24:14.489922 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a15c44-ef4b-40de-9f97-d68158721cf3 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:14.500653 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a15c44-ef4b-40de-9f97-d68158721cf3 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:14.505204 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86feb550-d4eb-4ea2-a4fc-9226df2fb3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:14.505854 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86feb550-d4eb-4ea2-a4fc-9226df2fb3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:14.506133 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86feb550-d4eb-4ea2-a4fc-9226df2fb3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:14.506401 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86feb550-d4eb-4ea2-a4fc-9226df2fb3b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:14.507176 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86feb550-d4eb-4ea2-a4fc-9226df2fb3b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:14.508857 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86feb550-d4eb-4ea2-a4fc-9226df2fb3b3 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:14.518904 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 973/1959] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:24:14.523372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9a3a6-f701-40fb-96b4-5e9cda533016 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:14.533274 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9a3a6-f701-40fb-96b4-5e9cda533016 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:14.537913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bff4c-52b0-4b32-b2c9-b9b34c390728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:14.539208 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bff4c-52b0-4b32-b2c9-b9b34c390728 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:14.539501 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bff4c-52b0-4b32-b2c9-b9b34c390728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:14.539754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bff4c-52b0-4b32-b2c9-b9b34c390728 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:14.540507 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bff4c-52b0-4b32-b2c9-b9b34c390728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:14.542093 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bff4c-52b0-4b32-b2c9-b9b34c390728 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:14.552453 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 987/1960] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:24:14.556607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86feb550-d4eb-4ea2-a4fc-9226df2fb3b3 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:14.566394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86feb550-d4eb-4ea2-a4fc-9226df2fb3b3 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:14.572812 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2869415-6e2f-4fa0-9660-17477551574a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:14.573738 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2869415-6e2f-4fa0-9660-17477551574a admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:14.574048 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2869415-6e2f-4fa0-9660-17477551574a admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:14.574296 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2869415-6e2f-4fa0-9660-17477551574a admin admin] PATH_INFO: `/v3/projects/37a58b4b6deb4d84a61be396825b63d6/users/f74b0acffb994b9a9415453843d81eca/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:14.593482 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2869415-6e2f-4fa0-9660-17477551574a admin admin] RBAC: Authorizing `identity:create_grant(project_id=37a58b4b6deb4d84a61be396825b63d6, user_id=f74b0acffb994b9a9415453843d81eca, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:14.596487 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2869415-6e2f-4fa0-9660-17477551574a admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:14.652622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 974/1961] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:24:14 2022] PUT /identity/v3/projects/37a58b4b6deb4d84a61be396825b63d6/users/f74b0acffb994b9a9415453843d81eca/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:14.664511 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70aae6-21b7-4956-9086-9aaa3bca818f None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:14.664762 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70aae6-21b7-4956-9086-9aaa3bca818f None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:14.665040 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70aae6-21b7-4956-9086-9aaa3bca818f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:14.695306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-4c70aae6-21b7-4956-9086-9aaa3bca818f None None] MFA Rules not processed for user `f74b0acffb994b9a9415453843d81eca`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:14.696550 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-4c70aae6-21b7-4956-9086-9aaa3bca818f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:14.772641 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 988/1962] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:14.777256 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2869415-6e2f-4fa0-9660-17477551574a admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:14.838810 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2869415-6e2f-4fa0-9660-17477551574a admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:14.843492 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc743918-87f1-422c-95e2-492d6b4b49f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:14.844176 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc743918-87f1-422c-95e2-492d6b4b49f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:14.844460 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc743918-87f1-422c-95e2-492d6b4b49f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:14.844740 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc743918-87f1-422c-95e2-492d6b4b49f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:14.845436 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc743918-87f1-422c-95e2-492d6b4b49f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:14.847317 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc743918-87f1-422c-95e2-492d6b4b49f8 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:14.885195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:14.972195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 975/1963] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:24:14 2022] POST /identity/v3/projects => generated 389 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:24:14.977773 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70aae6-21b7-4956-9086-9aaa3bca818f None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:14.988351 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70aae6-21b7-4956-9086-9aaa3bca818f None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:15.050700 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc6c8d-aa84-4666-a99f-432a172bdc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:15.051381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc6c8d-aa84-4666-a99f-432a172bdc42 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:15.051656 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc6c8d-aa84-4666-a99f-432a172bdc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:15.051928 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc6c8d-aa84-4666-a99f-432a172bdc42 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:15.052648 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc6c8d-aa84-4666-a99f-432a172bdc42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:15.055281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc6c8d-aa84-4666-a99f-432a172bdc42 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:15.171081 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:15.180840 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 989/1964] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:24:14 2022] POST /identity/v3/users => generated 301 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:24:15.184409 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc743918-87f1-422c-95e2-492d6b4b49f8 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:15.198015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc743918-87f1-422c-95e2-492d6b4b49f8 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:15.205268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb85382-7990-4471-812d-eced4e198006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:15.208928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb85382-7990-4471-812d-eced4e198006 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:15.208928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb85382-7990-4471-812d-eced4e198006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:15.208928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb85382-7990-4471-812d-eced4e198006 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:15.208928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb85382-7990-4471-812d-eced4e198006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:15.209400 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb85382-7990-4471-812d-eced4e198006 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:15.225246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 976/1965] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:24:15.227139 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc6c8d-aa84-4666-a99f-432a172bdc42 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:15.237337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc6c8d-aa84-4666-a99f-432a172bdc42 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:15.246813 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42fd57-b607-4d9a-a6b2-0eb3dd79d171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:15.248036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42fd57-b607-4d9a-a6b2-0eb3dd79d171 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:15.248246 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42fd57-b607-4d9a-a6b2-0eb3dd79d171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:15.248526 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42fd57-b607-4d9a-a6b2-0eb3dd79d171 admin admin] PATH_INFO: `/v3/projects/7c682b679689430e93d5e9d5e9eb422e/users/2a714ea6fba648af9428b3a069cf87b7/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:15.264805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42fd57-b607-4d9a-a6b2-0eb3dd79d171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c682b679689430e93d5e9d5e9eb422e, user_id=2a714ea6fba648af9428b3a069cf87b7, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:15.267450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42fd57-b607-4d9a-a6b2-0eb3dd79d171 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:15.410775 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 990/1966] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:24:15 2022] PUT /identity/v3/projects/7c682b679689430e93d5e9d5e9eb422e/users/2a714ea6fba648af9428b3a069cf87b7/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:15.415078 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb85382-7990-4471-812d-eced4e198006 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:15.425327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb85382-7990-4471-812d-eced4e198006 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:15.502354 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ca288-b158-46eb-a54a-89e1162fdd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:15.503132 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ca288-b158-46eb-a54a-89e1162fdd14 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:15.503728 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ca288-b158-46eb-a54a-89e1162fdd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:15.504101 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ca288-b158-46eb-a54a-89e1162fdd14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:15.504913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ca288-b158-46eb-a54a-89e1162fdd14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:15.508022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ca288-b158-46eb-a54a-89e1162fdd14 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:15.522108 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 977/1967] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:24:15.526693 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42fd57-b607-4d9a-a6b2-0eb3dd79d171 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:15.538652 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42fd57-b607-4d9a-a6b2-0eb3dd79d171 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:15.546137 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d0350-15d0-402b-abe6-5a17f7c11389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:15.546137 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d0350-15d0-402b-abe6-5a17f7c11389 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:15.546137 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d0350-15d0-402b-abe6-5a17f7c11389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:15.546137 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d0350-15d0-402b-abe6-5a17f7c11389 admin admin] PATH_INFO: `/v3/projects/7c682b679689430e93d5e9d5e9eb422e/users/2a714ea6fba648af9428b3a069cf87b7/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:15.547926 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d0350-15d0-402b-abe6-5a17f7c11389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c682b679689430e93d5e9d5e9eb422e, user_id=2a714ea6fba648af9428b3a069cf87b7, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:15.550870 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d0350-15d0-402b-abe6-5a17f7c11389 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:15.562344 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 991/1968] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:24:15 2022] PUT /identity/v3/projects/7c682b679689430e93d5e9d5e9eb422e/users/2a714ea6fba648af9428b3a069cf87b7/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:15.574353 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b0446-7f16-40f1-ad22-19ce43d00afa None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:15.574644 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b0446-7f16-40f1-ad22-19ce43d00afa None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:15.574928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b0446-7f16-40f1-ad22-19ce43d00afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:15.603159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-902b0446-7f16-40f1-ad22-19ce43d00afa None None] MFA Rules not processed for user `2a714ea6fba648af9428b3a069cf87b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:15.604448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-902b0446-7f16-40f1-ad22-19ce43d00afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:15.673213 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 978/1969] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:15 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:24:15.685369 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d0350-15d0-402b-abe6-5a17f7c11389 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:15.744665 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d0350-15d0-402b-abe6-5a17f7c11389 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:15.748465 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051710d-af2a-4d60-8318-4badfa4fa96f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:15.749129 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051710d-af2a-4d60-8318-4badfa4fa96f service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:15.749432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051710d-af2a-4d60-8318-4badfa4fa96f service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:15.749712 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051710d-af2a-4d60-8318-4badfa4fa96f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:15.761606 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051710d-af2a-4d60-8318-4badfa4fa96f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:15.763714 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051710d-af2a-4d60-8318-4badfa4fa96f service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:15.771826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:15.784423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 992/1970] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:24:15 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:24:15.918777 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b0446-7f16-40f1-ad22-19ce43d00afa None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:16.003724 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b0446-7f16-40f1-ad22-19ce43d00afa None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:16.010421 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6656a-5a86-4438-8153-4d17bf22316f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:16.011955 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6656a-5a86-4438-8153-4d17bf22316f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:16.012498 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6656a-5a86-4438-8153-4d17bf22316f admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:16.012991 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6656a-5a86-4438-8153-4d17bf22316f admin admin] PATH_INFO: `/v3/users/f74b0acffb994b9a9415453843d81eca` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:16.015104 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6656a-5a86-4438-8153-4d17bf22316f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f74b0acffb994b9a9415453843d81eca)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:16.017534 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6656a-5a86-4438-8153-4d17bf22316f admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:16.188598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:16.229852 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-89e6656a-5a86-4438-8153-4d17bf22316f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f74b0acffb994b9a9415453843d81eca'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:16.238393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-89e6656a-5a86-4438-8153-4d17bf22316f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f74b0acffb994b9a9415453843d81eca'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:16.241295 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-89e6656a-5a86-4438-8153-4d17bf22316f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f74b0acffb994b9a9415453843d81eca'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:16.241295 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-89e6656a-5a86-4438-8153-4d17bf22316f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f74b0acffb994b9a9415453843d81eca'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:16.253447 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-89e6656a-5a86-4438-8153-4d17bf22316f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f74b0acffb994b9a9415453843d81eca'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:16.302604 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 979/1971] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:24:15 2022] DELETE /identity/v3/users/f74b0acffb994b9a9415453843d81eca => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:16.308370 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440404f3-fb56-427b-a12d-b5dff9322c9c None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:16.308717 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440404f3-fb56-427b-a12d-b5dff9322c9c None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:16.309051 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440404f3-fb56-427b-a12d-b5dff9322c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:16.328490 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-440404f3-fb56-427b-a12d-b5dff9322c9c None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:16.329706 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-440404f3-fb56-427b-a12d-b5dff9322c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:16.342460 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:16.394315 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 993/1972] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:16.404594 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6656a-5a86-4438-8153-4d17bf22316f admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:16.406358 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-89e6656a-5a86-4438-8153-4d17bf22316f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:16.416937 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:16.467393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6656a-5a86-4438-8153-4d17bf22316f admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:16.471047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc72a04-6cff-492a-9cd0-6676a2dbc801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:16.471749 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc72a04-6cff-492a-9cd0-6676a2dbc801 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:16.471967 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc72a04-6cff-492a-9cd0-6676a2dbc801 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:16.472273 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc72a04-6cff-492a-9cd0-6676a2dbc801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:16.482114 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc72a04-6cff-492a-9cd0-6676a2dbc801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:16.483530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc72a04-6cff-492a-9cd0-6676a2dbc801 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:16.492866 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 980/1973] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:24:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:24:16.520247 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:16.554882 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:16.599241 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440404f3-fb56-427b-a12d-b5dff9322c9c None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:16.601841 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-440404f3-fb56-427b-a12d-b5dff9322c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:16.629490 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440404f3-fb56-427b-a12d-b5dff9322c9c None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:16.634704 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154320ee-6f11-4aa8-892f-01c65ed1b5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:16.635705 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154320ee-6f11-4aa8-892f-01c65ed1b5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:16.636026 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154320ee-6f11-4aa8-892f-01c65ed1b5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:16.636324 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154320ee-6f11-4aa8-892f-01c65ed1b5f0 admin admin] PATH_INFO: `/v3/users/5c4d1ee372cf48ceb90fc3c83fc9e9a1` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:16.637637 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154320ee-6f11-4aa8-892f-01c65ed1b5f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c4d1ee372cf48ceb90fc3c83fc9e9a1)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:16.639633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154320ee-6f11-4aa8-892f-01c65ed1b5f0 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:16.851238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-154320ee-6f11-4aa8-892f-01c65ed1b5f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c4d1ee372cf48ceb90fc3c83fc9e9a1'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:16.866685 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-154320ee-6f11-4aa8-892f-01c65ed1b5f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c4d1ee372cf48ceb90fc3c83fc9e9a1'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:16.877768 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-154320ee-6f11-4aa8-892f-01c65ed1b5f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c4d1ee372cf48ceb90fc3c83fc9e9a1'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:16.878836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-154320ee-6f11-4aa8-892f-01c65ed1b5f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c4d1ee372cf48ceb90fc3c83fc9e9a1'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:16.879720 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-154320ee-6f11-4aa8-892f-01c65ed1b5f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c4d1ee372cf48ceb90fc3c83fc9e9a1'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:16.940872 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc72a04-6cff-492a-9cd0-6676a2dbc801 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:16.942418 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7bc72a04-6cff-492a-9cd0-6676a2dbc801 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:16.955371 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:16.959754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 994/1974] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:24:16 2022] DELETE /identity/v3/users/5c4d1ee372cf48ceb90fc3c83fc9e9a1 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:16.962120 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc72a04-6cff-492a-9cd0-6676a2dbc801 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:16.969662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc199be-478c-40c7-a472-17e7ac5a8ff4 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:16.969948 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc199be-478c-40c7-a472-17e7ac5a8ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:16.970232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc199be-478c-40c7-a472-17e7ac5a8ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:17.002647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-7fc199be-478c-40c7-a472-17e7ac5a8ff4 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:17.003884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-7fc199be-478c-40c7-a472-17e7ac5a8ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:17.059574 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:17.061499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ad6ac-5db0-4ba7-825d-35ed9d3ac890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:17.063508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ad6ac-5db0-4ba7-825d-35ed9d3ac890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:17.063795 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ad6ac-5db0-4ba7-825d-35ed9d3ac890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:17.064099 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ad6ac-5db0-4ba7-825d-35ed9d3ac890 admin admin] PATH_INFO: `/v3/projects/37a58b4b6deb4d84a61be396825b63d6` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:17.065585 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ad6ac-5db0-4ba7-825d-35ed9d3ac890 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37a58b4b6deb4d84a61be396825b63d6)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:17.067761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ad6ac-5db0-4ba7-825d-35ed9d3ac890 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:17.089240 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 995/1975] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:17.100717 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc199be-478c-40c7-a472-17e7ac5a8ff4 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:17.103110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-7fc199be-478c-40c7-a472-17e7ac5a8ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:17.168614 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc199be-478c-40c7-a472-17e7ac5a8ff4 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:17.172667 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec1f63-debe-416b-ab6c-ebce8634bf31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:17.173638 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec1f63-debe-416b-ab6c-ebce8634bf31 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:17.174213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec1f63-debe-416b-ab6c-ebce8634bf31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:17.183145 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec1f63-debe-416b-ab6c-ebce8634bf31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:17.199309 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec1f63-debe-416b-ab6c-ebce8634bf31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:17.201717 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec1f63-debe-416b-ab6c-ebce8634bf31 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:17.223206 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-013ad6ac-5db0-4ba7-825d-35ed9d3ac890 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37a58b4b6deb4d84a61be396825b63d6', 'request_id': 'req-013ad6ac-5db0-4ba7-825d-35ed9d3ac890'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:17.224104 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 996/1976] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:24:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:24:17.234135 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-013ad6ac-5db0-4ba7-825d-35ed9d3ac890 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37a58b4b6deb4d84a61be396825b63d6', 'request_id': 'req-013ad6ac-5db0-4ba7-825d-35ed9d3ac890'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:17.313845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-013ad6ac-5db0-4ba7-825d-35ed9d3ac890 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37a58b4b6deb4d84a61be396825b63d6', 'request_id': 'req-013ad6ac-5db0-4ba7-825d-35ed9d3ac890'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:17.329644 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-013ad6ac-5db0-4ba7-825d-35ed9d3ac890 admin admin] The token cache is being invalidate because project 37a58b4b6deb4d84a61be396825b63d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:24:17.329966 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-013ad6ac-5db0-4ba7-825d-35ed9d3ac890 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:17.330581 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-013ad6ac-5db0-4ba7-825d-35ed9d3ac890 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:17.338440 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 981/1977] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:24:16 2022] DELETE /identity/v3/projects/37a58b4b6deb4d84a61be396825b63d6 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:24:17.340681 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec1f63-debe-416b-ab6c-ebce8634bf31 service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:17.342992 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-e0ec1f63-debe-416b-ab6c-ebce8634bf31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:17.358830 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec1f63-debe-416b-ab6c-ebce8634bf31 service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:17.444916 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367390e-4f98-4c61-9b98-56f23fc7aaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:17.445832 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367390e-4f98-4c61-9b98-56f23fc7aaf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:17.446112 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367390e-4f98-4c61-9b98-56f23fc7aaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:17.446393 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367390e-4f98-4c61-9b98-56f23fc7aaf7 admin admin] PATH_INFO: `/v3/users/2a714ea6fba648af9428b3a069cf87b7` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:17.448131 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367390e-4f98-4c61-9b98-56f23fc7aaf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a714ea6fba648af9428b3a069cf87b7)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:17.450221 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367390e-4f98-4c61-9b98-56f23fc7aaf7 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:17.478442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:17.601621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:17.762972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-d367390e-4f98-4c61-9b98-56f23fc7aaf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a714ea6fba648af9428b3a069cf87b7'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:17.784769 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-d367390e-4f98-4c61-9b98-56f23fc7aaf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a714ea6fba648af9428b3a069cf87b7'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:17.811855 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-d367390e-4f98-4c61-9b98-56f23fc7aaf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a714ea6fba648af9428b3a069cf87b7'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:17.813038 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-d367390e-4f98-4c61-9b98-56f23fc7aaf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a714ea6fba648af9428b3a069cf87b7'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:17.815091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-d367390e-4f98-4c61-9b98-56f23fc7aaf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a714ea6fba648af9428b3a069cf87b7'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:17.969145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ad6ac-5db0-4ba7-825d-35ed9d3ac890 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:17.976925 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-013ad6ac-5db0-4ba7-825d-35ed9d3ac890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:17.990699 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ad6ac-5db0-4ba7-825d-35ed9d3ac890 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:18.002651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58048b7-243c-4228-a8be-691deeb08b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:18.003727 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58048b7-243c-4228-a8be-691deeb08b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:18.004026 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58048b7-243c-4228-a8be-691deeb08b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:18.004319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58048b7-243c-4228-a8be-691deeb08b9e admin admin] PATH_INFO: `/v3/projects/2c1a924ab4244d76a7acb426b3501bf1` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:18.005973 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58048b7-243c-4228-a8be-691deeb08b9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c1a924ab4244d76a7acb426b3501bf1)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:18.012181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58048b7-243c-4228-a8be-691deeb08b9e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:18.029045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 997/1978] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:24:17 2022] DELETE /identity/v3/users/2a714ea6fba648af9428b3a069cf87b7 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:24:18.479644 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-f58048b7-243c-4228-a8be-691deeb08b9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c1a924ab4244d76a7acb426b3501bf1', 'request_id': 'req-f58048b7-243c-4228-a8be-691deeb08b9e'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:18.487784 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-f58048b7-243c-4228-a8be-691deeb08b9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c1a924ab4244d76a7acb426b3501bf1', 'request_id': 'req-f58048b7-243c-4228-a8be-691deeb08b9e'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:18.799477 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-f58048b7-243c-4228-a8be-691deeb08b9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c1a924ab4244d76a7acb426b3501bf1', 'request_id': 'req-f58048b7-243c-4228-a8be-691deeb08b9e'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:18.801250 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:18.813410 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-f58048b7-243c-4228-a8be-691deeb08b9e admin admin] The token cache is being invalidate because project 2c1a924ab4244d76a7acb426b3501bf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:24:18.813709 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-f58048b7-243c-4228-a8be-691deeb08b9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:18.815086 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-f58048b7-243c-4228-a8be-691deeb08b9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:18.816223 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 982/1979] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:24:17 2022] DELETE /identity/v3/projects/2c1a924ab4244d76a7acb426b3501bf1 => generated 0 bytes in 848 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:18.821345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367390e-4f98-4c61-9b98-56f23fc7aaf7 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:18.823469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-d367390e-4f98-4c61-9b98-56f23fc7aaf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:18.918505 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367390e-4f98-4c61-9b98-56f23fc7aaf7 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:18.999436 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36407f3d-7e1e-4bb6-8116-80c7f932f590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:19.000390 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36407f3d-7e1e-4bb6-8116-80c7f932f590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:19.000670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36407f3d-7e1e-4bb6-8116-80c7f932f590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:19.000977 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36407f3d-7e1e-4bb6-8116-80c7f932f590 admin admin] PATH_INFO: `/v3/users/d7dbb5c760a841f4ab23ebb4fca6ea46` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:19.002269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36407f3d-7e1e-4bb6-8116-80c7f932f590 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7dbb5c760a841f4ab23ebb4fca6ea46)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:19.004497 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36407f3d-7e1e-4bb6-8116-80c7f932f590 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:19.257809 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58048b7-243c-4228-a8be-691deeb08b9e admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:19.260496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f58048b7-243c-4228-a8be-691deeb08b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:19.284610 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-36407f3d-7e1e-4bb6-8116-80c7f932f590 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7dbb5c760a841f4ab23ebb4fca6ea46'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:19.288970 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58048b7-243c-4228-a8be-691deeb08b9e admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:19.296427 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a3e45-a388-4ac6-a4ec-3bc4763b64a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:19.298193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a3e45-a388-4ac6-a4ec-3bc4763b64a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:19.299434 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a3e45-a388-4ac6-a4ec-3bc4763b64a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:19.300367 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a3e45-a388-4ac6-a4ec-3bc4763b64a9 admin admin] PATH_INFO: `/v3/projects/7c682b679689430e93d5e9d5e9eb422e` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:19.303453 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a3e45-a388-4ac6-a4ec-3bc4763b64a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c682b679689430e93d5e9d5e9eb422e)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:19.306564 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a3e45-a388-4ac6-a4ec-3bc4763b64a9 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:19.313224 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-36407f3d-7e1e-4bb6-8116-80c7f932f590 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7dbb5c760a841f4ab23ebb4fca6ea46'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:19.323656 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-36407f3d-7e1e-4bb6-8116-80c7f932f590 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7dbb5c760a841f4ab23ebb4fca6ea46'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:19.324568 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-36407f3d-7e1e-4bb6-8116-80c7f932f590 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7dbb5c760a841f4ab23ebb4fca6ea46'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:19.325328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-36407f3d-7e1e-4bb6-8116-80c7f932f590 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7dbb5c760a841f4ab23ebb4fca6ea46'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:19.440092 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 998/1980] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:24:18 2022] DELETE /identity/v3/users/d7dbb5c760a841f4ab23ebb4fca6ea46 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:19.523250 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-667a3e45-a388-4ac6-a4ec-3bc4763b64a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c682b679689430e93d5e9d5e9eb422e', 'request_id': 'req-667a3e45-a388-4ac6-a4ec-3bc4763b64a9'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:19.533361 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-667a3e45-a388-4ac6-a4ec-3bc4763b64a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c682b679689430e93d5e9d5e9eb422e', 'request_id': 'req-667a3e45-a388-4ac6-a4ec-3bc4763b64a9'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:19.576700 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:19.605162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-667a3e45-a388-4ac6-a4ec-3bc4763b64a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c682b679689430e93d5e9d5e9eb422e', 'request_id': 'req-667a3e45-a388-4ac6-a4ec-3bc4763b64a9'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:19.617886 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-667a3e45-a388-4ac6-a4ec-3bc4763b64a9 admin admin] The token cache is being invalidate because project 7c682b679689430e93d5e9d5e9eb422e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:24:19.618156 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-667a3e45-a388-4ac6-a4ec-3bc4763b64a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:19.618910 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-667a3e45-a388-4ac6-a4ec-3bc4763b64a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:19.620770 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 983/1981] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:24:19 2022] DELETE /identity/v3/projects/7c682b679689430e93d5e9d5e9eb422e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:19.626300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed481a-84d1-44cf-b433-9f0863c4ff9d None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:19.626590 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed481a-84d1-44cf-b433-9f0863c4ff9d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:19.626854 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed481a-84d1-44cf-b433-9f0863c4ff9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:19.649009 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-c8ed481a-84d1-44cf-b433-9f0863c4ff9d None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:19.650263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c8ed481a-84d1-44cf-b433-9f0863c4ff9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:19.736793 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 999/1982] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:19.739746 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd607caa-7a30-4a94-bd5f-777ff6540195 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:19.740136 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd607caa-7a30-4a94-bd5f-777ff6540195 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:19.740946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd607caa-7a30-4a94-bd5f-777ff6540195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:19.765112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-dd607caa-7a30-4a94-bd5f-777ff6540195 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:19.766330 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-dd607caa-7a30-4a94-bd5f-777ff6540195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:19.781778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 984/1983] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:19.783695 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed481a-84d1-44cf-b433-9f0863c4ff9d None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:19.795274 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed481a-84d1-44cf-b433-9f0863c4ff9d None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:19.800543 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad24025-caca-4031-b905-6f392228bfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:19.801400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad24025-caca-4031-b905-6f392228bfca admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:19.801837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad24025-caca-4031-b905-6f392228bfca admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:19.801837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad24025-caca-4031-b905-6f392228bfca admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:19.802869 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad24025-caca-4031-b905-6f392228bfca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:24:19.802869 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad24025-caca-4031-b905-6f392228bfca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:19.804741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad24025-caca-4031-b905-6f392228bfca admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:19.823198 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1000/1984] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:24:19.824748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd607caa-7a30-4a94-bd5f-777ff6540195 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:19.836349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd607caa-7a30-4a94-bd5f-777ff6540195 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:19.841358 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3711fcc-203d-444a-841a-3fbd0f877c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:19.842124 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3711fcc-203d-444a-841a-3fbd0f877c55 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:19.844181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3711fcc-203d-444a-841a-3fbd0f877c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:19.844181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3711fcc-203d-444a-841a-3fbd0f877c55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:19.844181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3711fcc-203d-444a-841a-3fbd0f877c55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:19.845950 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3711fcc-203d-444a-841a-3fbd0f877c55 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:19.939574 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 985/1985] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:24:19 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:24:19.944086 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad24025-caca-4031-b905-6f392228bfca admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:19.956196 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad24025-caca-4031-b905-6f392228bfca admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:20.020228 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a50d8-5018-4672-9d3b-8462103185e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:20.020919 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a50d8-5018-4672-9d3b-8462103185e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:20.021205 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a50d8-5018-4672-9d3b-8462103185e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:20.021483 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a50d8-5018-4672-9d3b-8462103185e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:20.022177 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a50d8-5018-4672-9d3b-8462103185e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:20.024276 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a50d8-5018-4672-9d3b-8462103185e9 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:20.106488 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3711fcc-203d-444a-841a-3fbd0f877c55 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:20.108440 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b3711fcc-203d-444a-841a-3fbd0f877c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:20.121705 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3711fcc-203d-444a-841a-3fbd0f877c55 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:20.127533 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b818472-1785-4474-abf9-bb2aa37992e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:20.128746 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b818472-1785-4474-abf9-bb2aa37992e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:20.129182 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b818472-1785-4474-abf9-bb2aa37992e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:20.129618 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b818472-1785-4474-abf9-bb2aa37992e5 admin admin] PATH_INFO: `/v3/projects/8d8346ff285545cd842a78d8312ebe33` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:20.132236 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b818472-1785-4474-abf9-bb2aa37992e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d8346ff285545cd842a78d8312ebe33)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:20.135158 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b818472-1785-4474-abf9-bb2aa37992e5 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:20.166041 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1001/1986] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:24:19 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:24:20.166904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a50d8-5018-4672-9d3b-8462103185e9 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:20.168565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-3e7a50d8-5018-4672-9d3b-8462103185e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:20.227550 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a50d8-5018-4672-9d3b-8462103185e9 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:20.231338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737002dc-3859-40a6-b190-7c6c4be0c1d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:20.232030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737002dc-3859-40a6-b190-7c6c4be0c1d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:20.232322 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737002dc-3859-40a6-b190-7c6c4be0c1d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:20.232597 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737002dc-3859-40a6-b190-7c6c4be0c1d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:20.234446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-737002dc-3859-40a6-b190-7c6c4be0c1d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:20.258076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:20.308858 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737002dc-3859-40a6-b190-7c6c4be0c1d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:20.310585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737002dc-3859-40a6-b190-7c6c4be0c1d0 service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:20.323368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1002/1987] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:24:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:24:20.324534 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737002dc-3859-40a6-b190-7c6c4be0c1d0 service cinder] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:20.337396 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737002dc-3859-40a6-b190-7c6c4be0c1d0 service cinder] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:20.353706 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c8fe3-3b65-4004-84f3-0e5c50b35fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:20.354412 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c8fe3-3b65-4004-84f3-0e5c50b35fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:20.354703 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c8fe3-3b65-4004-84f3-0e5c50b35fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:20.355742 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c8fe3-3b65-4004-84f3-0e5c50b35fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:20.355742 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c8fe3-3b65-4004-84f3-0e5c50b35fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:20.357422 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c8fe3-3b65-4004-84f3-0e5c50b35fb2 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:20.368845 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1003/1988] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:24:20.372410 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c8fe3-3b65-4004-84f3-0e5c50b35fb2 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:20.383147 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c8fe3-3b65-4004-84f3-0e5c50b35fb2 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:20.412501 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-4b818472-1785-4474-abf9-bb2aa37992e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d8346ff285545cd842a78d8312ebe33', 'request_id': 'req-4b818472-1785-4474-abf9-bb2aa37992e5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:20.414547 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-4b818472-1785-4474-abf9-bb2aa37992e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d8346ff285545cd842a78d8312ebe33', 'request_id': 'req-4b818472-1785-4474-abf9-bb2aa37992e5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:20.455084 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db892016-b280-4c2a-8567-81106d6da2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:20.461486 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db892016-b280-4c2a-8567-81106d6da2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:20.461486 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db892016-b280-4c2a-8567-81106d6da2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:20.461486 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db892016-b280-4c2a-8567-81106d6da2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:20.461486 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db892016-b280-4c2a-8567-81106d6da2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:20.461486 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db892016-b280-4c2a-8567-81106d6da2c7 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:20.473152 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1004/1989] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:24:20.475013 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db892016-b280-4c2a-8567-81106d6da2c7 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:20.486143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db892016-b280-4c2a-8567-81106d6da2c7 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:20.491485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff2dc7-30f9-4c9d-9547-a2770617d9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:20.492626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff2dc7-30f9-4c9d-9547-a2770617d9b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:20.492998 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff2dc7-30f9-4c9d-9547-a2770617d9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:20.493380 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff2dc7-30f9-4c9d-9547-a2770617d9b3 admin admin] PATH_INFO: `/v3/projects/3daad4aa72eb4e9e8bd5e802e80752b0/users/60724987823f46478bd43a824306f389/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:20.509093 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff2dc7-30f9-4c9d-9547-a2770617d9b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3daad4aa72eb4e9e8bd5e802e80752b0, user_id=60724987823f46478bd43a824306f389, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:20.511763 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff2dc7-30f9-4c9d-9547-a2770617d9b3 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:20.594509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-4b818472-1785-4474-abf9-bb2aa37992e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d8346ff285545cd842a78d8312ebe33', 'request_id': 'req-4b818472-1785-4474-abf9-bb2aa37992e5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:20.607947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-4b818472-1785-4474-abf9-bb2aa37992e5 admin admin] The token cache is being invalidate because project 8d8346ff285545cd842a78d8312ebe33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:24:20.607947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-4b818472-1785-4474-abf9-bb2aa37992e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:20.608535 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-4b818472-1785-4474-abf9-bb2aa37992e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:20.610128 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 986/1990] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:24:20 2022] DELETE /identity/v3/projects/8d8346ff285545cd842a78d8312ebe33 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:20.615251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b706fb2-3931-41db-b7b8-eda2fbc78db4 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:20.615430 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b706fb2-3931-41db-b7b8-eda2fbc78db4 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:20.615708 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b706fb2-3931-41db-b7b8-eda2fbc78db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:20.634818 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1005/1991] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:24:20 2022] PUT /identity/v3/projects/3daad4aa72eb4e9e8bd5e802e80752b0/users/60724987823f46478bd43a824306f389/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:24:20.636331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-4b706fb2-3931-41db-b7b8-eda2fbc78db4 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:20.638023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4b706fb2-3931-41db-b7b8-eda2fbc78db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:20.647593 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100f075-5d13-432b-beb8-407fa71e4883 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:20.647899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100f075-5d13-432b-beb8-407fa71e4883 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:20.648346 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100f075-5d13-432b-beb8-407fa71e4883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:20.679576 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-2100f075-5d13-432b-beb8-407fa71e4883 None None] MFA Rules not processed for user `60724987823f46478bd43a824306f389`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:20.680971 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-2100f075-5d13-432b-beb8-407fa71e4883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:20.756068 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 987/1992] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:24:20.768769 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc3a52-5e23-48c1-b40b-2622060045b3 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:20.769141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc3a52-5e23-48c1-b40b-2622060045b3 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:20.769543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc3a52-5e23-48c1-b40b-2622060045b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:20.777674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1006/1993] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:24:20.797410 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-acbc3a52-5e23-48c1-b40b-2622060045b3 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:20.799942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-acbc3a52-5e23-48c1-b40b-2622060045b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:20.806376 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100f075-5d13-432b-beb8-407fa71e4883 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:20.808495 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-2100f075-5d13-432b-beb8-407fa71e4883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:20.812383 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 988/1994] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:20.821108 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc3a52-5e23-48c1-b40b-2622060045b3 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:20.833460 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc3a52-5e23-48c1-b40b-2622060045b3 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:20.839839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84305bbb-1a1b-4e90-8f0d-ec8ab9773520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:20.840818 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84305bbb-1a1b-4e90-8f0d-ec8ab9773520 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:20.841107 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84305bbb-1a1b-4e90-8f0d-ec8ab9773520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:20.841391 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84305bbb-1a1b-4e90-8f0d-ec8ab9773520 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:20.844315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84305bbb-1a1b-4e90-8f0d-ec8ab9773520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:24:20.844315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84305bbb-1a1b-4e90-8f0d-ec8ab9773520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:20.844315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84305bbb-1a1b-4e90-8f0d-ec8ab9773520 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:20.868772 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 989/1995] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:24:20.870278 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84305bbb-1a1b-4e90-8f0d-ec8ab9773520 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:20.875972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100f075-5d13-432b-beb8-407fa71e4883 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:20.881016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84305bbb-1a1b-4e90-8f0d-ec8ab9773520 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:20.885693 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3e1c7-28a5-4467-a4d5-6b8ee6535523 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:20.886477 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3e1c7-28a5-4467-a4d5-6b8ee6535523 service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:20.886680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff0d39-dd6d-4a55-9d61-1880da3a9efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:20.886915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3e1c7-28a5-4467-a4d5-6b8ee6535523 service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:20.887315 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3e1c7-28a5-4467-a4d5-6b8ee6535523 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:20.887425 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff0d39-dd6d-4a55-9d61-1880da3a9efb admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:20.887635 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff0d39-dd6d-4a55-9d61-1880da3a9efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:20.887910 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff0d39-dd6d-4a55-9d61-1880da3a9efb admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:20.888732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff0d39-dd6d-4a55-9d61-1880da3a9efb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:20.890757 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff0d39-dd6d-4a55-9d61-1880da3a9efb admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:20.896962 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3e1c7-28a5-4467-a4d5-6b8ee6535523 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:20.899044 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3e1c7-28a5-4467-a4d5-6b8ee6535523 service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:20.908853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1007/1996] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:24:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:24:20.997215 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 990/1997] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:24:20 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:24:21.002153 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3e1c7-28a5-4467-a4d5-6b8ee6535523 service cinder] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:21.015133 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3e1c7-28a5-4467-a4d5-6b8ee6535523 service cinder] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:21.063223 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:21.084992 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa21f31-6c39-4e32-aff8-928c06883540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:21.085708 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa21f31-6c39-4e32-aff8-928c06883540 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:21.085991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa21f31-6c39-4e32-aff8-928c06883540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:21.086312 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa21f31-6c39-4e32-aff8-928c06883540 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:21.087055 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa21f31-6c39-4e32-aff8-928c06883540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:21.089488 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa21f31-6c39-4e32-aff8-928c06883540 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:21.208373 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1008/1998] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:24:21 2022] POST /identity/v3/users => generated 286 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:24:21.215018 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff0d39-dd6d-4a55-9d61-1880da3a9efb admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:21.225394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff0d39-dd6d-4a55-9d61-1880da3a9efb admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:21.230960 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2b256-ac98-4044-a264-a909f71a6580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:21.231815 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2b256-ac98-4044-a264-a909f71a6580 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:21.232292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2b256-ac98-4044-a264-a909f71a6580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:21.232642 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2b256-ac98-4044-a264-a909f71a6580 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:21.233456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2b256-ac98-4044-a264-a909f71a6580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:21.235326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2b256-ac98-4044-a264-a909f71a6580 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:21.247602 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 991/1999] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:24:21.253320 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa21f31-6c39-4e32-aff8-928c06883540 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:21.267117 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa21f31-6c39-4e32-aff8-928c06883540 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:21.272131 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04e013-b188-4ce0-8fed-c1424f1acd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:21.272849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04e013-b188-4ce0-8fed-c1424f1acd1b admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:21.273131 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04e013-b188-4ce0-8fed-c1424f1acd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:21.273411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04e013-b188-4ce0-8fed-c1424f1acd1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:21.274137 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04e013-b188-4ce0-8fed-c1424f1acd1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:21.275774 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04e013-b188-4ce0-8fed-c1424f1acd1b admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:21.291908 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1009/2000] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:24:21.296149 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2b256-ac98-4044-a264-a909f71a6580 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:21.308526 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2b256-ac98-4044-a264-a909f71a6580 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:21.313418 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f60cb-46d8-485f-80a4-c14991825c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:21.314326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f60cb-46d8-485f-80a4-c14991825c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:21.314601 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f60cb-46d8-485f-80a4-c14991825c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:21.314885 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f60cb-46d8-485f-80a4-c14991825c0f admin admin] PATH_INFO: `/v3/projects/e698050f081b4668ae999bab9afe3040/users/7be641b806154b2fb419763417fecc38/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:21.332518 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f60cb-46d8-485f-80a4-c14991825c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e698050f081b4668ae999bab9afe3040, user_id=7be641b806154b2fb419763417fecc38, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:21.335266 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f60cb-46d8-485f-80a4-c14991825c0f admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:21.455638 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 992/2001] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:24:21 2022] PUT /identity/v3/projects/e698050f081b4668ae999bab9afe3040/users/7be641b806154b2fb419763417fecc38/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:21.466239 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c591ed-4076-4f00-bdc3-76ead73abb16 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:21.466533 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c591ed-4076-4f00-bdc3-76ead73abb16 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:21.466821 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c591ed-4076-4f00-bdc3-76ead73abb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:21.497073 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-d8c591ed-4076-4f00-bdc3-76ead73abb16 None None] MFA Rules not processed for user `7be641b806154b2fb419763417fecc38`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:21.503715 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-d8c591ed-4076-4f00-bdc3-76ead73abb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:21.619185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:21.628473 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1010/2002] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:21.646546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f60cb-46d8-485f-80a4-c14991825c0f admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:21.648378 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ab5f60cb-46d8-485f-80a4-c14991825c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:21.728300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f60cb-46d8-485f-80a4-c14991825c0f admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:21.738666 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d40a8e-d11a-4333-8e94-3d9dc9634922 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '226743f4f93c44c5aef5919a7813bd3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:21.739372 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d40a8e-d11a-4333-8e94-3d9dc9634922 service glance] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:21.739659 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d40a8e-d11a-4333-8e94-3d9dc9634922 service glance] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:21.739937 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d40a8e-d11a-4333-8e94-3d9dc9634922 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:21.755624 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d40a8e-d11a-4333-8e94-3d9dc9634922 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:21.760469 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d40a8e-d11a-4333-8e94-3d9dc9634922 service glance] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:21.775767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 993/2003] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:24:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:24:22.909167 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:23.686057 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:24.155611 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:27.342983 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04ef8f-19af-437a-b7a8-f2b4d52ca680 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:27.343692 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04ef8f-19af-437a-b7a8-f2b4d52ca680 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:27.343692 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04ef8f-19af-437a-b7a8-f2b4d52ca680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:27.363939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-2b04ef8f-19af-437a-b7a8-f2b4d52ca680 None None] MFA Rules not processed for user `7b9b819e522144dbb780cbc3843f88c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:27.365627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-2b04ef8f-19af-437a-b7a8-f2b4d52ca680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:27.450587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1011/2004] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:32.316233 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=48,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:37.438992 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=29 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:38.765798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d40a8e-d11a-4333-8e94-3d9dc9634922 service glance] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:38.767320 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b5d40a8e-d11a-4333-8e94-3d9dc9634922 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:38.922102 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d40a8e-d11a-4333-8e94-3d9dc9634922 service glance] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:38.926894 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a13a35-8d51-4b4a-b342-f6f69ac46795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:38.927842 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a13a35-8d51-4b4a-b342-f6f69ac46795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:38.928107 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a13a35-8d51-4b4a-b342-f6f69ac46795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:38.928584 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a13a35-8d51-4b4a-b342-f6f69ac46795 admin admin] PATH_INFO: `/v3/users/fef950327730419aa3fbdf79d681737a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:38.930184 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a13a35-8d51-4b4a-b342-f6f69ac46795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fef950327730419aa3fbdf79d681737a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:38.932153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a13a35-8d51-4b4a-b342-f6f69ac46795 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:39.144682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-11a13a35-8d51-4b4a-b342-f6f69ac46795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fef950327730419aa3fbdf79d681737a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:39.152163 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-11a13a35-8d51-4b4a-b342-f6f69ac46795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fef950327730419aa3fbdf79d681737a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:39.152832 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-11a13a35-8d51-4b4a-b342-f6f69ac46795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fef950327730419aa3fbdf79d681737a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:39.153433 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-11a13a35-8d51-4b4a-b342-f6f69ac46795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fef950327730419aa3fbdf79d681737a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:39.165755 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-11a13a35-8d51-4b4a-b342-f6f69ac46795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fef950327730419aa3fbdf79d681737a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:39.268455 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 994/2005] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:24:38 2022] DELETE /identity/v3/users/fef950327730419aa3fbdf79d681737a => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:39.269235 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73815e50-bb80-492b-b51e-9f96b0ae35da None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:39.269235 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73815e50-bb80-492b-b51e-9f96b0ae35da None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:39.270006 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73815e50-bb80-492b-b51e-9f96b0ae35da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:39.304690 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-73815e50-bb80-492b-b51e-9f96b0ae35da None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:39.306439 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-73815e50-bb80-492b-b51e-9f96b0ae35da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:39.374483 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1012/2006] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:39.385739 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a13a35-8d51-4b4a-b342-f6f69ac46795 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:39.387388 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-11a13a35-8d51-4b4a-b342-f6f69ac46795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:39.413891 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:39.497692 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a13a35-8d51-4b4a-b342-f6f69ac46795 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:39.501609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8091b-7f5f-43dc-9926-d352208ce554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:39.502285 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8091b-7f5f-43dc-9926-d352208ce554 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:39.507203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8091b-7f5f-43dc-9926-d352208ce554 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:39.507203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8091b-7f5f-43dc-9926-d352208ce554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:39.513818 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8091b-7f5f-43dc-9926-d352208ce554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:39.515271 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8091b-7f5f-43dc-9926-d352208ce554 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:39.526937 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 995/2007] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:24:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:24:40.079749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73815e50-bb80-492b-b51e-9f96b0ae35da None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:40.081565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-73815e50-bb80-492b-b51e-9f96b0ae35da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:40.094418 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73815e50-bb80-492b-b51e-9f96b0ae35da None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:40.099015 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2105de-1675-4d1a-b48f-662697c1e3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:40.099886 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2105de-1675-4d1a-b48f-662697c1e3f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:40.100205 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2105de-1675-4d1a-b48f-662697c1e3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:40.100482 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2105de-1675-4d1a-b48f-662697c1e3f0 admin admin] PATH_INFO: `/v3/projects/897d4ecaf10d4a169a6802c96571be01` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:40.102409 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2105de-1675-4d1a-b48f-662697c1e3f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=897d4ecaf10d4a169a6802c96571be01)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:40.104364 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2105de-1675-4d1a-b48f-662697c1e3f0 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:40.233501 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-fa2105de-1675-4d1a-b48f-662697c1e3f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '897d4ecaf10d4a169a6802c96571be01', 'request_id': 'req-fa2105de-1675-4d1a-b48f-662697c1e3f0'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:40.307431 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-fa2105de-1675-4d1a-b48f-662697c1e3f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '897d4ecaf10d4a169a6802c96571be01', 'request_id': 'req-fa2105de-1675-4d1a-b48f-662697c1e3f0'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:40.313497 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-fa2105de-1675-4d1a-b48f-662697c1e3f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '897d4ecaf10d4a169a6802c96571be01', 'request_id': 'req-fa2105de-1675-4d1a-b48f-662697c1e3f0'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:40.324948 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-fa2105de-1675-4d1a-b48f-662697c1e3f0 admin admin] The token cache is being invalidate because project 897d4ecaf10d4a169a6802c96571be01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:24:40.325230 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-fa2105de-1675-4d1a-b48f-662697c1e3f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:40.325862 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-fa2105de-1675-4d1a-b48f-662697c1e3f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:40.327392 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1013/2008] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:24:40 2022] DELETE /identity/v3/projects/897d4ecaf10d4a169a6802c96571be01 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:40.331627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8091b-7f5f-43dc-9926-d352208ce554 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:40.341322 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8091b-7f5f-43dc-9926-d352208ce554 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:40.397620 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3433a4-5a33-4d7b-a2cd-c70b86575a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:40.398494 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3433a4-5a33-4d7b-a2cd-c70b86575a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:40.399314 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3433a4-5a33-4d7b-a2cd-c70b86575a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:40.399598 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3433a4-5a33-4d7b-a2cd-c70b86575a54 admin admin] PATH_INFO: `/v3/users/375cd3cbec304456bd71f6d2cc3cea73` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:40.401064 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3433a4-5a33-4d7b-a2cd-c70b86575a54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=375cd3cbec304456bd71f6d2cc3cea73)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:40.402794 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3433a4-5a33-4d7b-a2cd-c70b86575a54 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:40.560779 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-de3433a4-5a33-4d7b-a2cd-c70b86575a54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '375cd3cbec304456bd71f6d2cc3cea73'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:40.568056 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-de3433a4-5a33-4d7b-a2cd-c70b86575a54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '375cd3cbec304456bd71f6d2cc3cea73'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:40.568733 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-de3433a4-5a33-4d7b-a2cd-c70b86575a54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '375cd3cbec304456bd71f6d2cc3cea73'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:40.569820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-de3433a4-5a33-4d7b-a2cd-c70b86575a54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '375cd3cbec304456bd71f6d2cc3cea73'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:40.582999 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-de3433a4-5a33-4d7b-a2cd-c70b86575a54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '375cd3cbec304456bd71f6d2cc3cea73'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:40.656445 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 996/2009] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:24:40 2022] DELETE /identity/v3/users/375cd3cbec304456bd71f6d2cc3cea73 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:41.111401 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2105de-1675-4d1a-b48f-662697c1e3f0 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:41.121939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-fa2105de-1675-4d1a-b48f-662697c1e3f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:41.161192 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2105de-1675-4d1a-b48f-662697c1e3f0 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:41.264390 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbed16e-78ad-402c-8c73-c07253ea56b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:41.265308 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbed16e-78ad-402c-8c73-c07253ea56b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:41.266176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbed16e-78ad-402c-8c73-c07253ea56b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:41.266176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbed16e-78ad-402c-8c73-c07253ea56b7 admin admin] PATH_INFO: `/v3/projects/6ffaa617788b4475aa609f37bf8a35ac` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:41.267571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbed16e-78ad-402c-8c73-c07253ea56b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ffaa617788b4475aa609f37bf8a35ac)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:41.269882 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbed16e-78ad-402c-8c73-c07253ea56b7 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:41.294585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:41.386860 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-9fbed16e-78ad-402c-8c73-c07253ea56b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ffaa617788b4475aa609f37bf8a35ac', 'request_id': 'req-9fbed16e-78ad-402c-8c73-c07253ea56b7'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:41.473778 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-9fbed16e-78ad-402c-8c73-c07253ea56b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ffaa617788b4475aa609f37bf8a35ac', 'request_id': 'req-9fbed16e-78ad-402c-8c73-c07253ea56b7'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:41.482096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-9fbed16e-78ad-402c-8c73-c07253ea56b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ffaa617788b4475aa609f37bf8a35ac', 'request_id': 'req-9fbed16e-78ad-402c-8c73-c07253ea56b7'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:41.494056 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-9fbed16e-78ad-402c-8c73-c07253ea56b7 admin admin] The token cache is being invalidate because project 6ffaa617788b4475aa609f37bf8a35ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:24:41.494343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-9fbed16e-78ad-402c-8c73-c07253ea56b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:41.495151 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-9fbed16e-78ad-402c-8c73-c07253ea56b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:41.497248 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1014/2010] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:24:41 2022] DELETE /identity/v3/projects/6ffaa617788b4475aa609f37bf8a35ac => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:41.502797 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39003b-3a0f-4241-822f-d222aefb1bfa None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:41.503297 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39003b-3a0f-4241-822f-d222aefb1bfa None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:41.503544 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39003b-3a0f-4241-822f-d222aefb1bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:41.510168 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:41.549336 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-5d39003b-3a0f-4241-822f-d222aefb1bfa None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:41.550589 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5d39003b-3a0f-4241-822f-d222aefb1bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:41.630097 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 997/2011] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:24:41.638788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204d5d6-1631-4f42-9ec6-3bf5ead64c24 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:41.639011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204d5d6-1631-4f42-9ec6-3bf5ead64c24 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:41.639288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204d5d6-1631-4f42-9ec6-3bf5ead64c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:41.659539 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-1204d5d6-1631-4f42-9ec6-3bf5ead64c24 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:41.660837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-1204d5d6-1631-4f42-9ec6-3bf5ead64c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:41.669355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1015/2012] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:41.673825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39003b-3a0f-4241-822f-d222aefb1bfa None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:41.683929 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39003b-3a0f-4241-822f-d222aefb1bfa None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:41.688657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303f5ec-96e8-4da0-af0f-fe82eed764be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:41.689404 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303f5ec-96e8-4da0-af0f-fe82eed764be admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:41.689678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303f5ec-96e8-4da0-af0f-fe82eed764be admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:41.689952 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303f5ec-96e8-4da0-af0f-fe82eed764be admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:41.690668 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303f5ec-96e8-4da0-af0f-fe82eed764be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:24:41.690969 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303f5ec-96e8-4da0-af0f-fe82eed764be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:41.692612 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303f5ec-96e8-4da0-af0f-fe82eed764be admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:41.706716 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 998/2013] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:24:41.715930 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204d5d6-1631-4f42-9ec6-3bf5ead64c24 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:41.725980 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204d5d6-1631-4f42-9ec6-3bf5ead64c24 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:41.733646 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd381f-9336-4db7-b652-12e2c09e81ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:41.734317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd381f-9336-4db7-b652-12e2c09e81ed admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:41.734602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd381f-9336-4db7-b652-12e2c09e81ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:41.734882 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd381f-9336-4db7-b652-12e2c09e81ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:41.735587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd381f-9336-4db7-b652-12e2c09e81ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:41.737589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd381f-9336-4db7-b652-12e2c09e81ed admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:41.813042 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1016/2014] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:24:41 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:24:41.816878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303f5ec-96e8-4da0-af0f-fe82eed764be admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:41.828210 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303f5ec-96e8-4da0-af0f-fe82eed764be admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:41.894399 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b69a43-8932-400a-8451-774a37a22eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:41.894974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b69a43-8932-400a-8451-774a37a22eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:41.895254 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b69a43-8932-400a-8451-774a37a22eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:41.895531 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b69a43-8932-400a-8451-774a37a22eb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:41.896265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b69a43-8932-400a-8451-774a37a22eb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:41.898181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b69a43-8932-400a-8451-774a37a22eb8 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:42.018310 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 999/2015] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:24:41 2022] POST /identity/v3/users => generated 291 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:24:42.022545 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd381f-9336-4db7-b652-12e2c09e81ed admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:42.032761 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd381f-9336-4db7-b652-12e2c09e81ed admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:42.037723 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fcf21-7e26-44a6-8943-d2758aa2aeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:42.038548 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fcf21-7e26-44a6-8943-d2758aa2aeac admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:42.038930 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fcf21-7e26-44a6-8943-d2758aa2aeac admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:42.039275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fcf21-7e26-44a6-8943-d2758aa2aeac admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:42.040111 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139fcf21-7e26-44a6-8943-d2758aa2aeac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:42.041792 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139fcf21-7e26-44a6-8943-d2758aa2aeac admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:42.056693 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1017/2016] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:24:42.057988 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b69a43-8932-400a-8451-774a37a22eb8 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:42.072546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b69a43-8932-400a-8451-774a37a22eb8 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:42.077975 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7498fc2-93fc-49e4-a0ed-dc21f546e57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:42.078459 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7498fc2-93fc-49e4-a0ed-dc21f546e57c admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:42.078918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7498fc2-93fc-49e4-a0ed-dc21f546e57c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:42.079194 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7498fc2-93fc-49e4-a0ed-dc21f546e57c admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:42.079935 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7498fc2-93fc-49e4-a0ed-dc21f546e57c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:42.081579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7498fc2-93fc-49e4-a0ed-dc21f546e57c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:42.092610 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1000/2017] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:24:42.099043 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fcf21-7e26-44a6-8943-d2758aa2aeac admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:42.109544 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fcf21-7e26-44a6-8943-d2758aa2aeac admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:42.114110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc2fbd-d120-4ede-856a-d5f5f9c6cfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:42.114999 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc2fbd-d120-4ede-856a-d5f5f9c6cfe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:42.115277 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc2fbd-d120-4ede-856a-d5f5f9c6cfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:42.115552 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc2fbd-d120-4ede-856a-d5f5f9c6cfe4 admin admin] PATH_INFO: `/v3/projects/d4ddd573ceae4849a5b5220b5e106834/users/5ed5ebc99ffd4426966230c18a73f91c/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:42.130783 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc2fbd-d120-4ede-856a-d5f5f9c6cfe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ddd573ceae4849a5b5220b5e106834, user_id=5ed5ebc99ffd4426966230c18a73f91c, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:42.134261 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc2fbd-d120-4ede-856a-d5f5f9c6cfe4 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:42.199966 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1018/2018] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:24:42 2022] PUT /identity/v3/projects/d4ddd573ceae4849a5b5220b5e106834/users/5ed5ebc99ffd4426966230c18a73f91c/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:42.210071 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df12061-ceb1-4ab1-a738-28db4b3af953 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:42.210361 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df12061-ceb1-4ab1-a738-28db4b3af953 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:42.210637 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df12061-ceb1-4ab1-a738-28db4b3af953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:42.238470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-5df12061-ceb1-4ab1-a738-28db4b3af953 None None] MFA Rules not processed for user `5ed5ebc99ffd4426966230c18a73f91c`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:42.239739 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5df12061-ceb1-4ab1-a738-28db4b3af953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:42.286066 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:42.310808 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1001/2019] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:42.314977 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc2fbd-d120-4ede-856a-d5f5f9c6cfe4 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:42.348916 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df12061-ceb1-4ab1-a738-28db4b3af953 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:42.350362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5df12061-ceb1-4ab1-a738-28db4b3af953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:42.396549 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc2fbd-d120-4ede-856a-d5f5f9c6cfe4 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:42.401564 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5afd8a-4369-4dd9-91ce-0271b277c564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:42.402232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5afd8a-4369-4dd9-91ce-0271b277c564 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:42.402512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5afd8a-4369-4dd9-91ce-0271b277c564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:42.402805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5afd8a-4369-4dd9-91ce-0271b277c564 admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:42.403539 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5afd8a-4369-4dd9-91ce-0271b277c564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:42.405490 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5afd8a-4369-4dd9-91ce-0271b277c564 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:42.423965 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df12061-ceb1-4ab1-a738-28db4b3af953 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:42.429229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014d844-77c9-4f6e-904c-5a7331c5d89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:42.434610 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014d844-77c9-4f6e-904c-5a7331c5d89e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:42.434610 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014d844-77c9-4f6e-904c-5a7331c5d89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:42.434610 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014d844-77c9-4f6e-904c-5a7331c5d89e admin admin] PATH_INFO: `/v3/users/60724987823f46478bd43a824306f389` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:42.434610 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014d844-77c9-4f6e-904c-5a7331c5d89e admin admin] RBAC: Authorizing `identity:delete_user(user_id=60724987823f46478bd43a824306f389)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:42.434610 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014d844-77c9-4f6e-904c-5a7331c5d89e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:42.493745 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1019/2020] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:24:42 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:24:42.497796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5afd8a-4369-4dd9-91ce-0271b277c564 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:42.529999 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:42.560647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5afd8a-4369-4dd9-91ce-0271b277c564 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:42.565558 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093453a-e6fc-4fac-ae77-12f1a4c70a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:42.566225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093453a-e6fc-4fac-ae77-12f1a4c70a7c admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:42.566504 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093453a-e6fc-4fac-ae77-12f1a4c70a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:42.566775 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093453a-e6fc-4fac-ae77-12f1a4c70a7c admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:42.567451 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093453a-e6fc-4fac-ae77-12f1a4c70a7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:42.569421 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093453a-e6fc-4fac-ae77-12f1a4c70a7c admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:42.641807 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0014d844-77c9-4f6e-904c-5a7331c5d89e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60724987823f46478bd43a824306f389'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:42.650349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0014d844-77c9-4f6e-904c-5a7331c5d89e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60724987823f46478bd43a824306f389'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:42.651069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0014d844-77c9-4f6e-904c-5a7331c5d89e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60724987823f46478bd43a824306f389'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:42.651694 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0014d844-77c9-4f6e-904c-5a7331c5d89e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60724987823f46478bd43a824306f389'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:42.663920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0014d844-77c9-4f6e-904c-5a7331c5d89e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60724987823f46478bd43a824306f389'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:42.696168 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1020/2021] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:24:42 2022] POST /identity/v3/users => generated 298 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:24:42.700606 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093453a-e6fc-4fac-ae77-12f1a4c70a7c admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:42.702242 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-8093453a-e6fc-4fac-ae77-12f1a4c70a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:42.714486 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093453a-e6fc-4fac-ae77-12f1a4c70a7c admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:42.720119 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb970c-8d12-48d2-ae88-63b37fcc9c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:42.720781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb970c-8d12-48d2-ae88-63b37fcc9c54 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:42.721064 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb970c-8d12-48d2-ae88-63b37fcc9c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:42.721339 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb970c-8d12-48d2-ae88-63b37fcc9c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:42.722068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb970c-8d12-48d2-ae88-63b37fcc9c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:42.723668 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb970c-8d12-48d2-ae88-63b37fcc9c54 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:42.735137 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1021/2022] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:24:42.739133 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb970c-8d12-48d2-ae88-63b37fcc9c54 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:42.749081 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb970c-8d12-48d2-ae88-63b37fcc9c54 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:42.753764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471bc3bc-38d6-455e-81b1-44d69419584d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:42.754658 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bc3bc-38d6-455e-81b1-44d69419584d admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:42.754934 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bc3bc-38d6-455e-81b1-44d69419584d admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:42.755206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bc3bc-38d6-455e-81b1-44d69419584d admin admin] PATH_INFO: `/v3/projects/9b23efc8cd0f45f58d7cfc8927a9cb6b/users/82b6d2b0b3124d89b77323521837f533/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:42.770761 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471bc3bc-38d6-455e-81b1-44d69419584d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b23efc8cd0f45f58d7cfc8927a9cb6b, user_id=82b6d2b0b3124d89b77323521837f533, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:42.771223 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1002/2023] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:24:42 2022] DELETE /identity/v3/users/60724987823f46478bd43a824306f389 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:42.774007 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471bc3bc-38d6-455e-81b1-44d69419584d admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:42.777732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ccd40-d798-4099-b12b-570b8b5aa6e1 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:42.778013 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ccd40-d798-4099-b12b-570b8b5aa6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:42.781325 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ccd40-d798-4099-b12b-570b8b5aa6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:42.798098 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-bb3ccd40-d798-4099-b12b-570b8b5aa6e1 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:42.798729 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-bb3ccd40-d798-4099-b12b-570b8b5aa6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:42.860221 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1003/2024] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:24:42.868820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1022/2025] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:24:42 2022] PUT /identity/v3/projects/9b23efc8cd0f45f58d7cfc8927a9cb6b/users/82b6d2b0b3124d89b77323521837f533/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:24:42.871124 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ccd40-d798-4099-b12b-570b8b5aa6e1 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:42.872819 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471bc3bc-38d6-455e-81b1-44d69419584d admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:42.873006 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-bb3ccd40-d798-4099-b12b-570b8b5aa6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:42.879550 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:42.948469 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ccd40-d798-4099-b12b-570b8b5aa6e1 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:42.984730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471bc3bc-38d6-455e-81b1-44d69419584d admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:42.995511 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70a129-de03-4d50-8cf3-6235d9ee608a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:42.998623 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70a129-de03-4d50-8cf3-6235d9ee608a admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:42.999259 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70a129-de03-4d50-8cf3-6235d9ee608a admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:42.999753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70a129-de03-4d50-8cf3-6235d9ee608a admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:43.001192 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70a129-de03-4d50-8cf3-6235d9ee608a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:43.006141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70a129-de03-4d50-8cf3-6235d9ee608a admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:43.026725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3802f-511a-4f17-86b3-682c03b88b38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:43.028807 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3802f-511a-4f17-86b3-682c03b88b38 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:43.029269 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3802f-511a-4f17-86b3-682c03b88b38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:43.029687 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3802f-511a-4f17-86b3-682c03b88b38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:43.033055 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1023/2026] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:24:43.037618 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70a129-de03-4d50-8cf3-6235d9ee608a admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:43.044620 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3802f-511a-4f17-86b3-682c03b88b38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:43.046160 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3802f-511a-4f17-86b3-682c03b88b38 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:43.058378 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1004/2027] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:24:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:24:43.067406 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70a129-de03-4d50-8cf3-6235d9ee608a admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:43.075868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d1934-84fb-4c6b-960b-f3a14eadb7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:43.077571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d1934-84fb-4c6b-960b-f3a14eadb7a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:43.078070 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d1934-84fb-4c6b-960b-f3a14eadb7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:43.078562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d1934-84fb-4c6b-960b-f3a14eadb7a0 admin admin] PATH_INFO: `/v3/projects/9b23efc8cd0f45f58d7cfc8927a9cb6b/users/82b6d2b0b3124d89b77323521837f533/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:43.082126 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d1934-84fb-4c6b-960b-f3a14eadb7a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b23efc8cd0f45f58d7cfc8927a9cb6b, user_id=82b6d2b0b3124d89b77323521837f533, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:43.087536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d1934-84fb-4c6b-960b-f3a14eadb7a0 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:43.103777 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1024/2028] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:24:43 2022] PUT /identity/v3/projects/9b23efc8cd0f45f58d7cfc8927a9cb6b/users/82b6d2b0b3124d89b77323521837f533/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:24:43.115456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0907bb-62d5-4b36-92b8-8eebf4771f66 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:43.115756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0907bb-62d5-4b36-92b8-8eebf4771f66 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:43.116074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0907bb-62d5-4b36-92b8-8eebf4771f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:43.148300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-5a0907bb-62d5-4b36-92b8-8eebf4771f66 None None] MFA Rules not processed for user `82b6d2b0b3124d89b77323521837f533`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:43.149838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5a0907bb-62d5-4b36-92b8-8eebf4771f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:43.245288 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1005/2029] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:43.256889 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d1934-84fb-4c6b-960b-f3a14eadb7a0 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:43.258683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-874d1934-84fb-4c6b-960b-f3a14eadb7a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:43.320294 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d1934-84fb-4c6b-960b-f3a14eadb7a0 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:43.325941 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcda5f-d8cd-45e3-83ed-13a3f3ecabf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:43.326641 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcda5f-d8cd-45e3-83ed-13a3f3ecabf8 service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:43.326919 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcda5f-d8cd-45e3-83ed-13a3f3ecabf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:43.327195 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcda5f-d8cd-45e3-83ed-13a3f3ecabf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:43.337695 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcda5f-d8cd-45e3-83ed-13a3f3ecabf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:43.339312 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcda5f-d8cd-45e3-83ed-13a3f3ecabf8 service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:43.349675 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1025/2030] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:24:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:24:43.560748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0907bb-62d5-4b36-92b8-8eebf4771f66 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:43.570763 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0907bb-62d5-4b36-92b8-8eebf4771f66 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:43.574931 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830f16b-a0c7-4669-8a61-0d3c136e406b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:43.575825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830f16b-a0c7-4669-8a61-0d3c136e406b service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:43.576212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830f16b-a0c7-4669-8a61-0d3c136e406b service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:43.576559 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830f16b-a0c7-4669-8a61-0d3c136e406b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:43.578733 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcda5f-d8cd-45e3-83ed-13a3f3ecabf8 service cinder] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:43.579204 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8830f16b-a0c7-4669-8a61-0d3c136e406b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:43.580851 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-b9bcda5f-d8cd-45e3-83ed-13a3f3ecabf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:43.594639 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:43.649680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:43.661886 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830f16b-a0c7-4669-8a61-0d3c136e406b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:43.663387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830f16b-a0c7-4669-8a61-0d3c136e406b service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:43.665486 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcda5f-d8cd-45e3-83ed-13a3f3ecabf8 service cinder] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:43.670877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227486c6-dc49-4014-905c-917022991717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:43.672096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227486c6-dc49-4014-905c-917022991717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:43.672096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227486c6-dc49-4014-905c-917022991717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:43.672363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227486c6-dc49-4014-905c-917022991717 admin admin] PATH_INFO: `/v3/projects/3daad4aa72eb4e9e8bd5e802e80752b0` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:43.673765 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227486c6-dc49-4014-905c-917022991717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3daad4aa72eb4e9e8bd5e802e80752b0)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:43.677711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1006/2031] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:24:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:24:43.677867 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227486c6-dc49-4014-905c-917022991717 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:43.834060 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-227486c6-dc49-4014-905c-917022991717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3daad4aa72eb4e9e8bd5e802e80752b0', 'request_id': 'req-227486c6-dc49-4014-905c-917022991717'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:43.907864 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-227486c6-dc49-4014-905c-917022991717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3daad4aa72eb4e9e8bd5e802e80752b0', 'request_id': 'req-227486c6-dc49-4014-905c-917022991717'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:43.915036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-227486c6-dc49-4014-905c-917022991717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3daad4aa72eb4e9e8bd5e802e80752b0', 'request_id': 'req-227486c6-dc49-4014-905c-917022991717'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:43.929439 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-227486c6-dc49-4014-905c-917022991717 admin admin] The token cache is being invalidate because project 3daad4aa72eb4e9e8bd5e802e80752b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:24:43.929951 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-227486c6-dc49-4014-905c-917022991717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:43.930771 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-227486c6-dc49-4014-905c-917022991717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:43.932858 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1026/2032] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:24:43 2022] DELETE /identity/v3/projects/3daad4aa72eb4e9e8bd5e802e80752b0 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:24:43.938049 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d50e1-f2fd-4327-8531-be14ceea66d2 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:43.938343 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d50e1-f2fd-4327-8531-be14ceea66d2 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:43.942939 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d50e1-f2fd-4327-8531-be14ceea66d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:43.957346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-1d7d50e1-f2fd-4327-8531-be14ceea66d2 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:43.958552 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1d7d50e1-f2fd-4327-8531-be14ceea66d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:44.022319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1007/2033] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:44.031821 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f6359-524f-417b-a76d-10d1814a4a10 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:44.032173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f6359-524f-417b-a76d-10d1814a4a10 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:44.032413 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f6359-524f-417b-a76d-10d1814a4a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:44.051572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-ab5f6359-524f-417b-a76d-10d1814a4a10 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:44.052848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-ab5f6359-524f-417b-a76d-10d1814a4a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:44.061384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1027/2034] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:44.065821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d50e1-f2fd-4327-8531-be14ceea66d2 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:44.077928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d50e1-f2fd-4327-8531-be14ceea66d2 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:44.084026 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477b557-6192-461c-85d9-bcdb92455244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:44.084768 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477b557-6192-461c-85d9-bcdb92455244 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:44.085034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477b557-6192-461c-85d9-bcdb92455244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:44.086897 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477b557-6192-461c-85d9-bcdb92455244 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:44.086897 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477b557-6192-461c-85d9-bcdb92455244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:24:44.086897 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477b557-6192-461c-85d9-bcdb92455244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:44.088729 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477b557-6192-461c-85d9-bcdb92455244 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:44.104606 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1008/2035] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:24:44.110097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f6359-524f-417b-a76d-10d1814a4a10 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:44.120377 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f6359-524f-417b-a76d-10d1814a4a10 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:44.129788 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879d70f-26a1-4fc0-aa0c-16c39082ed22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:44.130841 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879d70f-26a1-4fc0-aa0c-16c39082ed22 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:44.131143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879d70f-26a1-4fc0-aa0c-16c39082ed22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:44.133618 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879d70f-26a1-4fc0-aa0c-16c39082ed22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:44.133618 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879d70f-26a1-4fc0-aa0c-16c39082ed22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:44.135474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879d70f-26a1-4fc0-aa0c-16c39082ed22 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:44.270985 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477b557-6192-461c-85d9-bcdb92455244 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:44.277643 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d477b557-6192-461c-85d9-bcdb92455244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:44.289694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1028/2036] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:24:44 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:24:44.291220 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477b557-6192-461c-85d9-bcdb92455244 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:44.293903 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879d70f-26a1-4fc0-aa0c-16c39082ed22 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:44.366433 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba064ba-f774-45e6-a572-b0005b936adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:44.367924 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba064ba-f774-45e6-a572-b0005b936adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:44.368151 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba064ba-f774-45e6-a572-b0005b936adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:44.368409 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba064ba-f774-45e6-a572-b0005b936adb admin admin] PATH_INFO: `/v3/users/5ed5ebc99ffd4426966230c18a73f91c` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:44.369742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba064ba-f774-45e6-a572-b0005b936adb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ed5ebc99ffd4426966230c18a73f91c)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:44.371965 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba064ba-f774-45e6-a572-b0005b936adb admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:44.399181 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879d70f-26a1-4fc0-aa0c-16c39082ed22 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:44.404281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753c866-fb82-448b-b4f1-190cfb5a9596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:44.404963 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753c866-fb82-448b-b4f1-190cfb5a9596 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:44.405273 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753c866-fb82-448b-b4f1-190cfb5a9596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:44.405546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753c866-fb82-448b-b4f1-190cfb5a9596 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:44.406256 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753c866-fb82-448b-b4f1-190cfb5a9596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:44.408231 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753c866-fb82-448b-b4f1-190cfb5a9596 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:44.514644 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:44.523515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1029/2037] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:24:44 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:24:44.524667 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753c866-fb82-448b-b4f1-190cfb5a9596 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:44.534656 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753c866-fb82-448b-b4f1-190cfb5a9596 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:44.539852 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1738de6-48da-4b6a-980e-3ab6e39f5adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:44.540596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1738de6-48da-4b6a-980e-3ab6e39f5adf admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:44.540880 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1738de6-48da-4b6a-980e-3ab6e39f5adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:44.541153 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1738de6-48da-4b6a-980e-3ab6e39f5adf admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:44.541894 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1738de6-48da-4b6a-980e-3ab6e39f5adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:44.543498 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1738de6-48da-4b6a-980e-3ab6e39f5adf admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:44.554598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1030/2038] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:24:44.559107 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1738de6-48da-4b6a-980e-3ab6e39f5adf admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:44.568737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1738de6-48da-4b6a-980e-3ab6e39f5adf admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:44.573543 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f313e86-b291-4bbf-a2bf-f4795abc149c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:44.574208 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f313e86-b291-4bbf-a2bf-f4795abc149c admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:44.574490 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f313e86-b291-4bbf-a2bf-f4795abc149c admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:44.574762 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f313e86-b291-4bbf-a2bf-f4795abc149c admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:44.575470 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f313e86-b291-4bbf-a2bf-f4795abc149c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:44.577071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f313e86-b291-4bbf-a2bf-f4795abc149c admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:44.587005 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1031/2039] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:24:44.591003 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f313e86-b291-4bbf-a2bf-f4795abc149c admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:44.600953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f313e86-b291-4bbf-a2bf-f4795abc149c admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:44.607458 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47512b2c-a694-4c6f-88d8-3a647abe3197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:44.608392 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47512b2c-a694-4c6f-88d8-3a647abe3197 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:44.608702 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47512b2c-a694-4c6f-88d8-3a647abe3197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:44.608978 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47512b2c-a694-4c6f-88d8-3a647abe3197 admin admin] PATH_INFO: `/v3/projects/5a4caacda202479cb050fa46737cb0b6/users/7b903da4712b47b885b737c85038e1e9/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:44.620335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-bba064ba-f774-45e6-a572-b0005b936adb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ed5ebc99ffd4426966230c18a73f91c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:44.624696 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47512b2c-a694-4c6f-88d8-3a647abe3197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4caacda202479cb050fa46737cb0b6, user_id=7b903da4712b47b885b737c85038e1e9, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:44.627388 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47512b2c-a694-4c6f-88d8-3a647abe3197 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:44.628072 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-bba064ba-f774-45e6-a572-b0005b936adb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ed5ebc99ffd4426966230c18a73f91c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:44.628841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-bba064ba-f774-45e6-a572-b0005b936adb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ed5ebc99ffd4426966230c18a73f91c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:44.629483 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-bba064ba-f774-45e6-a572-b0005b936adb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ed5ebc99ffd4426966230c18a73f91c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:44.643808 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-bba064ba-f774-45e6-a572-b0005b936adb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ed5ebc99ffd4426966230c18a73f91c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:44.646993 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:44.703387 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1032/2040] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:24:44 2022] PUT /identity/v3/projects/5a4caacda202479cb050fa46737cb0b6/users/7b903da4712b47b885b737c85038e1e9/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:24:44.716033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5185f-00e1-4a98-aff0-32886869272d None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:44.716509 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5185f-00e1-4a98-aff0-32886869272d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:44.716605 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5185f-00e1-4a98-aff0-32886869272d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:44.735105 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1009/2041] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:24:44 2022] DELETE /identity/v3/users/5ed5ebc99ffd4426966230c18a73f91c => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:24:44.740176 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f45f0-e558-44c6-8316-756bfb8195b6 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:44.740176 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f45f0-e558-44c6-8316-756bfb8195b6 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:44.740478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f45f0-e558-44c6-8316-756bfb8195b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:44.750553 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-4be5185f-00e1-4a98-aff0-32886869272d None None] MFA Rules not processed for user `7b903da4712b47b885b737c85038e1e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:44.751851 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-4be5185f-00e1-4a98-aff0-32886869272d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:44.761559 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-4c3f45f0-e558-44c6-8316-756bfb8195b6 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:44.763011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4c3f45f0-e558-44c6-8316-756bfb8195b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:44.828727 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1033/2042] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:44.842927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1010/2043] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:24:44.843835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5185f-00e1-4a98-aff0-32886869272d None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:44.845241 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-4be5185f-00e1-4a98-aff0-32886869272d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:44.854257 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f45f0-e558-44c6-8316-756bfb8195b6 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:44.855912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4c3f45f0-e558-44c6-8316-756bfb8195b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:44.904285 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5185f-00e1-4a98-aff0-32886869272d None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:44.908750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994aa4c7-a2fd-4169-b8f5-1ac85075c6da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:44.909402 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aa4c7-a2fd-4169-b8f5-1ac85075c6da service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:44.909688 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aa4c7-a2fd-4169-b8f5-1ac85075c6da service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:44.909963 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aa4c7-a2fd-4169-b8f5-1ac85075c6da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:44.915105 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f45f0-e558-44c6-8316-756bfb8195b6 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:44.918873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af2865-6316-403f-8bf2-eda45573b4f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:44.919094 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994aa4c7-a2fd-4169-b8f5-1ac85075c6da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:44.919606 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af2865-6316-403f-8bf2-eda45573b4f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:44.919792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af2865-6316-403f-8bf2-eda45573b4f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:44.920100 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af2865-6316-403f-8bf2-eda45573b4f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:44.920666 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994aa4c7-a2fd-4169-b8f5-1ac85075c6da service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:44.929483 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af2865-6316-403f-8bf2-eda45573b4f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:44.930447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1034/2044] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:24:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:24:44.931915 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af2865-6316-403f-8bf2-eda45573b4f5 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:44.944047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1011/2045] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:24:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:24:45.453723 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994aa4c7-a2fd-4169-b8f5-1ac85075c6da service cinder] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:45.455511 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-994aa4c7-a2fd-4169-b8f5-1ac85075c6da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:45.471386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994aa4c7-a2fd-4169-b8f5-1ac85075c6da service cinder] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:45.476377 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b173e-74b5-470c-aff3-3b0133933ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:45.477385 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b173e-74b5-470c-aff3-3b0133933ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:45.477891 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b173e-74b5-470c-aff3-3b0133933ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:45.478242 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b173e-74b5-470c-aff3-3b0133933ed3 admin admin] PATH_INFO: `/v3/projects/d4ddd573ceae4849a5b5220b5e106834` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:45.479557 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b173e-74b5-470c-aff3-3b0133933ed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4ddd573ceae4849a5b5220b5e106834)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:45.481542 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b173e-74b5-470c-aff3-3b0133933ed3 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:45.641493 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:45.647497 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-277b173e-74b5-470c-aff3-3b0133933ed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4ddd573ceae4849a5b5220b5e106834', 'request_id': 'req-277b173e-74b5-470c-aff3-3b0133933ed3'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:45.764659 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-277b173e-74b5-470c-aff3-3b0133933ed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4ddd573ceae4849a5b5220b5e106834', 'request_id': 'req-277b173e-74b5-470c-aff3-3b0133933ed3'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:45.772191 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-277b173e-74b5-470c-aff3-3b0133933ed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4ddd573ceae4849a5b5220b5e106834', 'request_id': 'req-277b173e-74b5-470c-aff3-3b0133933ed3'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:45.785485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-277b173e-74b5-470c-aff3-3b0133933ed3 admin admin] The token cache is being invalidate because project d4ddd573ceae4849a5b5220b5e106834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:24:45.785864 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-277b173e-74b5-470c-aff3-3b0133933ed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:45.786700 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-277b173e-74b5-470c-aff3-3b0133933ed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:45.789122 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1035/2046] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:24:45 2022] DELETE /identity/v3/projects/d4ddd573ceae4849a5b5220b5e106834 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:45.793140 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af2865-6316-403f-8bf2-eda45573b4f5 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:45.804131 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af2865-6316-403f-8bf2-eda45573b4f5 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:45.868240 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f5eef-368f-45dc-afbc-c0c12ed9ec49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:45.869258 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f5eef-368f-45dc-afbc-c0c12ed9ec49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:45.869536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f5eef-368f-45dc-afbc-c0c12ed9ec49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:45.869818 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f5eef-368f-45dc-afbc-c0c12ed9ec49 admin admin] PATH_INFO: `/v3/users/82b6d2b0b3124d89b77323521837f533` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:45.871031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f5eef-368f-45dc-afbc-c0c12ed9ec49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82b6d2b0b3124d89b77323521837f533)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:45.873079 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f5eef-368f-45dc-afbc-c0c12ed9ec49 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:46.116114 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:DELETE=6,keystone:SELECT=94 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:46.123884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-729f5eef-368f-45dc-afbc-c0c12ed9ec49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82b6d2b0b3124d89b77323521837f533'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:46.131423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-729f5eef-368f-45dc-afbc-c0c12ed9ec49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82b6d2b0b3124d89b77323521837f533'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:46.132501 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-729f5eef-368f-45dc-afbc-c0c12ed9ec49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82b6d2b0b3124d89b77323521837f533'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:46.133297 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-729f5eef-368f-45dc-afbc-c0c12ed9ec49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82b6d2b0b3124d89b77323521837f533'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:46.146796 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-729f5eef-368f-45dc-afbc-c0c12ed9ec49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82b6d2b0b3124d89b77323521837f533'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:46.234539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1012/2047] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:24:45 2022] DELETE /identity/v3/users/82b6d2b0b3124d89b77323521837f533 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:46.708459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b173e-74b5-470c-aff3-3b0133933ed3 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:46.710569 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-277b173e-74b5-470c-aff3-3b0133933ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:46.728952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b173e-74b5-470c-aff3-3b0133933ed3 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:46.822967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47c359-b37a-4a03-96ab-8cd240588210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:46.823923 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47c359-b37a-4a03-96ab-8cd240588210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:46.824301 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47c359-b37a-4a03-96ab-8cd240588210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:46.824665 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47c359-b37a-4a03-96ab-8cd240588210 admin admin] PATH_INFO: `/v3/projects/9b23efc8cd0f45f58d7cfc8927a9cb6b` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:46.826199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d47c359-b37a-4a03-96ab-8cd240588210 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b23efc8cd0f45f58d7cfc8927a9cb6b)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:46.828774 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d47c359-b37a-4a03-96ab-8cd240588210 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:46.965949 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-5d47c359-b37a-4a03-96ab-8cd240588210 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b23efc8cd0f45f58d7cfc8927a9cb6b', 'request_id': 'req-5d47c359-b37a-4a03-96ab-8cd240588210'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:47.061695 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-5d47c359-b37a-4a03-96ab-8cd240588210 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b23efc8cd0f45f58d7cfc8927a9cb6b', 'request_id': 'req-5d47c359-b37a-4a03-96ab-8cd240588210'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:47.068633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-5d47c359-b37a-4a03-96ab-8cd240588210 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b23efc8cd0f45f58d7cfc8927a9cb6b', 'request_id': 'req-5d47c359-b37a-4a03-96ab-8cd240588210'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:47.081802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-5d47c359-b37a-4a03-96ab-8cd240588210 admin admin] The token cache is being invalidate because project 9b23efc8cd0f45f58d7cfc8927a9cb6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:24:47.082099 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-5d47c359-b37a-4a03-96ab-8cd240588210 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:47.082769 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-5d47c359-b37a-4a03-96ab-8cd240588210 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:47.084381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1036/2048] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:24:46 2022] DELETE /identity/v3/projects/9b23efc8cd0f45f58d7cfc8927a9cb6b => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:47.090189 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b29250-863a-4c17-a75e-62a1ff51ae3b None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:47.090679 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b29250-863a-4c17-a75e-62a1ff51ae3b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:47.090794 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b29250-863a-4c17-a75e-62a1ff51ae3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:47.109461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f5b29250-863a-4c17-a75e-62a1ff51ae3b None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:47.110857 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f5b29250-863a-4c17-a75e-62a1ff51ae3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:47.174375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1013/2049] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:47.185071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83390f26-a60c-462e-879a-957833a5eb49 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:47.185422 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83390f26-a60c-462e-879a-957833a5eb49 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:47.190833 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83390f26-a60c-462e-879a-957833a5eb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:47.204762 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-83390f26-a60c-462e-879a-957833a5eb49 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:47.206002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-83390f26-a60c-462e-879a-957833a5eb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:47.217279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1037/2050] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:47.218789 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b29250-863a-4c17-a75e-62a1ff51ae3b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:47.228287 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b29250-863a-4c17-a75e-62a1ff51ae3b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:47.232836 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626380ac-cd40-42ee-a009-8de8feb56f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:47.233480 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626380ac-cd40-42ee-a009-8de8feb56f97 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:47.233838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626380ac-cd40-42ee-a009-8de8feb56f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:47.234119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626380ac-cd40-42ee-a009-8de8feb56f97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:47.234868 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626380ac-cd40-42ee-a009-8de8feb56f97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:24:47.235175 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626380ac-cd40-42ee-a009-8de8feb56f97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:47.236882 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626380ac-cd40-42ee-a009-8de8feb56f97 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:47.249262 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1014/2051] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:24:47.253720 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83390f26-a60c-462e-879a-957833a5eb49 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:47.264069 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83390f26-a60c-462e-879a-957833a5eb49 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:47.271443 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5132ddb-5feb-4cb7-a00a-45880d11f57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:47.271443 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5132ddb-5feb-4cb7-a00a-45880d11f57d admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:47.271443 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5132ddb-5feb-4cb7-a00a-45880d11f57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:47.271443 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5132ddb-5feb-4cb7-a00a-45880d11f57d admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:47.272166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5132ddb-5feb-4cb7-a00a-45880d11f57d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:47.273203 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5132ddb-5feb-4cb7-a00a-45880d11f57d admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:47.358058 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1038/2052] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:24:47 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:24:47.359298 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626380ac-cd40-42ee-a009-8de8feb56f97 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:47.370086 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626380ac-cd40-42ee-a009-8de8feb56f97 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:47.427061 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e211e-b76c-4f49-857e-2346d11cad0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:47.427739 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e211e-b76c-4f49-857e-2346d11cad0b admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:47.428050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e211e-b76c-4f49-857e-2346d11cad0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:47.428330 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e211e-b76c-4f49-857e-2346d11cad0b admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:47.429033 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e211e-b76c-4f49-857e-2346d11cad0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:47.431515 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e211e-b76c-4f49-857e-2346d11cad0b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:47.541010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1015/2053] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:24:47 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:24:47.542424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5132ddb-5feb-4cb7-a00a-45880d11f57d admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:47.555702 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5132ddb-5feb-4cb7-a00a-45880d11f57d admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:47.560832 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f3542-4d56-4584-80a0-7532cc5e6b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:47.561500 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f3542-4d56-4584-80a0-7532cc5e6b10 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:47.561782 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f3542-4d56-4584-80a0-7532cc5e6b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:47.562058 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f3542-4d56-4584-80a0-7532cc5e6b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:47.562782 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f3542-4d56-4584-80a0-7532cc5e6b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:47.564558 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f3542-4d56-4584-80a0-7532cc5e6b10 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:47.575945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1039/2054] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:24:47.580717 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e211e-b76c-4f49-857e-2346d11cad0b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:47.592336 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e211e-b76c-4f49-857e-2346d11cad0b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:47.597914 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a8538-b764-49a4-8301-150052b1ebbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:47.598661 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a8538-b764-49a4-8301-150052b1ebbc admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:47.599012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a8538-b764-49a4-8301-150052b1ebbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:47.599353 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a8538-b764-49a4-8301-150052b1ebbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:47.600187 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a8538-b764-49a4-8301-150052b1ebbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:47.602391 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a8538-b764-49a4-8301-150052b1ebbc admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:47.613228 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1016/2055] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:24:47.617322 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f3542-4d56-4584-80a0-7532cc5e6b10 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:47.628222 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f3542-4d56-4584-80a0-7532cc5e6b10 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:47.634335 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f729a-44a8-4cf6-b47f-66466add9e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:47.635138 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f729a-44a8-4cf6-b47f-66466add9e11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:47.635363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f729a-44a8-4cf6-b47f-66466add9e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:47.635657 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f729a-44a8-4cf6-b47f-66466add9e11 admin admin] PATH_INFO: `/v3/projects/f5c1b4d4cb2e4720997779ba0624ae4e/users/35118295a16f4a148cf8892afbe64b75/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:47.651380 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f729a-44a8-4cf6-b47f-66466add9e11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5c1b4d4cb2e4720997779ba0624ae4e, user_id=35118295a16f4a148cf8892afbe64b75, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:47.654063 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f729a-44a8-4cf6-b47f-66466add9e11 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:47.657111 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:47.708466 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1040/2056] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:24:47 2022] PUT /identity/v3/projects/f5c1b4d4cb2e4720997779ba0624ae4e/users/35118295a16f4a148cf8892afbe64b75/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:47.718935 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c128f0-f383-4d63-a47a-d25f04921bbc None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:47.719230 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c128f0-f383-4d63-a47a-d25f04921bbc None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:47.719510 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c128f0-f383-4d63-a47a-d25f04921bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:47.748628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-a2c128f0-f383-4d63-a47a-d25f04921bbc None None] MFA Rules not processed for user `35118295a16f4a148cf8892afbe64b75`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:47.750049 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a2c128f0-f383-4d63-a47a-d25f04921bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:47.762708 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:47.816761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1017/2057] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:47.821669 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f729a-44a8-4cf6-b47f-66466add9e11 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:47.887078 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f729a-44a8-4cf6-b47f-66466add9e11 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:47.892412 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedb3a6-6ece-433d-9b22-a1f299320e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:47.893181 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedb3a6-6ece-433d-9b22-a1f299320e74 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:47.893532 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedb3a6-6ece-433d-9b22-a1f299320e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:47.893818 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedb3a6-6ece-433d-9b22-a1f299320e74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:47.895463 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedb3a6-6ece-433d-9b22-a1f299320e74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:47.897517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedb3a6-6ece-433d-9b22-a1f299320e74 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:47.979096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1041/2058] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:24:47 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:24:47.983202 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c128f0-f383-4d63-a47a-d25f04921bbc None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:47.994029 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c128f0-f383-4d63-a47a-d25f04921bbc None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:48.061357 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d07de6-fd23-4d0e-9ca5-c6095338f1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:48.062284 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d07de6-fd23-4d0e-9ca5-c6095338f1bf admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:48.062580 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d07de6-fd23-4d0e-9ca5-c6095338f1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:48.062863 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d07de6-fd23-4d0e-9ca5-c6095338f1bf admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:48.063761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d07de6-fd23-4d0e-9ca5-c6095338f1bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:48.065816 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d07de6-fd23-4d0e-9ca5-c6095338f1bf admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:48.083949 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedb3a6-6ece-433d-9b22-a1f299320e74 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:48.085718 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-7aedb3a6-6ece-433d-9b22-a1f299320e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:48.098897 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedb3a6-6ece-433d-9b22-a1f299320e74 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:48.104839 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b401e3-3a62-47c4-8a83-0949ca5395a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:48.105818 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b401e3-3a62-47c4-8a83-0949ca5395a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:48.106099 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b401e3-3a62-47c4-8a83-0949ca5395a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:48.106371 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b401e3-3a62-47c4-8a83-0949ca5395a1 admin admin] PATH_INFO: `/v3/users/7b903da4712b47b885b737c85038e1e9` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:48.107656 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b401e3-3a62-47c4-8a83-0949ca5395a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b903da4712b47b885b737c85038e1e9)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:48.109647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b401e3-3a62-47c4-8a83-0949ca5395a1 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:48.148267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1018/2059] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:24:47 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:24:48.152746 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d07de6-fd23-4d0e-9ca5-c6095338f1bf admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:48.162948 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d07de6-fd23-4d0e-9ca5-c6095338f1bf admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:48.168398 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460035c-54d2-4b0f-a75d-d590e2c65e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:48.169162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460035c-54d2-4b0f-a75d-d590e2c65e53 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:48.169446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460035c-54d2-4b0f-a75d-d590e2c65e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:48.169725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460035c-54d2-4b0f-a75d-d590e2c65e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:48.170458 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460035c-54d2-4b0f-a75d-d590e2c65e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:48.172144 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460035c-54d2-4b0f-a75d-d590e2c65e53 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:48.183341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1019/2060] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:24:48.187643 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460035c-54d2-4b0f-a75d-d590e2c65e53 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:48.197867 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460035c-54d2-4b0f-a75d-d590e2c65e53 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:48.202586 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731d331-74ad-44c1-ba2a-5f4fda273de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:48.203821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731d331-74ad-44c1-ba2a-5f4fda273de6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:48.204015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731d331-74ad-44c1-ba2a-5f4fda273de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:48.204347 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731d331-74ad-44c1-ba2a-5f4fda273de6 admin admin] PATH_INFO: `/v3/projects/40f6c5f670734839bc756175119610c2/users/8ee3d8f9f25c432299ad774bfe02ae9c/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:48.220912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731d331-74ad-44c1-ba2a-5f4fda273de6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40f6c5f670734839bc756175119610c2, user_id=8ee3d8f9f25c432299ad774bfe02ae9c, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:48.224174 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731d331-74ad-44c1-ba2a-5f4fda273de6 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:48.337668 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1020/2061] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:24:48 2022] PUT /identity/v3/projects/40f6c5f670734839bc756175119610c2/users/8ee3d8f9f25c432299ad774bfe02ae9c/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:24:48.341442 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731d331-74ad-44c1-ba2a-5f4fda273de6 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:48.363474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-47b401e3-3a62-47c4-8a83-0949ca5395a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b903da4712b47b885b737c85038e1e9'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:48.377374 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-47b401e3-3a62-47c4-8a83-0949ca5395a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b903da4712b47b885b737c85038e1e9'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:48.386257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-47b401e3-3a62-47c4-8a83-0949ca5395a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b903da4712b47b885b737c85038e1e9'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:48.387117 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-47b401e3-3a62-47c4-8a83-0949ca5395a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b903da4712b47b885b737c85038e1e9'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:48.387797 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-47b401e3-3a62-47c4-8a83-0949ca5395a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b903da4712b47b885b737c85038e1e9'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:48.416458 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731d331-74ad-44c1-ba2a-5f4fda273de6 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:48.421284 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac7a56-b673-4fed-bab5-19ff6b608fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:48.421970 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac7a56-b673-4fed-bab5-19ff6b608fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:48.422258 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac7a56-b673-4fed-bab5-19ff6b608fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:48.422524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac7a56-b673-4fed-bab5-19ff6b608fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:48.423264 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac7a56-b673-4fed-bab5-19ff6b608fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:48.425005 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac7a56-b673-4fed-bab5-19ff6b608fd5 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:48.436414 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1021/2062] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:24:48.440851 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac7a56-b673-4fed-bab5-19ff6b608fd5 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:48.442645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9aac7a56-b673-4fed-bab5-19ff6b608fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:48.451601 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:48.463179 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac7a56-b673-4fed-bab5-19ff6b608fd5 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:48.468631 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0b00a-f0d1-4876-bcb9-92a841206f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:48.470627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0b00a-f0d1-4876-bcb9-92a841206f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:48.470627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0b00a-f0d1-4876-bcb9-92a841206f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:48.471169 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0b00a-f0d1-4876-bcb9-92a841206f09 admin admin] PATH_INFO: `/v3/projects/40f6c5f670734839bc756175119610c2/users/8ee3d8f9f25c432299ad774bfe02ae9c/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:48.473931 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0b00a-f0d1-4876-bcb9-92a841206f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40f6c5f670734839bc756175119610c2, user_id=8ee3d8f9f25c432299ad774bfe02ae9c, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:48.474874 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1042/2063] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:24:48 2022] DELETE /identity/v3/users/7b903da4712b47b885b737c85038e1e9 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:24:48.477545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0b00a-f0d1-4876-bcb9-92a841206f09 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:48.479779 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112fcd2-191e-48a3-b8a1-b5887072020d None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:48.480214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112fcd2-191e-48a3-b8a1-b5887072020d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:48.480824 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112fcd2-191e-48a3-b8a1-b5887072020d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:48.491070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1022/2064] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:24:48 2022] PUT /identity/v3/projects/40f6c5f670734839bc756175119610c2/users/8ee3d8f9f25c432299ad774bfe02ae9c/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:48.503217 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191468d2-7ba1-4fe6-9ff7-bfbbb6a7f078 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:48.503519 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191468d2-7ba1-4fe6-9ff7-bfbbb6a7f078 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:48.503796 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191468d2-7ba1-4fe6-9ff7-bfbbb6a7f078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:48.504692 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-a112fcd2-191e-48a3-b8a1-b5887072020d None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:48.506290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-a112fcd2-191e-48a3-b8a1-b5887072020d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:48.533125 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-191468d2-7ba1-4fe6-9ff7-bfbbb6a7f078 None None] MFA Rules not processed for user `8ee3d8f9f25c432299ad774bfe02ae9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:48.534153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-191468d2-7ba1-4fe6-9ff7-bfbbb6a7f078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:48.566418 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:48.591334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1043/2065] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:24:48.600496 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112fcd2-191e-48a3-b8a1-b5887072020d None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:48.612134 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-a112fcd2-191e-48a3-b8a1-b5887072020d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:48.619072 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1023/2066] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:24:48.630554 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191468d2-7ba1-4fe6-9ff7-bfbbb6a7f078 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:48.632063 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-191468d2-7ba1-4fe6-9ff7-bfbbb6a7f078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:48.674657 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112fcd2-191e-48a3-b8a1-b5887072020d None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:48.678774 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de8704-d0e9-4bc2-ae81-805277665610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:48.679489 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de8704-d0e9-4bc2-ae81-805277665610 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:48.679805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de8704-d0e9-4bc2-ae81-805277665610 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:48.680113 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de8704-d0e9-4bc2-ae81-805277665610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:48.692038 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de8704-d0e9-4bc2-ae81-805277665610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:48.693577 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de8704-d0e9-4bc2-ae81-805277665610 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:48.706501 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191468d2-7ba1-4fe6-9ff7-bfbbb6a7f078 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:48.714073 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1044/2067] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:24:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:24:48.716095 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8ba73-d7a5-4388-8946-ebb495d9a226 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:48.716777 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8ba73-d7a5-4388-8946-ebb495d9a226 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:48.717129 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8ba73-d7a5-4388-8946-ebb495d9a226 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:48.717406 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8ba73-d7a5-4388-8946-ebb495d9a226 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:48.719489 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b4e8ba73-d7a5-4388-8946-ebb495d9a226 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:48.811469 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8ba73-d7a5-4388-8946-ebb495d9a226 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:48.813020 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8ba73-d7a5-4388-8946-ebb495d9a226 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:48.823524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1024/2068] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:24:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:24:49.244848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de8704-d0e9-4bc2-ae81-805277665610 service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:49.247282 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-03de8704-d0e9-4bc2-ae81-805277665610 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:49.262860 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de8704-d0e9-4bc2-ae81-805277665610 service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:49.268137 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f3c4d-3a91-4aac-ad89-fc43527ccd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:49.270455 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f3c4d-3a91-4aac-ad89-fc43527ccd8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:49.270892 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f3c4d-3a91-4aac-ad89-fc43527ccd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:49.271530 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f3c4d-3a91-4aac-ad89-fc43527ccd8e admin admin] PATH_INFO: `/v3/projects/5a4caacda202479cb050fa46737cb0b6` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:49.272790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f3c4d-3a91-4aac-ad89-fc43527ccd8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a4caacda202479cb050fa46737cb0b6)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:49.275419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f3c4d-3a91-4aac-ad89-fc43527ccd8e admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:49.455814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-549f3c4d-3a91-4aac-ad89-fc43527ccd8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a4caacda202479cb050fa46737cb0b6', 'request_id': 'req-549f3c4d-3a91-4aac-ad89-fc43527ccd8e'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:49.541770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-549f3c4d-3a91-4aac-ad89-fc43527ccd8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a4caacda202479cb050fa46737cb0b6', 'request_id': 'req-549f3c4d-3a91-4aac-ad89-fc43527ccd8e'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:49.547900 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-549f3c4d-3a91-4aac-ad89-fc43527ccd8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a4caacda202479cb050fa46737cb0b6', 'request_id': 'req-549f3c4d-3a91-4aac-ad89-fc43527ccd8e'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:49.563023 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-549f3c4d-3a91-4aac-ad89-fc43527ccd8e admin admin] The token cache is being invalidate because project 5a4caacda202479cb050fa46737cb0b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:24:49.563349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-549f3c4d-3a91-4aac-ad89-fc43527ccd8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:49.563981 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-549f3c4d-3a91-4aac-ad89-fc43527ccd8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:49.565554 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1045/2069] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:24:49 2022] DELETE /identity/v3/projects/5a4caacda202479cb050fa46737cb0b6 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:49.576196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09209886-5f6a-4fd1-ab91-68c3c4a4bd37 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:49.576602 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09209886-5f6a-4fd1-ab91-68c3c4a4bd37 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:49.576750 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09209886-5f6a-4fd1-ab91-68c3c4a4bd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:49.614487 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-09209886-5f6a-4fd1-ab91-68c3c4a4bd37 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:49.615679 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-09209886-5f6a-4fd1-ab91-68c3c4a4bd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:49.638642 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:49.690183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1025/2070] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:49.698968 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06ef8d-38a2-4827-8f01-2a965c3c2fda None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:49.699257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06ef8d-38a2-4827-8f01-2a965c3c2fda None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:49.699532 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06ef8d-38a2-4827-8f01-2a965c3c2fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:49.718325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-8c06ef8d-38a2-4827-8f01-2a965c3c2fda None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:49.719587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-8c06ef8d-38a2-4827-8f01-2a965c3c2fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:49.730564 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1046/2071] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:49.735466 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09209886-5f6a-4fd1-ab91-68c3c4a4bd37 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:49.746505 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09209886-5f6a-4fd1-ab91-68c3c4a4bd37 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:49.753049 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8eb04-f858-485d-9426-100d7474345c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:49.753837 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8eb04-f858-485d-9426-100d7474345c admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:49.754118 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8eb04-f858-485d-9426-100d7474345c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:49.754390 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8eb04-f858-485d-9426-100d7474345c admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:49.755121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8eb04-f858-485d-9426-100d7474345c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:24:49.755424 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8eb04-f858-485d-9426-100d7474345c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:49.757132 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8eb04-f858-485d-9426-100d7474345c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:49.770324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1026/2072] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:24:49.776181 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06ef8d-38a2-4827-8f01-2a965c3c2fda None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:49.784410 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06ef8d-38a2-4827-8f01-2a965c3c2fda None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:49.789869 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888540f-3359-4426-8611-89d1532924f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:49.790570 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888540f-3359-4426-8611-89d1532924f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:49.790851 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888540f-3359-4426-8611-89d1532924f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:49.791380 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888540f-3359-4426-8611-89d1532924f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:49.791968 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888540f-3359-4426-8611-89d1532924f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:49.793922 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888540f-3359-4426-8611-89d1532924f4 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:49.881216 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1047/2073] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:24:49 2022] POST /identity/v3/projects => generated 399 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:24:49.885392 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8eb04-f858-485d-9426-100d7474345c admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:49.896191 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8eb04-f858-485d-9426-100d7474345c admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:49.956044 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fd9ae-c6d8-4917-893d-6c423d265981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:49.956717 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fd9ae-c6d8-4917-893d-6c423d265981 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:49.957001 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fd9ae-c6d8-4917-893d-6c423d265981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:49.957276 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fd9ae-c6d8-4917-893d-6c423d265981 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:49.957976 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035fd9ae-c6d8-4917-893d-6c423d265981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:49.959894 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035fd9ae-c6d8-4917-893d-6c423d265981 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:50.058669 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1027/2074] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:24:49 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:24:50.061252 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888540f-3359-4426-8611-89d1532924f4 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:50.073609 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888540f-3359-4426-8611-89d1532924f4 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:50.079475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fc03c-ac1f-4f56-9ecd-d551b8d7d066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:50.080463 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fc03c-ac1f-4f56-9ecd-d551b8d7d066 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:50.080749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fc03c-ac1f-4f56-9ecd-d551b8d7d066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:50.081023 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fc03c-ac1f-4f56-9ecd-d551b8d7d066 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:50.081765 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fc03c-ac1f-4f56-9ecd-d551b8d7d066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:50.083388 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fc03c-ac1f-4f56-9ecd-d551b8d7d066 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:50.095253 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1048/2075] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:24:50.099386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fd9ae-c6d8-4917-893d-6c423d265981 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:50.109989 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fd9ae-c6d8-4917-893d-6c423d265981 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:50.114664 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ccbb8-0334-41cf-85ac-75c370e257ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:50.115318 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ccbb8-0334-41cf-85ac-75c370e257ce admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:50.115605 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ccbb8-0334-41cf-85ac-75c370e257ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:50.115883 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ccbb8-0334-41cf-85ac-75c370e257ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:50.116688 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ccbb8-0334-41cf-85ac-75c370e257ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:50.118928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ccbb8-0334-41cf-85ac-75c370e257ce admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:50.128936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1028/2076] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:24:50.133134 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fc03c-ac1f-4f56-9ecd-d551b8d7d066 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:50.142997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fc03c-ac1f-4f56-9ecd-d551b8d7d066 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:50.149217 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63fe30-e9dc-4420-acf2-cb19a9530b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:50.150208 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63fe30-e9dc-4420-acf2-cb19a9530b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:50.150616 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63fe30-e9dc-4420-acf2-cb19a9530b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:50.150901 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63fe30-e9dc-4420-acf2-cb19a9530b8a admin admin] PATH_INFO: `/v3/projects/6609861d4955424d876246fb5b8c82b8/users/2eb195a0b03e43b39b1d2d5aaa578c3f/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:50.167943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63fe30-e9dc-4420-acf2-cb19a9530b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6609861d4955424d876246fb5b8c82b8, user_id=2eb195a0b03e43b39b1d2d5aaa578c3f, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:50.170699 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63fe30-e9dc-4420-acf2-cb19a9530b8a admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:50.285241 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1049/2077] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:24:50 2022] PUT /identity/v3/projects/6609861d4955424d876246fb5b8c82b8/users/2eb195a0b03e43b39b1d2d5aaa578c3f/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:50.300140 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb6384-b021-424c-9ba7-b777f4bceea8 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:50.300430 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb6384-b021-424c-9ba7-b777f4bceea8 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:50.300709 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb6384-b021-424c-9ba7-b777f4bceea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:50.327594 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-a7cb6384-b021-424c-9ba7-b777f4bceea8 None None] MFA Rules not processed for user `2eb195a0b03e43b39b1d2d5aaa578c3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:50.328887 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a7cb6384-b021-424c-9ba7-b777f4bceea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:50.403987 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1029/2078] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:50.498384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63fe30-e9dc-4420-acf2-cb19a9530b8a admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:50.500146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5f63fe30-e9dc-4420-acf2-cb19a9530b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:50.521911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:50.607092 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63fe30-e9dc-4420-acf2-cb19a9530b8a admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:50.609326 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973c251-b86d-4eb8-938b-e181cde548da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:50.610249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973c251-b86d-4eb8-938b-e181cde548da service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:50.610690 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973c251-b86d-4eb8-938b-e181cde548da service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:50.611265 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973c251-b86d-4eb8-938b-e181cde548da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:50.623595 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973c251-b86d-4eb8-938b-e181cde548da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:50.625101 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973c251-b86d-4eb8-938b-e181cde548da service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:50.644838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1050/2079] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:24:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:24:52.849203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1f2e0-9a87-40c8-9f2c-201cd29eaaf8 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:52.849679 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1f2e0-9a87-40c8-9f2c-201cd29eaaf8 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:52.849768 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1f2e0-9a87-40c8-9f2c-201cd29eaaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:52.872889 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:52.878775 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-86d1f2e0-9a87-40c8-9f2c-201cd29eaaf8 None None] MFA Rules not processed for user `235042beafd246c5b227b3926098c8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:52.881094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-86d1f2e0-9a87-40c8-9f2c-201cd29eaaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:52.937134 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1030/2080] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jun 2 19:24:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:52.989262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973c251-b86d-4eb8-938b-e181cde548da service cinder] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:52.991408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-a973c251-b86d-4eb8-938b-e181cde548da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:53.084124 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973c251-b86d-4eb8-938b-e181cde548da service cinder] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:53.089869 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869cbd5-24a2-46b4-885e-236de4c2022c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ba0ab9510d49c4ab4c634e82790efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:53.090534 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869cbd5-24a2-46b4-885e-236de4c2022c service swift] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:53.090817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869cbd5-24a2-46b4-885e-236de4c2022c service swift] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:53.091091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869cbd5-24a2-46b4-885e-236de4c2022c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:53.100219 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869cbd5-24a2-46b4-885e-236de4c2022c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:53.101899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869cbd5-24a2-46b4-885e-236de4c2022c service swift] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:53.113380 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1051/2081] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jun 2 19:24:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 19:24:54.475314 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1f2e0-9a87-40c8-9f2c-201cd29eaaf8 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:54.477870 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-86d1f2e0-9a87-40c8-9f2c-201cd29eaaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:54.503501 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1f2e0-9a87-40c8-9f2c-201cd29eaaf8 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:54.512953 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77973650-6673-47be-a1d3-75e0b959753f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:54.514122 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77973650-6673-47be-a1d3-75e0b959753f service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:54.514570 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77973650-6673-47be-a1d3-75e0b959753f service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:54.514989 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77973650-6673-47be-a1d3-75e0b959753f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:54.517113 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-77973650-6673-47be-a1d3-75e0b959753f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:54.639035 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77973650-6673-47be-a1d3-75e0b959753f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:54.641780 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77973650-6673-47be-a1d3-75e0b959753f service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:54.657619 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1031/2082] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:24:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:24:56.994986 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869cbd5-24a2-46b4-885e-236de4c2022c service swift] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:56.996753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5869cbd5-24a2-46b4-885e-236de4c2022c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:57.094416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869cbd5-24a2-46b4-885e-236de4c2022c service swift] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:57.099832 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119995e0-428c-41c7-b4a0-bbf5d30cfc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:57.100975 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119995e0-428c-41c7-b4a0-bbf5d30cfc48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:57.101263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119995e0-428c-41c7-b4a0-bbf5d30cfc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:57.102100 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119995e0-428c-41c7-b4a0-bbf5d30cfc48 admin admin] PATH_INFO: `/v3/users/7be641b806154b2fb419763417fecc38` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:57.103541 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119995e0-428c-41c7-b4a0-bbf5d30cfc48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7be641b806154b2fb419763417fecc38)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:57.105621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119995e0-428c-41c7-b4a0-bbf5d30cfc48 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:57.324191 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-119995e0-428c-41c7-b4a0-bbf5d30cfc48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7be641b806154b2fb419763417fecc38'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:57.327560 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:57.340787 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-119995e0-428c-41c7-b4a0-bbf5d30cfc48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7be641b806154b2fb419763417fecc38'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:57.349001 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-119995e0-428c-41c7-b4a0-bbf5d30cfc48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7be641b806154b2fb419763417fecc38'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:57.349949 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-119995e0-428c-41c7-b4a0-bbf5d30cfc48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7be641b806154b2fb419763417fecc38'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:57.351889 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-119995e0-428c-41c7-b4a0-bbf5d30cfc48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7be641b806154b2fb419763417fecc38'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:57.463716 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1052/2083] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:24:56 2022] DELETE /identity/v3/users/7be641b806154b2fb419763417fecc38 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:57.468944 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf6059-0853-44ae-8055-3a509f01a386 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:57.470197 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf6059-0853-44ae-8055-3a509f01a386 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:57.471396 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf6059-0853-44ae-8055-3a509f01a386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:57.496570 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-94bf6059-0853-44ae-8055-3a509f01a386 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:57.497968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-94bf6059-0853-44ae-8055-3a509f01a386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:57.585461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1032/2084] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:57.598460 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119995e0-428c-41c7-b4a0-bbf5d30cfc48 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:57.599877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-119995e0-428c-41c7-b4a0-bbf5d30cfc48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:57.682416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119995e0-428c-41c7-b4a0-bbf5d30cfc48 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:57.691521 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60cc14-0e86-4a6c-a8f3-f613af5abdde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:57.692463 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60cc14-0e86-4a6c-a8f3-f613af5abdde service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:57.692752 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60cc14-0e86-4a6c-a8f3-f613af5abdde service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:57.693026 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60cc14-0e86-4a6c-a8f3-f613af5abdde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:57.708044 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60cc14-0e86-4a6c-a8f3-f613af5abdde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:57.709933 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60cc14-0e86-4a6c-a8f3-f613af5abdde service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:57.733458 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1053/2085] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:24:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:24:58.266154 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf6059-0853-44ae-8055-3a509f01a386 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:58.275476 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-94bf6059-0853-44ae-8055-3a509f01a386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:58.306478 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf6059-0853-44ae-8055-3a509f01a386 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:58.307946 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60cc14-0e86-4a6c-a8f3-f613af5abdde service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:58.310595 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5c60cc14-0e86-4a6c-a8f3-f613af5abdde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:58.311813 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580165a-bc03-4618-ba0e-047389c76e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:58.313163 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580165a-bc03-4618-ba0e-047389c76e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:58.313546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580165a-bc03-4618-ba0e-047389c76e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:58.316250 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580165a-bc03-4618-ba0e-047389c76e29 admin admin] PATH_INFO: `/v3/projects/e698050f081b4668ae999bab9afe3040` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:58.318217 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580165a-bc03-4618-ba0e-047389c76e29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e698050f081b4668ae999bab9afe3040)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:58.322416 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580165a-bc03-4618-ba0e-047389c76e29 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:58.332648 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60cc14-0e86-4a6c-a8f3-f613af5abdde service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:58.341693 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577dafb-bf88-4943-91a6-e65b9f0e242b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:58.343889 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577dafb-bf88-4943-91a6-e65b9f0e242b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:58.344403 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577dafb-bf88-4943-91a6-e65b9f0e242b admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:58.345032 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577dafb-bf88-4943-91a6-e65b9f0e242b admin admin] PATH_INFO: `/v3/users/2eb195a0b03e43b39b1d2d5aaa578c3f` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:58.346587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577dafb-bf88-4943-91a6-e65b9f0e242b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eb195a0b03e43b39b1d2d5aaa578c3f)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:58.348818 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577dafb-bf88-4943-91a6-e65b9f0e242b admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:58.510417 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:58.523686 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6580165a-bc03-4618-ba0e-047389c76e29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e698050f081b4668ae999bab9afe3040', 'request_id': 'req-6580165a-bc03-4618-ba0e-047389c76e29'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:58.536061 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6580165a-bc03-4618-ba0e-047389c76e29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e698050f081b4668ae999bab9afe3040', 'request_id': 'req-6580165a-bc03-4618-ba0e-047389c76e29'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:58.604610 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6580165a-bc03-4618-ba0e-047389c76e29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e698050f081b4668ae999bab9afe3040', 'request_id': 'req-6580165a-bc03-4618-ba0e-047389c76e29'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:58.619530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6580165a-bc03-4618-ba0e-047389c76e29 admin admin] The token cache is being invalidate because project e698050f081b4668ae999bab9afe3040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:24:58.620205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6580165a-bc03-4618-ba0e-047389c76e29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:58.621696 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6580165a-bc03-4618-ba0e-047389c76e29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:58.627825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1033/2086] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:24:58 2022] DELETE /identity/v3/projects/e698050f081b4668ae999bab9afe3040 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:58.629719 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8130d1c-39c7-4122-92fe-06b8d0c5eb33 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:58.630235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8130d1c-39c7-4122-92fe-06b8d0c5eb33 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:58.630746 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8130d1c-39c7-4122-92fe-06b8d0c5eb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:58.659284 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-6577dafb-bf88-4943-91a6-e65b9f0e242b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eb195a0b03e43b39b1d2d5aaa578c3f'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:58.672978 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-b8130d1c-39c7-4122-92fe-06b8d0c5eb33 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:58.679063 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b8130d1c-39c7-4122-92fe-06b8d0c5eb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:58.694299 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-6577dafb-bf88-4943-91a6-e65b9f0e242b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eb195a0b03e43b39b1d2d5aaa578c3f'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:58.725475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-6577dafb-bf88-4943-91a6-e65b9f0e242b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eb195a0b03e43b39b1d2d5aaa578c3f'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:58.727974 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-6577dafb-bf88-4943-91a6-e65b9f0e242b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eb195a0b03e43b39b1d2d5aaa578c3f'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:58.731426 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-6577dafb-bf88-4943-91a6-e65b9f0e242b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eb195a0b03e43b39b1d2d5aaa578c3f'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:24:58.809089 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1034/2087] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:58.819976 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a5c61-69a8-4497-830a-fe3d88029d2d None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:58.820313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a5c61-69a8-4497-830a-fe3d88029d2d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:58.824827 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a5c61-69a8-4497-830a-fe3d88029d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:58.842289 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1054/2088] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:24:58 2022] DELETE /identity/v3/users/2eb195a0b03e43b39b1d2d5aaa578c3f => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:58.854914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c538cda-a648-46da-b892-88e0db6bece9 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:58.859362 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c538cda-a648-46da-b892-88e0db6bece9 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:58.860132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c538cda-a648-46da-b892-88e0db6bece9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:58.865690 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-a55a5c61-69a8-4497-830a-fe3d88029d2d None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:58.868291 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a55a5c61-69a8-4497-830a-fe3d88029d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:58.933912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-2c538cda-a648-46da-b892-88e0db6bece9 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:58.938502 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-2c538cda-a648-46da-b892-88e0db6bece9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:58.979422 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1035/2089] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:58.989159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a5c61-69a8-4497-830a-fe3d88029d2d None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:59.008809 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a5c61-69a8-4497-830a-fe3d88029d2d None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:59.017145 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:59.023051 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb9669-8d29-4c25-b906-876554ddf463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:59.024582 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb9669-8d29-4c25-b906-876554ddf463 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:59.025048 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb9669-8d29-4c25-b906-876554ddf463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:59.025555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb9669-8d29-4c25-b906-876554ddf463 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:59.027316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb9669-8d29-4c25-b906-876554ddf463 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:24:59.027624 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb9669-8d29-4c25-b906-876554ddf463 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:59.031596 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb9669-8d29-4c25-b906-876554ddf463 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:59.051212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1055/2090] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:59.064952 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1036/2091] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:24:59.068828 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c538cda-a648-46da-b892-88e0db6bece9 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:59.070908 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-2c538cda-a648-46da-b892-88e0db6bece9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:59.071751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb9669-8d29-4c25-b906-876554ddf463 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:59.084932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb9669-8d29-4c25-b906-876554ddf463 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:59.094909 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55d004-55e2-43e2-b4d6-097e90f2db69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:59.094909 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55d004-55e2-43e2-b4d6-097e90f2db69 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:59.094909 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55d004-55e2-43e2-b4d6-097e90f2db69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:59.094909 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55d004-55e2-43e2-b4d6-097e90f2db69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:59.095605 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55d004-55e2-43e2-b4d6-097e90f2db69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:59.095896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55d004-55e2-43e2-b4d6-097e90f2db69 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:59.197483 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c538cda-a648-46da-b892-88e0db6bece9 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:59.199889 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1037/2092] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:24:59 2022] POST /identity/v3/projects => generated 363 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:24:59.204018 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55d004-55e2-43e2-b4d6-097e90f2db69 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:59.285218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:59.318582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ff36c-f23c-4f89-85ef-b2a944f2ace4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:59.319523 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ff36c-f23c-4f89-85ef-b2a944f2ace4 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:59.319870 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ff36c-f23c-4f89-85ef-b2a944f2ace4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:59.320337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ff36c-f23c-4f89-85ef-b2a944f2ace4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:59.320938 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55d004-55e2-43e2-b4d6-097e90f2db69 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:59.327153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de29e8a-09dc-418c-b008-8f11dcfe95fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:59.330474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de29e8a-09dc-418c-b008-8f11dcfe95fd admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:59.330474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de29e8a-09dc-418c-b008-8f11dcfe95fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:59.330474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de29e8a-09dc-418c-b008-8f11dcfe95fd admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:59.330474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de29e8a-09dc-418c-b008-8f11dcfe95fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:59.332824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de29e8a-09dc-418c-b008-8f11dcfe95fd admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:59.336750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ff36c-f23c-4f89-85ef-b2a944f2ace4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:59.338347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ff36c-f23c-4f89-85ef-b2a944f2ace4 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:59.353274 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1056/2093] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:24:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:24:59.454774 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1038/2094] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:24:59 2022] POST /identity/v3/users => generated 282 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:24:59.458764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ff36c-f23c-4f89-85ef-b2a944f2ace4 service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:59.488878 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ff36c-f23c-4f89-85ef-b2a944f2ace4 service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:59.504981 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65becdb-e676-40a6-9226-794a7dfee397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:59.506362 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65becdb-e676-40a6-9226-794a7dfee397 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:59.508532 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65becdb-e676-40a6-9226-794a7dfee397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:59.508952 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65becdb-e676-40a6-9226-794a7dfee397 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:59.510596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65becdb-e676-40a6-9226-794a7dfee397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:59.516720 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65becdb-e676-40a6-9226-794a7dfee397 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:59.545447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1057/2095] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:24:59.562501 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de29e8a-09dc-418c-b008-8f11dcfe95fd admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:59.583335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de29e8a-09dc-418c-b008-8f11dcfe95fd admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:59.591778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e3e4e-0198-4b05-be39-d86b1288c668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:59.592534 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e3e4e-0198-4b05-be39-d86b1288c668 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:59.599860 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e3e4e-0198-4b05-be39-d86b1288c668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:59.599860 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e3e4e-0198-4b05-be39-d86b1288c668 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:59.599860 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e3e4e-0198-4b05-be39-d86b1288c668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:59.599860 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e3e4e-0198-4b05-be39-d86b1288c668 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:59.613170 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1039/2096] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:24:59.614837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65becdb-e676-40a6-9226-794a7dfee397 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:59.634345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65becdb-e676-40a6-9226-794a7dfee397 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:59.640039 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818288c-5a4a-444a-b949-5c2bdc617c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:59.640611 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818288c-5a4a-444a-b949-5c2bdc617c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:59.640893 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818288c-5a4a-444a-b949-5c2bdc617c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:59.641169 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818288c-5a4a-444a-b949-5c2bdc617c0e admin admin] PATH_INFO: `/v3/projects/f1420743836f47a0a0287c4c275fc40a/users/16d60d70038d4ff7a882d35d818fd661/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:59.664485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818288c-5a4a-444a-b949-5c2bdc617c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1420743836f47a0a0287c4c275fc40a, user_id=16d60d70038d4ff7a882d35d818fd661, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:59.664485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818288c-5a4a-444a-b949-5c2bdc617c0e admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:59.749979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1058/2097] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:24:59 2022] PUT /identity/v3/projects/f1420743836f47a0a0287c4c275fc40a/users/16d60d70038d4ff7a882d35d818fd661/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:24:59.767174 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f2531-cca5-4ac7-b941-47ceb3560d92 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:59.767621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f2531-cca5-4ac7-b941-47ceb3560d92 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:59.768019 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f2531-cca5-4ac7-b941-47ceb3560d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:59.821081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-050f2531-cca5-4ac7-b941-47ceb3560d92 None None] MFA Rules not processed for user `16d60d70038d4ff7a882d35d818fd661`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:24:59.822602 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-050f2531-cca5-4ac7-b941-47ceb3560d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:59.906139 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1040/2098] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:24:59 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:24:59.918797 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818288c-5a4a-444a-b949-5c2bdc617c0e admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:59.920597 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5818288c-5a4a-444a-b949-5c2bdc617c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:59.989320 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f2531-cca5-4ac7-b941-47ceb3560d92 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:59.990938 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-050f2531-cca5-4ac7-b941-47ceb3560d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:00.022834 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818288c-5a4a-444a-b949-5c2bdc617c0e admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:00.029153 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c112f-1859-469d-97d0-161949d6b794 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:00.029822 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c112f-1859-469d-97d0-161949d6b794 service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:00.030114 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c112f-1859-469d-97d0-161949d6b794 service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:00.030924 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c112f-1859-469d-97d0-161949d6b794 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:00.041101 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c112f-1859-469d-97d0-161949d6b794 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:00.042563 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c112f-1859-469d-97d0-161949d6b794 service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:00.052760 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1059/2099] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:24:59 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:25:00.095723 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f2531-cca5-4ac7-b941-47ceb3560d92 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:00.104519 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b64888-ff80-475c-8812-a91d8c04945d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:00.106104 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b64888-ff80-475c-8812-a91d8c04945d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:00.106470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b64888-ff80-475c-8812-a91d8c04945d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:00.107496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b64888-ff80-475c-8812-a91d8c04945d admin admin] PATH_INFO: `/v3/projects/6609861d4955424d876246fb5b8c82b8` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:00.109137 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b64888-ff80-475c-8812-a91d8c04945d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6609861d4955424d876246fb5b8c82b8)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:00.111564 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b64888-ff80-475c-8812-a91d8c04945d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:00.285769 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:00.288921 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a2b64888-ff80-475c-8812-a91d8c04945d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6609861d4955424d876246fb5b8c82b8', 'request_id': 'req-a2b64888-ff80-475c-8812-a91d8c04945d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:00.298691 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a2b64888-ff80-475c-8812-a91d8c04945d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6609861d4955424d876246fb5b8c82b8', 'request_id': 'req-a2b64888-ff80-475c-8812-a91d8c04945d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:00.393523 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a2b64888-ff80-475c-8812-a91d8c04945d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6609861d4955424d876246fb5b8c82b8', 'request_id': 'req-a2b64888-ff80-475c-8812-a91d8c04945d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:00.406128 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a2b64888-ff80-475c-8812-a91d8c04945d admin admin] The token cache is being invalidate because project 6609861d4955424d876246fb5b8c82b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:25:00.406516 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a2b64888-ff80-475c-8812-a91d8c04945d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:00.407252 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a2b64888-ff80-475c-8812-a91d8c04945d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:00.409044 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1041/2100] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:24:59 2022] DELETE /identity/v3/projects/6609861d4955424d876246fb5b8c82b8 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:25:00.414581 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078b87b-2bdd-45dc-9b13-6497b4c1e37c None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:00.415141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078b87b-2bdd-45dc-9b13-6497b4c1e37c None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:00.415358 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078b87b-2bdd-45dc-9b13-6497b4c1e37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:00.440103 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-c078b87b-2bdd-45dc-9b13-6497b4c1e37c None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:00.441376 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c078b87b-2bdd-45dc-9b13-6497b4c1e37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:00.450881 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:00.528030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1060/2101] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:00.535858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2c1bf-4b1e-4bc1-9221-41e9c68d99a1 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:00.536176 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2c1bf-4b1e-4bc1-9221-41e9c68d99a1 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:00.536509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2c1bf-4b1e-4bc1-9221-41e9c68d99a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:00.559909 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f6b2c1bf-4b1e-4bc1-9221-41e9c68d99a1 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:00.563245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f6b2c1bf-4b1e-4bc1-9221-41e9c68d99a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:00.574850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1042/2102] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:00.577980 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078b87b-2bdd-45dc-9b13-6497b4c1e37c None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:00.594808 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078b87b-2bdd-45dc-9b13-6497b4c1e37c None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:00.610307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ae923-82bd-4174-8591-873e5cb92465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:00.611085 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ae923-82bd-4174-8591-873e5cb92465 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:00.611420 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ae923-82bd-4174-8591-873e5cb92465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:00.611796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ae923-82bd-4174-8591-873e5cb92465 admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:00.612793 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ae923-82bd-4174-8591-873e5cb92465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:25:00.617870 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ae923-82bd-4174-8591-873e5cb92465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:00.617870 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ae923-82bd-4174-8591-873e5cb92465 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:00.639764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1061/2103] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:25:00.644486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2c1bf-4b1e-4bc1-9221-41e9c68d99a1 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:00.660391 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2c1bf-4b1e-4bc1-9221-41e9c68d99a1 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:00.667520 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c5eed-4790-4c6d-99e7-a32ec878abf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:00.668276 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c5eed-4790-4c6d-99e7-a32ec878abf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:00.668565 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c5eed-4790-4c6d-99e7-a32ec878abf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:00.669619 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c5eed-4790-4c6d-99e7-a32ec878abf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:00.669619 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c5eed-4790-4c6d-99e7-a32ec878abf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:00.672884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c5eed-4790-4c6d-99e7-a32ec878abf1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:00.780347 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1043/2104] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:25:00 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:25:00.782142 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ae923-82bd-4174-8591-873e5cb92465 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:00.865950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ae923-82bd-4174-8591-873e5cb92465 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:01.036340 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86083fbe-b7f2-4f88-89f9-02a57deef2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:01.037120 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86083fbe-b7f2-4f88-89f9-02a57deef2af admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:01.037448 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86083fbe-b7f2-4f88-89f9-02a57deef2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:01.037687 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86083fbe-b7f2-4f88-89f9-02a57deef2af admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:01.040151 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86083fbe-b7f2-4f88-89f9-02a57deef2af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:01.046869 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86083fbe-b7f2-4f88-89f9-02a57deef2af admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:01.230462 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1062/2105] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:25:00 2022] POST /identity/v3/users => generated 293 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:25:01.234058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c5eed-4790-4c6d-99e7-a32ec878abf1 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:01.249740 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c5eed-4790-4c6d-99e7-a32ec878abf1 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:01.256496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd1957-d7dc-48d7-9852-9f2895cd11ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:01.257269 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd1957-d7dc-48d7-9852-9f2895cd11ad admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:01.257557 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd1957-d7dc-48d7-9852-9f2895cd11ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:01.257990 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd1957-d7dc-48d7-9852-9f2895cd11ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:01.259524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd1957-d7dc-48d7-9852-9f2895cd11ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:01.261110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd1957-d7dc-48d7-9852-9f2895cd11ad admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:01.328491 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1044/2106] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:25:01.333198 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86083fbe-b7f2-4f88-89f9-02a57deef2af admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:01.345085 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86083fbe-b7f2-4f88-89f9-02a57deef2af admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:01.350543 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feca770-2338-4e56-bfe9-6dbeb6e6ce1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:01.352295 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feca770-2338-4e56-bfe9-6dbeb6e6ce1b admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:01.352802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feca770-2338-4e56-bfe9-6dbeb6e6ce1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:01.353257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feca770-2338-4e56-bfe9-6dbeb6e6ce1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:01.354230 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feca770-2338-4e56-bfe9-6dbeb6e6ce1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:01.356252 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feca770-2338-4e56-bfe9-6dbeb6e6ce1b admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:01.372520 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1063/2107] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:25:01.386006 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd1957-d7dc-48d7-9852-9f2895cd11ad admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:01.399796 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd1957-d7dc-48d7-9852-9f2895cd11ad admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:01.405117 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03eb18-ca45-4f76-8800-896170d5e644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:01.406060 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03eb18-ca45-4f76-8800-896170d5e644 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:01.406343 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03eb18-ca45-4f76-8800-896170d5e644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:01.406630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03eb18-ca45-4f76-8800-896170d5e644 admin admin] PATH_INFO: `/v3/projects/958764b19ee344de88ee55921bc99ccd/users/c998847bbf28471b8df1260e807e0bd1/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:01.424334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03eb18-ca45-4f76-8800-896170d5e644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=958764b19ee344de88ee55921bc99ccd, user_id=c998847bbf28471b8df1260e807e0bd1, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:01.428019 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03eb18-ca45-4f76-8800-896170d5e644 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:01.498104 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1045/2108] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:25:01 2022] PUT /identity/v3/projects/958764b19ee344de88ee55921bc99ccd/users/c998847bbf28471b8df1260e807e0bd1/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:25:01.505799 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a61628-3ec1-4b4a-b381-3ad435a6145c None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:01.505799 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a61628-3ec1-4b4a-b381-3ad435a6145c None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:01.506567 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a61628-3ec1-4b4a-b381-3ad435a6145c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:01.566459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-d1a61628-3ec1-4b4a-b381-3ad435a6145c None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:01.568728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-d1a61628-3ec1-4b4a-b381-3ad435a6145c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:01.667842 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1064/2109] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:01.678212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03eb18-ca45-4f76-8800-896170d5e644 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:01.680648 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9c03eb18-ca45-4f76-8800-896170d5e644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:01.774129 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03eb18-ca45-4f76-8800-896170d5e644 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:01.779156 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b7ea7-9cf6-46d1-b084-1f1f8612351e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:01.780492 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b7ea7-9cf6-46d1-b084-1f1f8612351e service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:01.781552 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b7ea7-9cf6-46d1-b084-1f1f8612351e service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:01.782119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b7ea7-9cf6-46d1-b084-1f1f8612351e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:01.796031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b7ea7-9cf6-46d1-b084-1f1f8612351e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:01.797848 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b7ea7-9cf6-46d1-b084-1f1f8612351e service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:01.814040 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1046/2110] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:25:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:25:01.993232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a61628-3ec1-4b4a-b381-3ad435a6145c None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:01.994752 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-d1a61628-3ec1-4b4a-b381-3ad435a6145c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:02.014387 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a61628-3ec1-4b4a-b381-3ad435a6145c None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:02.027664 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b59030-c002-45bc-a243-e26a31764158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:02.029034 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b59030-c002-45bc-a243-e26a31764158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:02.029396 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b59030-c002-45bc-a243-e26a31764158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:02.030110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b59030-c002-45bc-a243-e26a31764158 admin admin] PATH_INFO: `/v3/users/35118295a16f4a148cf8892afbe64b75` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:02.032272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b59030-c002-45bc-a243-e26a31764158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35118295a16f4a148cf8892afbe64b75)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:02.033865 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b59030-c002-45bc-a243-e26a31764158 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:02.053887 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:02.314764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-76b59030-c002-45bc-a243-e26a31764158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35118295a16f4a148cf8892afbe64b75'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:02.353124 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-76b59030-c002-45bc-a243-e26a31764158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35118295a16f4a148cf8892afbe64b75'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:02.374954 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-76b59030-c002-45bc-a243-e26a31764158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35118295a16f4a148cf8892afbe64b75'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:02.380167 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-76b59030-c002-45bc-a243-e26a31764158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35118295a16f4a148cf8892afbe64b75'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:02.380167 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-76b59030-c002-45bc-a243-e26a31764158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35118295a16f4a148cf8892afbe64b75'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:02.483314 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1065/2111] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:25:01 2022] DELETE /identity/v3/users/35118295a16f4a148cf8892afbe64b75 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:25:02.486879 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef06c7-8f4f-4771-b31a-b396583dce1f None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:02.487169 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef06c7-8f4f-4771-b31a-b396583dce1f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:02.487439 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef06c7-8f4f-4771-b31a-b396583dce1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:02.514850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-17ef06c7-8f4f-4771-b31a-b396583dce1f None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:02.521215 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-17ef06c7-8f4f-4771-b31a-b396583dce1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:02.641456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1047/2112] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:02.652296 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b59030-c002-45bc-a243-e26a31764158 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:02.654588 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-76b59030-c002-45bc-a243-e26a31764158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:02.781319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b59030-c002-45bc-a243-e26a31764158 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:02.787333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce038d-80f0-4d3b-ab93-1310f3fe965f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:02.788163 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce038d-80f0-4d3b-ab93-1310f3fe965f service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:02.788518 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce038d-80f0-4d3b-ab93-1310f3fe965f service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:02.788893 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce038d-80f0-4d3b-ab93-1310f3fe965f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:02.818027 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce038d-80f0-4d3b-ab93-1310f3fe965f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:02.819725 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce038d-80f0-4d3b-ab93-1310f3fe965f service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:02.836712 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1066/2113] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:25:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:25:03.418866 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef06c7-8f4f-4771-b31a-b396583dce1f None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:03.420500 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-17ef06c7-8f4f-4771-b31a-b396583dce1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:03.435556 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef06c7-8f4f-4771-b31a-b396583dce1f None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:03.441249 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae7e9d-8aeb-4ff5-93fb-ec167447901f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:03.442195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae7e9d-8aeb-4ff5-93fb-ec167447901f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:03.442481 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae7e9d-8aeb-4ff5-93fb-ec167447901f admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:03.442899 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae7e9d-8aeb-4ff5-93fb-ec167447901f admin admin] PATH_INFO: `/v3/projects/f5c1b4d4cb2e4720997779ba0624ae4e` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:03.444978 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae7e9d-8aeb-4ff5-93fb-ec167447901f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5c1b4d4cb2e4720997779ba0624ae4e)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:03.447503 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae7e9d-8aeb-4ff5-93fb-ec167447901f admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:03.494965 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:03.786818 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0cae7e9d-8aeb-4ff5-93fb-ec167447901f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5c1b4d4cb2e4720997779ba0624ae4e', 'request_id': 'req-0cae7e9d-8aeb-4ff5-93fb-ec167447901f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:03.804320 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0cae7e9d-8aeb-4ff5-93fb-ec167447901f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5c1b4d4cb2e4720997779ba0624ae4e', 'request_id': 'req-0cae7e9d-8aeb-4ff5-93fb-ec167447901f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:03.998925 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0cae7e9d-8aeb-4ff5-93fb-ec167447901f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5c1b4d4cb2e4720997779ba0624ae4e', 'request_id': 'req-0cae7e9d-8aeb-4ff5-93fb-ec167447901f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:04.013239 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0cae7e9d-8aeb-4ff5-93fb-ec167447901f admin admin] The token cache is being invalidate because project f5c1b4d4cb2e4720997779ba0624ae4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:25:04.013523 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0cae7e9d-8aeb-4ff5-93fb-ec167447901f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:04.014578 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0cae7e9d-8aeb-4ff5-93fb-ec167447901f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:04.016835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1048/2114] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:25:03 2022] DELETE /identity/v3/projects/f5c1b4d4cb2e4720997779ba0624ae4e => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:25:04.021070 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce038d-80f0-4d3b-ab93-1310f3fe965f service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:04.033653 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce038d-80f0-4d3b-ab93-1310f3fe965f service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:04.189284 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f123c-7a27-4503-ba79-ab6440f1ba48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:04.190189 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f123c-7a27-4503-ba79-ab6440f1ba48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:04.190465 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f123c-7a27-4503-ba79-ab6440f1ba48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:04.190748 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f123c-7a27-4503-ba79-ab6440f1ba48 admin admin] PATH_INFO: `/v3/users/8ee3d8f9f25c432299ad774bfe02ae9c` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:04.192408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f123c-7a27-4503-ba79-ab6440f1ba48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ee3d8f9f25c432299ad774bfe02ae9c)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:04.194509 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f123c-7a27-4503-ba79-ab6440f1ba48 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:04.394742 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:04.428907 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-be5f123c-7a27-4503-ba79-ab6440f1ba48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ee3d8f9f25c432299ad774bfe02ae9c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:04.461282 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-be5f123c-7a27-4503-ba79-ab6440f1ba48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ee3d8f9f25c432299ad774bfe02ae9c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:04.473120 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-be5f123c-7a27-4503-ba79-ab6440f1ba48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ee3d8f9f25c432299ad774bfe02ae9c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:04.474758 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-be5f123c-7a27-4503-ba79-ab6440f1ba48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ee3d8f9f25c432299ad774bfe02ae9c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:04.475515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-be5f123c-7a27-4503-ba79-ab6440f1ba48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ee3d8f9f25c432299ad774bfe02ae9c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:04.594184 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1067/2115] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:25:04 2022] DELETE /identity/v3/users/8ee3d8f9f25c432299ad774bfe02ae9c => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:25:05.318204 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae7e9d-8aeb-4ff5-93fb-ec167447901f admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:05.318204 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0cae7e9d-8aeb-4ff5-93fb-ec167447901f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:05.348908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae7e9d-8aeb-4ff5-93fb-ec167447901f admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:05.498654 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf6220-b435-4ce3-85be-c28e2a62e21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:05.499624 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf6220-b435-4ce3-85be-c28e2a62e21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:05.500166 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf6220-b435-4ce3-85be-c28e2a62e21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:05.500491 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf6220-b435-4ce3-85be-c28e2a62e21c admin admin] PATH_INFO: `/v3/projects/40f6c5f670734839bc756175119610c2` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:05.501987 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf6220-b435-4ce3-85be-c28e2a62e21c admin admin] RBAC: Authorizing `identity:delete_project(project_id=40f6c5f670734839bc756175119610c2)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:05.503948 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf6220-b435-4ce3-85be-c28e2a62e21c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:05.654939 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e8cf6220-b435-4ce3-85be-c28e2a62e21c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40f6c5f670734839bc756175119610c2', 'request_id': 'req-e8cf6220-b435-4ce3-85be-c28e2a62e21c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:05.664620 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e8cf6220-b435-4ce3-85be-c28e2a62e21c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40f6c5f670734839bc756175119610c2', 'request_id': 'req-e8cf6220-b435-4ce3-85be-c28e2a62e21c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:05.767326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e8cf6220-b435-4ce3-85be-c28e2a62e21c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40f6c5f670734839bc756175119610c2', 'request_id': 'req-e8cf6220-b435-4ce3-85be-c28e2a62e21c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:05.782521 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e8cf6220-b435-4ce3-85be-c28e2a62e21c admin admin] The token cache is being invalidate because project 40f6c5f670734839bc756175119610c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:25:05.785665 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e8cf6220-b435-4ce3-85be-c28e2a62e21c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:05.785665 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e8cf6220-b435-4ce3-85be-c28e2a62e21c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:05.785665 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1049/2116] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:25:05 2022] DELETE /identity/v3/projects/40f6c5f670734839bc756175119610c2 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:25:05.791262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1449-1725-4abb-b53a-3e2ad7d60ac1 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:05.791787 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1449-1725-4abb-b53a-3e2ad7d60ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:05.791787 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1449-1725-4abb-b53a-3e2ad7d60ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:05.815405 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-9c9f1449-1725-4abb-b53a-3e2ad7d60ac1 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:05.817905 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-9c9f1449-1725-4abb-b53a-3e2ad7d60ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:06.018050 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1068/2117] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:06.020028 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6206c-b068-4756-a4b6-0f977d000c16 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:06.020323 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6206c-b068-4756-a4b6-0f977d000c16 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:06.020607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6206c-b068-4756-a4b6-0f977d000c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:06.068808 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-67f6206c-b068-4756-a4b6-0f977d000c16 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:06.071557 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-67f6206c-b068-4756-a4b6-0f977d000c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:06.086802 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1050/2118] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:06.091368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f1449-1725-4abb-b53a-3e2ad7d60ac1 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:06.113441 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f1449-1725-4abb-b53a-3e2ad7d60ac1 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:06.121090 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21779f0a-6627-4f3c-9dbe-b7316a879526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:06.122066 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21779f0a-6627-4f3c-9dbe-b7316a879526 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:06.122272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21779f0a-6627-4f3c-9dbe-b7316a879526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:06.122620 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21779f0a-6627-4f3c-9dbe-b7316a879526 admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:06.123449 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21779f0a-6627-4f3c-9dbe-b7316a879526 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:25:06.124589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21779f0a-6627-4f3c-9dbe-b7316a879526 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:06.125766 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21779f0a-6627-4f3c-9dbe-b7316a879526 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:06.143943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1069/2119] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:25:06.148147 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6206c-b068-4756-a4b6-0f977d000c16 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:06.159674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6206c-b068-4756-a4b6-0f977d000c16 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:06.170912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe344d-8850-4e59-bdd1-3f4797e83166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:06.171808 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe344d-8850-4e59-bdd1-3f4797e83166 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:06.172410 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe344d-8850-4e59-bdd1-3f4797e83166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:06.172781 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe344d-8850-4e59-bdd1-3f4797e83166 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:06.176174 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe344d-8850-4e59-bdd1-3f4797e83166 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:06.176174 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe344d-8850-4e59-bdd1-3f4797e83166 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:06.320045 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:06.329414 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1051/2120] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:25:06 2022] POST /identity/v3/projects => generated 371 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:25:06.333940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21779f0a-6627-4f3c-9dbe-b7316a879526 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:06.352262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21779f0a-6627-4f3c-9dbe-b7316a879526 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:06.503165 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bfbd7-29b3-4443-9f40-3f7f5e7cd4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:06.504033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bfbd7-29b3-4443-9f40-3f7f5e7cd4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:06.504912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bfbd7-29b3-4443-9f40-3f7f5e7cd4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:06.505295 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bfbd7-29b3-4443-9f40-3f7f5e7cd4a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:06.506116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bfbd7-29b3-4443-9f40-3f7f5e7cd4a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:06.508360 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bfbd7-29b3-4443-9f40-3f7f5e7cd4a6 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:06.565423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1070/2121] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:25:06 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:25:06.569530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe344d-8850-4e59-bdd1-3f4797e83166 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:06.586366 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe344d-8850-4e59-bdd1-3f4797e83166 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:06.600816 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3cd87b-d0fa-49cf-a002-7fb01f9ea2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:06.602290 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cd87b-d0fa-49cf-a002-7fb01f9ea2da admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:06.602807 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cd87b-d0fa-49cf-a002-7fb01f9ea2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:06.603328 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cd87b-d0fa-49cf-a002-7fb01f9ea2da admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:06.604313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3cd87b-d0fa-49cf-a002-7fb01f9ea2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:06.606172 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3cd87b-d0fa-49cf-a002-7fb01f9ea2da admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:06.635235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1052/2122] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:25:06.636320 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bfbd7-29b3-4443-9f40-3f7f5e7cd4a6 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:06.658006 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bfbd7-29b3-4443-9f40-3f7f5e7cd4a6 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:06.663550 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145c3da-12a7-46c5-99a9-560ca66d122b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:06.664954 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145c3da-12a7-46c5-99a9-560ca66d122b admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:06.665322 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145c3da-12a7-46c5-99a9-560ca66d122b admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:06.665606 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145c3da-12a7-46c5-99a9-560ca66d122b admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:06.666337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145c3da-12a7-46c5-99a9-560ca66d122b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:06.671874 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145c3da-12a7-46c5-99a9-560ca66d122b admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:06.707404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1071/2123] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:25:06.708953 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3cd87b-d0fa-49cf-a002-7fb01f9ea2da admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:06.729244 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3cd87b-d0fa-49cf-a002-7fb01f9ea2da admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:06.741152 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320825be-230b-4e52-9635-4d5410049581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:06.744201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320825be-230b-4e52-9635-4d5410049581 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:06.745194 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320825be-230b-4e52-9635-4d5410049581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:06.747421 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320825be-230b-4e52-9635-4d5410049581 admin admin] PATH_INFO: `/v3/projects/5be3ad11ad534cac941908bf0d1a7c83/users/07b92143522f4b41b9c8047c33a01e06/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:06.782112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320825be-230b-4e52-9635-4d5410049581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5be3ad11ad534cac941908bf0d1a7c83, user_id=07b92143522f4b41b9c8047c33a01e06, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:06.785722 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320825be-230b-4e52-9635-4d5410049581 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:06.883337 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1053/2124] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:25:06 2022] PUT /identity/v3/projects/5be3ad11ad534cac941908bf0d1a7c83/users/07b92143522f4b41b9c8047c33a01e06/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:25:06.918976 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989c290-854b-4a30-861d-b5a5ed42d5d2 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:06.919452 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989c290-854b-4a30-861d-b5a5ed42d5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:06.919565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989c290-854b-4a30-861d-b5a5ed42d5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:06.983888 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-a989c290-854b-4a30-861d-b5a5ed42d5d2 None None] MFA Rules not processed for user `07b92143522f4b41b9c8047c33a01e06`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:06.985558 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-a989c290-854b-4a30-861d-b5a5ed42d5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:06.991628 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:07.089603 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1072/2125] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:07.108458 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320825be-230b-4e52-9635-4d5410049581 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:07.111271 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-320825be-230b-4e52-9635-4d5410049581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:07.272158 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320825be-230b-4e52-9635-4d5410049581 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:07.279461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de5bc8-67dc-4562-93b2-31bb8d3b9d5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:07.280328 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de5bc8-67dc-4562-93b2-31bb8d3b9d5b service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:07.280615 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de5bc8-67dc-4562-93b2-31bb8d3b9d5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:07.280896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de5bc8-67dc-4562-93b2-31bb8d3b9d5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:07.295126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de5bc8-67dc-4562-93b2-31bb8d3b9d5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:07.296350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de5bc8-67dc-4562-93b2-31bb8d3b9d5b service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:07.312270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1054/2126] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:25:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:25:07.335094 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989c290-854b-4a30-861d-b5a5ed42d5d2 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:07.471153 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989c290-854b-4a30-861d-b5a5ed42d5d2 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:07.477159 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80aac77-5d4f-47c6-9ff1-a62f7d9c3bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:07.480161 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80aac77-5d4f-47c6-9ff1-a62f7d9c3bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:07.480161 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80aac77-5d4f-47c6-9ff1-a62f7d9c3bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:07.480161 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80aac77-5d4f-47c6-9ff1-a62f7d9c3bbb admin admin] PATH_INFO: `/v3/users/07b92143522f4b41b9c8047c33a01e06` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:07.482657 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80aac77-5d4f-47c6-9ff1-a62f7d9c3bbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=07b92143522f4b41b9c8047c33a01e06)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:07.487624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80aac77-5d4f-47c6-9ff1-a62f7d9c3bbb admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:07.761185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-f80aac77-5d4f-47c6-9ff1-a62f7d9c3bbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07b92143522f4b41b9c8047c33a01e06'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:07.780390 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-f80aac77-5d4f-47c6-9ff1-a62f7d9c3bbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07b92143522f4b41b9c8047c33a01e06'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:07.807344 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-f80aac77-5d4f-47c6-9ff1-a62f7d9c3bbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07b92143522f4b41b9c8047c33a01e06'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:07.808949 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-f80aac77-5d4f-47c6-9ff1-a62f7d9c3bbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07b92143522f4b41b9c8047c33a01e06'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:07.810278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-f80aac77-5d4f-47c6-9ff1-a62f7d9c3bbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07b92143522f4b41b9c8047c33a01e06'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:07.908813 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1073/2127] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:25:07 2022] DELETE /identity/v3/users/07b92143522f4b41b9c8047c33a01e06 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:25:07.909749 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fd808-7e8f-4d64-a49b-1547eed09c64 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:07.910532 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fd808-7e8f-4d64-a49b-1547eed09c64 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:07.910981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fd808-7e8f-4d64-a49b-1547eed09c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:07.961232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-eb5fd808-7e8f-4d64-a49b-1547eed09c64 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:07.962501 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-eb5fd808-7e8f-4d64-a49b-1547eed09c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:08.076450 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1055/2128] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:25:08.083180 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80aac77-5d4f-47c6-9ff1-a62f7d9c3bbb admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:08.085717 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-f80aac77-5d4f-47c6-9ff1-a62f7d9c3bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:08.130275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:08.200154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80aac77-5d4f-47c6-9ff1-a62f7d9c3bbb admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:08.211334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb50cd-0442-4c4c-97d5-1489d974c60b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:08.212711 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb50cd-0442-4c4c-97d5-1489d974c60b service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:08.213267 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb50cd-0442-4c4c-97d5-1489d974c60b service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:08.213812 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb50cd-0442-4c4c-97d5-1489d974c60b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:08.225468 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb50cd-0442-4c4c-97d5-1489d974c60b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:08.233769 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb50cd-0442-4c4c-97d5-1489d974c60b service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:08.245234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1074/2129] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:25:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:25:09.153114 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fd808-7e8f-4d64-a49b-1547eed09c64 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:09.153114 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-eb5fd808-7e8f-4d64-a49b-1547eed09c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:09.169805 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fd808-7e8f-4d64-a49b-1547eed09c64 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:09.186245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f7471-5271-40ac-a287-129bc87e2b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:09.187182 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f7471-5271-40ac-a287-129bc87e2b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:09.187470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f7471-5271-40ac-a287-129bc87e2b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:09.187741 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f7471-5271-40ac-a287-129bc87e2b72 admin admin] PATH_INFO: `/v3/projects/5be3ad11ad534cac941908bf0d1a7c83` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:09.189916 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f7471-5271-40ac-a287-129bc87e2b72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5be3ad11ad534cac941908bf0d1a7c83)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:09.194790 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f7471-5271-40ac-a287-129bc87e2b72 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:09.403572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:09.411844 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a6f7471-5271-40ac-a287-129bc87e2b72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5be3ad11ad534cac941908bf0d1a7c83', 'request_id': 'req-3a6f7471-5271-40ac-a287-129bc87e2b72'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:09.421661 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a6f7471-5271-40ac-a287-129bc87e2b72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5be3ad11ad534cac941908bf0d1a7c83', 'request_id': 'req-3a6f7471-5271-40ac-a287-129bc87e2b72'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:09.530083 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a6f7471-5271-40ac-a287-129bc87e2b72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5be3ad11ad534cac941908bf0d1a7c83', 'request_id': 'req-3a6f7471-5271-40ac-a287-129bc87e2b72'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:09.544268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a6f7471-5271-40ac-a287-129bc87e2b72 admin admin] The token cache is being invalidate because project 5be3ad11ad534cac941908bf0d1a7c83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:25:09.544724 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a6f7471-5271-40ac-a287-129bc87e2b72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:09.545425 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a6f7471-5271-40ac-a287-129bc87e2b72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:09.554482 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1056/2130] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:25:09 2022] DELETE /identity/v3/projects/5be3ad11ad534cac941908bf0d1a7c83 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:25:09.556154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15ee53-9436-4f0f-b1bf-bc73c43bb564 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:09.556776 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15ee53-9436-4f0f-b1bf-bc73c43bb564 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:09.556776 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15ee53-9436-4f0f-b1bf-bc73c43bb564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:09.591516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-6c15ee53-9436-4f0f-b1bf-bc73c43bb564 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:09.594176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-6c15ee53-9436-4f0f-b1bf-bc73c43bb564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:09.748043 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1075/2131] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:09.756402 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf6aac-e8b7-4cee-8aa5-72b39137fc0f None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:09.756689 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf6aac-e8b7-4cee-8aa5-72b39137fc0f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:09.757037 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf6aac-e8b7-4cee-8aa5-72b39137fc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:09.799897 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-0fcf6aac-e8b7-4cee-8aa5-72b39137fc0f None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:09.801445 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0fcf6aac-e8b7-4cee-8aa5-72b39137fc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:09.815772 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1057/2132] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:09.820799 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15ee53-9436-4f0f-b1bf-bc73c43bb564 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:09.836238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15ee53-9436-4f0f-b1bf-bc73c43bb564 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:09.843482 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb11c46-7e3e-493d-a896-fc51fddb3b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:09.844649 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb11c46-7e3e-493d-a896-fc51fddb3b1e admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:09.848448 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb11c46-7e3e-493d-a896-fc51fddb3b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:09.848448 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb11c46-7e3e-493d-a896-fc51fddb3b1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:09.848448 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb11c46-7e3e-493d-a896-fc51fddb3b1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:25:09.848448 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb11c46-7e3e-493d-a896-fc51fddb3b1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:09.848448 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb11c46-7e3e-493d-a896-fc51fddb3b1e admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:09.874511 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1076/2133] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:25:09.877057 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf6aac-e8b7-4cee-8aa5-72b39137fc0f None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:09.906148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf6aac-e8b7-4cee-8aa5-72b39137fc0f None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:09.939136 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b1308-da5e-409c-83a2-8d94011e98c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:09.940441 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b1308-da5e-409c-83a2-8d94011e98c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:09.941279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b1308-da5e-409c-83a2-8d94011e98c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:09.941775 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b1308-da5e-409c-83a2-8d94011e98c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:09.942756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b1308-da5e-409c-83a2-8d94011e98c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:09.945914 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b1308-da5e-409c-83a2-8d94011e98c4 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:10.144046 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1058/2134] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:25:09 2022] POST /identity/v3/projects => generated 375 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:25:10.151153 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb11c46-7e3e-493d-a896-fc51fddb3b1e admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:10.171799 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb11c46-7e3e-493d-a896-fc51fddb3b1e admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:10.295531 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90077e33-109c-49e1-aa1f-a2532f9849d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:10.296300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90077e33-109c-49e1-aa1f-a2532f9849d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:10.296582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90077e33-109c-49e1-aa1f-a2532f9849d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:10.299515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90077e33-109c-49e1-aa1f-a2532f9849d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:10.300043 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90077e33-109c-49e1-aa1f-a2532f9849d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:10.302958 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90077e33-109c-49e1-aa1f-a2532f9849d1 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:10.393756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1077/2135] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:25:10 2022] POST /identity/v3/users => generated 288 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:25:10.397895 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b1308-da5e-409c-83a2-8d94011e98c4 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:10.413052 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b1308-da5e-409c-83a2-8d94011e98c4 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:10.422335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265630e-cbc5-4160-80d8-16f2404f309d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:10.423062 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265630e-cbc5-4160-80d8-16f2404f309d admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:10.423347 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265630e-cbc5-4160-80d8-16f2404f309d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:10.423629 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265630e-cbc5-4160-80d8-16f2404f309d admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:10.424455 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265630e-cbc5-4160-80d8-16f2404f309d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:10.427105 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265630e-cbc5-4160-80d8-16f2404f309d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:10.457590 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90077e33-109c-49e1-aa1f-a2532f9849d1 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:10.458248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1059/2136] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:25:10.475747 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90077e33-109c-49e1-aa1f-a2532f9849d1 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:10.483499 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff6296-f41c-4743-8e71-3e76504209d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:10.485124 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff6296-f41c-4743-8e71-3e76504209d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:10.485424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff6296-f41c-4743-8e71-3e76504209d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:10.485710 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff6296-f41c-4743-8e71-3e76504209d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:10.486468 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff6296-f41c-4743-8e71-3e76504209d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:10.489688 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff6296-f41c-4743-8e71-3e76504209d0 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:10.505321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1078/2137] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:25:10.510040 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265630e-cbc5-4160-80d8-16f2404f309d admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:10.528020 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265630e-cbc5-4160-80d8-16f2404f309d admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:10.556245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31821c31-aac9-4fe2-8c55-c5a4acb8b134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:10.557651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31821c31-aac9-4fe2-8c55-c5a4acb8b134 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:10.558174 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31821c31-aac9-4fe2-8c55-c5a4acb8b134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:10.560560 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31821c31-aac9-4fe2-8c55-c5a4acb8b134 admin admin] PATH_INFO: `/v3/projects/55c1006273a34bd19cce6c8b65a48bd9/users/06e2b589340548ac90b8b5f36e67a438/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:10.611935 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31821c31-aac9-4fe2-8c55-c5a4acb8b134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55c1006273a34bd19cce6c8b65a48bd9, user_id=06e2b589340548ac90b8b5f36e67a438, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:10.620532 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31821c31-aac9-4fe2-8c55-c5a4acb8b134 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:10.741878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1060/2138] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:25:10 2022] PUT /identity/v3/projects/55c1006273a34bd19cce6c8b65a48bd9/users/06e2b589340548ac90b8b5f36e67a438/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:25:10.744837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160fb99-94dd-42cc-ba3d-5136ffd74263 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:10.745849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160fb99-94dd-42cc-ba3d-5136ffd74263 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:10.746239 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160fb99-94dd-42cc-ba3d-5136ffd74263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:10.819119 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-5160fb99-94dd-42cc-ba3d-5136ffd74263 None None] MFA Rules not processed for user `06e2b589340548ac90b8b5f36e67a438`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:10.822714 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5160fb99-94dd-42cc-ba3d-5136ffd74263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:10.876699 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:11.003493 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1079/2139] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:11.016562 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31821c31-aac9-4fe2-8c55-c5a4acb8b134 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:11.018452 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-31821c31-aac9-4fe2-8c55-c5a4acb8b134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:11.074372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4831844-057a-4086-bd52-ef6944d0e297 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:11.074372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4831844-057a-4086-bd52-ef6944d0e297 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:11.074372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4831844-057a-4086-bd52-ef6944d0e297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:11.151936 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-c4831844-057a-4086-bd52-ef6944d0e297 None None] MFA Rules not processed for user `c998847bbf28471b8df1260e807e0bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:11.153452 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c4831844-057a-4086-bd52-ef6944d0e297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:11.181636 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31821c31-aac9-4fe2-8c55-c5a4acb8b134 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:11.192141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0930914-090d-4ad9-b8f4-eb585dd22b92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:11.194244 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0930914-090d-4ad9-b8f4-eb585dd22b92 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:11.194244 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0930914-090d-4ad9-b8f4-eb585dd22b92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:11.194244 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0930914-090d-4ad9-b8f4-eb585dd22b92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:11.211107 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0930914-090d-4ad9-b8f4-eb585dd22b92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:11.214514 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0930914-090d-4ad9-b8f4-eb585dd22b92 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:11.228265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1061/2140] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:25:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:25:11.294329 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1080/2141] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:25:11.296140 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0930914-090d-4ad9-b8f4-eb585dd22b92 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:11.302449 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b0930914-090d-4ad9-b8f4-eb585dd22b92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:11.488186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0930914-090d-4ad9-b8f4-eb585dd22b92 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:11.492976 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201e5ff-e216-4b74-a511-a0be59736032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:11.494375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201e5ff-e216-4b74-a511-a0be59736032 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:11.494972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201e5ff-e216-4b74-a511-a0be59736032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:11.495256 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201e5ff-e216-4b74-a511-a0be59736032 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:11.496105 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201e5ff-e216-4b74-a511-a0be59736032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:11.498033 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201e5ff-e216-4b74-a511-a0be59736032 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:11.531453 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:11.645115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4831844-057a-4086-bd52-ef6944d0e297 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:11.645401 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1062/2142] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:25:11 2022] POST /identity/v3/projects => generated 385 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:25:11.663014 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4831844-057a-4086-bd52-ef6944d0e297 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:11.820848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf882d-8ee7-40c9-83d9-1606bb222046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:11.822584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf882d-8ee7-40c9-83d9-1606bb222046 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:11.823021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf882d-8ee7-40c9-83d9-1606bb222046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:11.823448 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf882d-8ee7-40c9-83d9-1606bb222046 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:11.824445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf882d-8ee7-40c9-83d9-1606bb222046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:11.826691 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf882d-8ee7-40c9-83d9-1606bb222046 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:11.968995 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1081/2143] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:25:11 2022] POST /identity/v3/users => generated 299 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:25:11.970405 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201e5ff-e216-4b74-a511-a0be59736032 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:11.986207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201e5ff-e216-4b74-a511-a0be59736032 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:12.004201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7486a6-c73c-4124-95af-dc7f311edd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:12.005419 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7486a6-c73c-4124-95af-dc7f311edd32 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:12.005419 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7486a6-c73c-4124-95af-dc7f311edd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:12.005419 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7486a6-c73c-4124-95af-dc7f311edd32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:12.006089 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7486a6-c73c-4124-95af-dc7f311edd32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:12.007785 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7486a6-c73c-4124-95af-dc7f311edd32 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:12.024746 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1063/2144] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:25:12.028691 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf882d-8ee7-40c9-83d9-1606bb222046 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:12.043438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf882d-8ee7-40c9-83d9-1606bb222046 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:12.050466 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35eee4-6a61-43c6-beca-888f5f9e98d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:12.061294 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35eee4-6a61-43c6-beca-888f5f9e98d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:12.061853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35eee4-6a61-43c6-beca-888f5f9e98d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:12.062143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35eee4-6a61-43c6-beca-888f5f9e98d3 admin admin] PATH_INFO: `/v3/projects/da478c0cb4f44fe4a1adb7571ae4e4a9/users/21a5dc56fc334170984813d6063c0256/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:12.086755 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35eee4-6a61-43c6-beca-888f5f9e98d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da478c0cb4f44fe4a1adb7571ae4e4a9, user_id=21a5dc56fc334170984813d6063c0256, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:12.091610 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35eee4-6a61-43c6-beca-888f5f9e98d3 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:12.184382 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1082/2145] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:25:12 2022] PUT /identity/v3/projects/da478c0cb4f44fe4a1adb7571ae4e4a9/users/21a5dc56fc334170984813d6063c0256/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:25:12.253341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7486a6-c73c-4124-95af-dc7f311edd32 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:12.283967 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7486a6-c73c-4124-95af-dc7f311edd32 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:12.419634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b3e98-220a-400b-b08a-ae75fa0e1783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:12.420898 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b3e98-220a-400b-b08a-ae75fa0e1783 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:12.420898 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b3e98-220a-400b-b08a-ae75fa0e1783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:12.421203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b3e98-220a-400b-b08a-ae75fa0e1783 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:12.421821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b3e98-220a-400b-b08a-ae75fa0e1783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:12.424366 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b3e98-220a-400b-b08a-ae75fa0e1783 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:12.446490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1064/2146] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:25:12.453369 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35eee4-6a61-43c6-beca-888f5f9e98d3 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:12.478818 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35eee4-6a61-43c6-beca-888f5f9e98d3 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:12.493519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c03062-7bd9-4b7f-89a2-bff36e8660ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:12.494870 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c03062-7bd9-4b7f-89a2-bff36e8660ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:12.495413 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c03062-7bd9-4b7f-89a2-bff36e8660ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:12.495810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c03062-7bd9-4b7f-89a2-bff36e8660ee admin admin] PATH_INFO: `/v3/projects/da478c0cb4f44fe4a1adb7571ae4e4a9/users/21a5dc56fc334170984813d6063c0256/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:12.498159 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c03062-7bd9-4b7f-89a2-bff36e8660ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=da478c0cb4f44fe4a1adb7571ae4e4a9, user_id=21a5dc56fc334170984813d6063c0256, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:12.503168 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c03062-7bd9-4b7f-89a2-bff36e8660ee admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:12.525396 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1083/2147] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:25:12 2022] PUT /identity/v3/projects/da478c0cb4f44fe4a1adb7571ae4e4a9/users/21a5dc56fc334170984813d6063c0256/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:25:12.715178 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af5ec1-c347-4359-a365-9f093d8c3d83 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:12.715686 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af5ec1-c347-4359-a365-9f093d8c3d83 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:12.715967 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af5ec1-c347-4359-a365-9f093d8c3d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:12.776909 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-20af5ec1-c347-4359-a365-9f093d8c3d83 None None] MFA Rules not processed for user `8fce5ea9cc1346b89cce855aaaa77466`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:12.781082 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-20af5ec1-c347-4359-a365-9f093d8c3d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:12.979845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1065/2148] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:17.036349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c03062-7bd9-4b7f-89a2-bff36e8660ee admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:17.069357 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:17.271217 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c03062-7bd9-4b7f-89a2-bff36e8660ee admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:17.282520 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82069db-8a4b-4a98-8d79-5a01d2fdba0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:17.283890 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82069db-8a4b-4a98-8d79-5a01d2fdba0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:17.284460 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82069db-8a4b-4a98-8d79-5a01d2fdba0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:17.285148 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82069db-8a4b-4a98-8d79-5a01d2fdba0c admin admin] PATH_INFO: `/v3/users/06e2b589340548ac90b8b5f36e67a438` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:17.286908 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82069db-8a4b-4a98-8d79-5a01d2fdba0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=06e2b589340548ac90b8b5f36e67a438)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:17.295198 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82069db-8a4b-4a98-8d79-5a01d2fdba0c admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:17.525197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-b82069db-8a4b-4a98-8d79-5a01d2fdba0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06e2b589340548ac90b8b5f36e67a438'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:17.567310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-b82069db-8a4b-4a98-8d79-5a01d2fdba0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06e2b589340548ac90b8b5f36e67a438'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:17.591447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-b82069db-8a4b-4a98-8d79-5a01d2fdba0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06e2b589340548ac90b8b5f36e67a438'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:17.593643 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-b82069db-8a4b-4a98-8d79-5a01d2fdba0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06e2b589340548ac90b8b5f36e67a438'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:17.594746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-b82069db-8a4b-4a98-8d79-5a01d2fdba0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06e2b589340548ac90b8b5f36e67a438'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:17.713530 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1084/2149] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:25:17 2022] DELETE /identity/v3/users/06e2b589340548ac90b8b5f36e67a438 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:25:17.718500 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e335f4-0dba-4e15-afaf-72931b207abd None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:17.719061 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e335f4-0dba-4e15-afaf-72931b207abd None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:17.719061 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e335f4-0dba-4e15-afaf-72931b207abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:17.741950 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-68e335f4-0dba-4e15-afaf-72931b207abd None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:17.743228 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-68e335f4-0dba-4e15-afaf-72931b207abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:17.938809 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1066/2150] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:17.961472 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82069db-8a4b-4a98-8d79-5a01d2fdba0c admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:17.964983 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-b82069db-8a4b-4a98-8d79-5a01d2fdba0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:18.123027 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82069db-8a4b-4a98-8d79-5a01d2fdba0c admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:18.134871 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82549c-dbfc-498d-90b5-00b08a23eadc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:18.136236 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82549c-dbfc-498d-90b5-00b08a23eadc service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:18.137342 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82549c-dbfc-498d-90b5-00b08a23eadc service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:18.139094 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82549c-dbfc-498d-90b5-00b08a23eadc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:18.181423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82549c-dbfc-498d-90b5-00b08a23eadc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:18.186738 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82549c-dbfc-498d-90b5-00b08a23eadc service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:18.203056 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1085/2151] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:25:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:25:18.256339 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3100fa-340c-4881-8e77-d9496e713eee None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:18.256971 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3100fa-340c-4881-8e77-d9496e713eee None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:18.257590 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3100fa-340c-4881-8e77-d9496e713eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:18.357361 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-ac3100fa-340c-4881-8e77-d9496e713eee None None] MFA Rules not processed for user `235042beafd246c5b227b3926098c8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:18.364223 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ac3100fa-340c-4881-8e77-d9496e713eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:18.453103 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:18.533175 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1067/2152] 10.222.0.45 () {58 vars in 967 bytes} [Thu Jun 2 19:25:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:18.566127 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82549c-dbfc-498d-90b5-00b08a23eadc service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:18.567919 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-8a82549c-dbfc-498d-90b5-00b08a23eadc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:18.686151 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:18.782550 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82549c-dbfc-498d-90b5-00b08a23eadc service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:18.789713 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9259a6-c757-4542-9c6a-6bf3548ba9b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ba0ab9510d49c4ab4c634e82790efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:18.790400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9259a6-c757-4542-9c6a-6bf3548ba9b3 service swift] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:18.792207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9259a6-c757-4542-9c6a-6bf3548ba9b3 service swift] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:18.792207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9259a6-c757-4542-9c6a-6bf3548ba9b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:18.808106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9259a6-c757-4542-9c6a-6bf3548ba9b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:18.810197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9259a6-c757-4542-9c6a-6bf3548ba9b3 service swift] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:18.824201 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1086/2153] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jun 2 19:25:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 19:25:19.040606 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3100fa-340c-4881-8e77-d9496e713eee None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:19.040606 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ac3100fa-340c-4881-8e77-d9496e713eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:19.067486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3100fa-340c-4881-8e77-d9496e713eee None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:19.078547 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde5555-1c78-447a-9a40-dd83f95d494d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:19.079451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde5555-1c78-447a-9a40-dd83f95d494d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:19.079732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde5555-1c78-447a-9a40-dd83f95d494d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:19.080084 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde5555-1c78-447a-9a40-dd83f95d494d admin admin] PATH_INFO: `/v3/projects/55c1006273a34bd19cce6c8b65a48bd9` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:19.081855 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde5555-1c78-447a-9a40-dd83f95d494d admin admin] RBAC: Authorizing `identity:delete_project(project_id=55c1006273a34bd19cce6c8b65a48bd9)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:19.083879 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde5555-1c78-447a-9a40-dd83f95d494d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:19.320959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fcde5555-1c78-447a-9a40-dd83f95d494d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55c1006273a34bd19cce6c8b65a48bd9', 'request_id': 'req-fcde5555-1c78-447a-9a40-dd83f95d494d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:19.340742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fcde5555-1c78-447a-9a40-dd83f95d494d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55c1006273a34bd19cce6c8b65a48bd9', 'request_id': 'req-fcde5555-1c78-447a-9a40-dd83f95d494d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:19.535947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fcde5555-1c78-447a-9a40-dd83f95d494d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55c1006273a34bd19cce6c8b65a48bd9', 'request_id': 'req-fcde5555-1c78-447a-9a40-dd83f95d494d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:19.568243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fcde5555-1c78-447a-9a40-dd83f95d494d admin admin] The token cache is being invalidate because project 55c1006273a34bd19cce6c8b65a48bd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:25:19.568925 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fcde5555-1c78-447a-9a40-dd83f95d494d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:19.570846 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fcde5555-1c78-447a-9a40-dd83f95d494d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:19.587163 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1068/2154] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:25:19 2022] DELETE /identity/v3/projects/55c1006273a34bd19cce6c8b65a48bd9 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:25:19.587312 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dc56f-9bc7-432e-bdfa-38d499beb8e2 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:19.587312 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dc56f-9bc7-432e-bdfa-38d499beb8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:19.587312 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dc56f-9bc7-432e-bdfa-38d499beb8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:19.627676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-035dc56f-9bc7-432e-bdfa-38d499beb8e2 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:19.655382 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-035dc56f-9bc7-432e-bdfa-38d499beb8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:19.770218 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1087/2155] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:19.780976 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c95ca-140e-4340-aca4-d8875a36cc86 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:19.781408 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c95ca-140e-4340-aca4-d8875a36cc86 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:19.782879 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c95ca-140e-4340-aca4-d8875a36cc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:19.817627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f48c95ca-140e-4340-aca4-d8875a36cc86 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:19.819633 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f48c95ca-140e-4340-aca4-d8875a36cc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:19.834327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1069/2156] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:19.834974 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035dc56f-9bc7-432e-bdfa-38d499beb8e2 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:19.848498 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035dc56f-9bc7-432e-bdfa-38d499beb8e2 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:19.864177 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12900d7-d5b5-4ad2-b87d-c4d85d35f533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:19.864713 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12900d7-d5b5-4ad2-b87d-c4d85d35f533 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:19.864997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12900d7-d5b5-4ad2-b87d-c4d85d35f533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:19.865292 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12900d7-d5b5-4ad2-b87d-c4d85d35f533 admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:19.866400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12900d7-d5b5-4ad2-b87d-c4d85d35f533 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:25:19.866400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12900d7-d5b5-4ad2-b87d-c4d85d35f533 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:19.868218 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12900d7-d5b5-4ad2-b87d-c4d85d35f533 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:19.896235 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1088/2157] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:25:19.900890 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c95ca-140e-4340-aca4-d8875a36cc86 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:19.914990 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c95ca-140e-4340-aca4-d8875a36cc86 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:19.920366 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf2ae7-57f6-49a1-93e1-a73084f4f29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:19.921160 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf2ae7-57f6-49a1-93e1-a73084f4f29d admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:19.921514 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf2ae7-57f6-49a1-93e1-a73084f4f29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:19.921885 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf2ae7-57f6-49a1-93e1-a73084f4f29d admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:19.922749 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf2ae7-57f6-49a1-93e1-a73084f4f29d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:19.924916 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf2ae7-57f6-49a1-93e1-a73084f4f29d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:20.047187 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1070/2158] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:25:19 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:25:20.052305 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12900d7-d5b5-4ad2-b87d-c4d85d35f533 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:20.066332 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12900d7-d5b5-4ad2-b87d-c4d85d35f533 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:20.202621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4db0a-6829-47d8-abed-ebd6b3309a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:20.204242 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4db0a-6829-47d8-abed-ebd6b3309a7a admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:20.204904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4db0a-6829-47d8-abed-ebd6b3309a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:20.206205 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4db0a-6829-47d8-abed-ebd6b3309a7a admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:20.206913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4db0a-6829-47d8-abed-ebd6b3309a7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:20.217736 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4db0a-6829-47d8-abed-ebd6b3309a7a admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:20.363600 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1089/2159] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:25:20 2022] POST /identity/v3/users => generated 286 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:25:20.369158 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf2ae7-57f6-49a1-93e1-a73084f4f29d admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:20.401748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf2ae7-57f6-49a1-93e1-a73084f4f29d admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:20.415390 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e17bc9-74ab-418d-93a9-d3c96e14562b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:20.417768 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e17bc9-74ab-418d-93a9-d3c96e14562b admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:20.418277 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e17bc9-74ab-418d-93a9-d3c96e14562b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:20.418769 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e17bc9-74ab-418d-93a9-d3c96e14562b admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:20.421920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e17bc9-74ab-418d-93a9-d3c96e14562b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:20.426714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e17bc9-74ab-418d-93a9-d3c96e14562b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:20.464237 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1071/2160] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:25:20.467928 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4db0a-6829-47d8-abed-ebd6b3309a7a admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:20.480424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4db0a-6829-47d8-abed-ebd6b3309a7a admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:20.489564 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acb720-e485-460f-abc6-c5b05d161da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:20.491582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acb720-e485-460f-abc6-c5b05d161da7 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:20.492559 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acb720-e485-460f-abc6-c5b05d161da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:20.493596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acb720-e485-460f-abc6-c5b05d161da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:20.497597 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01acb720-e485-460f-abc6-c5b05d161da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:20.499357 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01acb720-e485-460f-abc6-c5b05d161da7 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:20.513504 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1090/2161] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:25:20.519690 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e17bc9-74ab-418d-93a9-d3c96e14562b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:20.535985 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e17bc9-74ab-418d-93a9-d3c96e14562b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:20.550240 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5c0c5-2460-49ab-8734-7112ccb7291a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:20.551882 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5c0c5-2460-49ab-8734-7112ccb7291a admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:20.552939 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5c0c5-2460-49ab-8734-7112ccb7291a admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:20.553487 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5c0c5-2460-49ab-8734-7112ccb7291a admin admin] PATH_INFO: `/v3/projects/eafd60dd08874251bc1883443dc4de1a/users/6e409be193d14b9eae3f91102c492e74/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:20.581788 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5c0c5-2460-49ab-8734-7112ccb7291a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eafd60dd08874251bc1883443dc4de1a, user_id=6e409be193d14b9eae3f91102c492e74, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:20.585522 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5c0c5-2460-49ab-8734-7112ccb7291a admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:20.732927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1072/2162] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:25:20 2022] PUT /identity/v3/projects/eafd60dd08874251bc1883443dc4de1a/users/6e409be193d14b9eae3f91102c492e74/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:25:20.758925 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b709c75-349e-4915-83b1-ad2b0931f6ee None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:20.759450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b709c75-349e-4915-83b1-ad2b0931f6ee None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:20.760502 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b709c75-349e-4915-83b1-ad2b0931f6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:20.873233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-3b709c75-349e-4915-83b1-ad2b0931f6ee None None] MFA Rules not processed for user `6e409be193d14b9eae3f91102c492e74`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:20.875978 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-3b709c75-349e-4915-83b1-ad2b0931f6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:20.891342 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:21.069223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1091/2163] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:25:21.090138 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5c0c5-2460-49ab-8734-7112ccb7291a admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:21.093015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-28a5c0c5-2460-49ab-8734-7112ccb7291a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:21.252042 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:21.278397 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5c0c5-2460-49ab-8734-7112ccb7291a admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:21.283975 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098445b8-efee-4a85-af6f-e0e65fec1749 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:21.284955 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098445b8-efee-4a85-af6f-e0e65fec1749 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:21.285433 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098445b8-efee-4a85-af6f-e0e65fec1749 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:21.287736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098445b8-efee-4a85-af6f-e0e65fec1749 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:21.298863 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098445b8-efee-4a85-af6f-e0e65fec1749 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:21.300748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098445b8-efee-4a85-af6f-e0e65fec1749 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:21.314434 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1073/2164] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:25:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:25:21.349511 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b709c75-349e-4915-83b1-ad2b0931f6ee None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:21.547163 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b709c75-349e-4915-83b1-ad2b0931f6ee None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:21.571489 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cbd8e-6e58-49cf-9494-b9573518a156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:21.575658 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cbd8e-6e58-49cf-9494-b9573518a156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:21.575658 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cbd8e-6e58-49cf-9494-b9573518a156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:21.575658 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cbd8e-6e58-49cf-9494-b9573518a156 admin admin] PATH_INFO: `/v3/users/6e409be193d14b9eae3f91102c492e74` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:21.581498 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70cbd8e-6e58-49cf-9494-b9573518a156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e409be193d14b9eae3f91102c492e74)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:21.595858 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70cbd8e-6e58-49cf-9494-b9573518a156 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:21.852389 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-f70cbd8e-6e58-49cf-9494-b9573518a156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e409be193d14b9eae3f91102c492e74'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:21.866253 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-f70cbd8e-6e58-49cf-9494-b9573518a156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e409be193d14b9eae3f91102c492e74'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:21.874850 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-f70cbd8e-6e58-49cf-9494-b9573518a156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e409be193d14b9eae3f91102c492e74'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:21.881759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-f70cbd8e-6e58-49cf-9494-b9573518a156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e409be193d14b9eae3f91102c492e74'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:21.881759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-f70cbd8e-6e58-49cf-9494-b9573518a156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e409be193d14b9eae3f91102c492e74'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:21.966746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1092/2165] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:25:21 2022] DELETE /identity/v3/users/6e409be193d14b9eae3f91102c492e74 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:25:21.974974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd37fc-9bf0-49d3-ae3a-90136336ac48 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:21.975684 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd37fc-9bf0-49d3-ae3a-90136336ac48 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:21.976786 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd37fc-9bf0-49d3-ae3a-90136336ac48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:22.011267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-57fd37fc-9bf0-49d3-ae3a-90136336ac48 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:22.013463 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-57fd37fc-9bf0-49d3-ae3a-90136336ac48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:22.141343 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1074/2166] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:22.181757 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cbd8e-6e58-49cf-9494-b9573518a156 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:22.184294 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-f70cbd8e-6e58-49cf-9494-b9573518a156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:22.295158 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:22.335175 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cbd8e-6e58-49cf-9494-b9573518a156 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:22.340134 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ef0f0-96f1-493a-bd85-5be1a886df99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:22.340866 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ef0f0-96f1-493a-bd85-5be1a886df99 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:22.341222 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ef0f0-96f1-493a-bd85-5be1a886df99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:22.341555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ef0f0-96f1-493a-bd85-5be1a886df99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:22.353831 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ef0f0-96f1-493a-bd85-5be1a886df99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:22.355507 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ef0f0-96f1-493a-bd85-5be1a886df99 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:22.370565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1093/2167] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:25:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:25:23.497062 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed06911-8e6f-4133-b91d-1876c0c6a1a0 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:23.498356 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed06911-8e6f-4133-b91d-1876c0c6a1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:23.498694 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed06911-8e6f-4133-b91d-1876c0c6a1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:23.557577 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-4ed06911-8e6f-4133-b91d-1876c0c6a1a0 None None] MFA Rules not processed for user `21a5dc56fc334170984813d6063c0256`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:23.570508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4ed06911-8e6f-4133-b91d-1876c0c6a1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:23.731918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1075/2168] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:23.762918 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ef0f0-96f1-493a-bd85-5be1a886df99 service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:23.767049 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-ba8ef0f0-96f1-493a-bd85-5be1a886df99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:23.869187 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed06911-8e6f-4133-b91d-1876c0c6a1a0 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:23.875380 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4ed06911-8e6f-4133-b91d-1876c0c6a1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:23.912219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed06911-8e6f-4133-b91d-1876c0c6a1a0 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:23.919708 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278ae76-d8c7-4f02-a41b-10c8136548a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:23.925201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278ae76-d8c7-4f02-a41b-10c8136548a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:23.925201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278ae76-d8c7-4f02-a41b-10c8136548a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:23.925457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278ae76-d8c7-4f02-a41b-10c8136548a6 admin admin] PATH_INFO: `/v3/projects/eafd60dd08874251bc1883443dc4de1a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:23.928990 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278ae76-d8c7-4f02-a41b-10c8136548a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eafd60dd08874251bc1883443dc4de1a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:23.930796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ef0f0-96f1-493a-bd85-5be1a886df99 service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:23.931653 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278ae76-d8c7-4f02-a41b-10c8136548a6 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:23.947226 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407d704-2f55-476f-8ea2-05f94bf747b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '226743f4f93c44c5aef5919a7813bd3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:23.948753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407d704-2f55-476f-8ea2-05f94bf747b7 service glance] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:23.949043 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407d704-2f55-476f-8ea2-05f94bf747b7 service glance] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:23.949560 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407d704-2f55-476f-8ea2-05f94bf747b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:23.955552 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-7407d704-2f55-476f-8ea2-05f94bf747b7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:24.063554 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407d704-2f55-476f-8ea2-05f94bf747b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:24.069499 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407d704-2f55-476f-8ea2-05f94bf747b7 service glance] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:24.080727 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1094/2169] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:25:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:25:24.081665 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407d704-2f55-476f-8ea2-05f94bf747b7 service glance] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:24.084658 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-7407d704-2f55-476f-8ea2-05f94bf747b7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:24.084956 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6278ae76-d8c7-4f02-a41b-10c8136548a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eafd60dd08874251bc1883443dc4de1a', 'request_id': 'req-6278ae76-d8c7-4f02-a41b-10c8136548a6'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:24.107764 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6278ae76-d8c7-4f02-a41b-10c8136548a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eafd60dd08874251bc1883443dc4de1a', 'request_id': 'req-6278ae76-d8c7-4f02-a41b-10c8136548a6'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:24.111771 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407d704-2f55-476f-8ea2-05f94bf747b7 service glance] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:24.190860 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317bc86-f32f-466b-bbf2-636da1af0582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:24.191747 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317bc86-f32f-466b-bbf2-636da1af0582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:24.192069 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317bc86-f32f-466b-bbf2-636da1af0582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:24.192357 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317bc86-f32f-466b-bbf2-636da1af0582 admin admin] PATH_INFO: `/v3/users/7b9b819e522144dbb780cbc3843f88c8` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:24.193778 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317bc86-f32f-466b-bbf2-636da1af0582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b9b819e522144dbb780cbc3843f88c8)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:24.195894 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317bc86-f32f-466b-bbf2-636da1af0582 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:24.201107 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6278ae76-d8c7-4f02-a41b-10c8136548a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eafd60dd08874251bc1883443dc4de1a', 'request_id': 'req-6278ae76-d8c7-4f02-a41b-10c8136548a6'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:24.208669 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:24.217964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:24.222356 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6278ae76-d8c7-4f02-a41b-10c8136548a6 admin admin] The token cache is being invalidate because project eafd60dd08874251bc1883443dc4de1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:25:24.222356 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6278ae76-d8c7-4f02-a41b-10c8136548a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:24.222356 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6278ae76-d8c7-4f02-a41b-10c8136548a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:24.224593 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1076/2170] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:25:23 2022] DELETE /identity/v3/projects/eafd60dd08874251bc1883443dc4de1a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:25:24.430088 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-8317bc86-f32f-466b-bbf2-636da1af0582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b9b819e522144dbb780cbc3843f88c8'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:24.460154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-8317bc86-f32f-466b-bbf2-636da1af0582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b9b819e522144dbb780cbc3843f88c8'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:24.482260 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-8317bc86-f32f-466b-bbf2-636da1af0582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b9b819e522144dbb780cbc3843f88c8'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:24.484086 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-8317bc86-f32f-466b-bbf2-636da1af0582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b9b819e522144dbb780cbc3843f88c8'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:24.484991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-8317bc86-f32f-466b-bbf2-636da1af0582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b9b819e522144dbb780cbc3843f88c8'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:24.491911 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a2ae0-704d-4997-86d1-4bc8656c3eac None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:24.492284 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a2ae0-704d-4997-86d1-4bc8656c3eac None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:24.492693 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a2ae0-704d-4997-86d1-4bc8656c3eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:24.578236 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-583a2ae0-704d-4997-86d1-4bc8656c3eac None None] MFA Rules not processed for user `235042beafd246c5b227b3926098c8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:24.581726 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-583a2ae0-704d-4997-86d1-4bc8656c3eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:24.640219 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1095/2171] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:25:24 2022] DELETE /identity/v3/users/7b9b819e522144dbb780cbc3843f88c8 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:25:24.733418 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1077/2172] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jun 2 19:25:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:24.749470 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317bc86-f32f-466b-bbf2-636da1af0582 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:24.751840 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-8317bc86-f32f-466b-bbf2-636da1af0582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:24.899239 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317bc86-f32f-466b-bbf2-636da1af0582 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:24.907690 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbdd73-4015-48ec-a1e4-5f154b22f7c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ba0ab9510d49c4ab4c634e82790efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:24.908654 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbdd73-4015-48ec-a1e4-5f154b22f7c8 service swift] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:24.908939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbdd73-4015-48ec-a1e4-5f154b22f7c8 service swift] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:24.909217 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbdd73-4015-48ec-a1e4-5f154b22f7c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:25.021579 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fbdd73-4015-48ec-a1e4-5f154b22f7c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:25.024320 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fbdd73-4015-48ec-a1e4-5f154b22f7c8 service swift] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:25.035306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1096/2173] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jun 2 19:25:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 19:25:25.048413 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a2ae0-704d-4997-86d1-4bc8656c3eac None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:25.050017 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-583a2ae0-704d-4997-86d1-4bc8656c3eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:25.074874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a2ae0-704d-4997-86d1-4bc8656c3eac None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:25.201608 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994032ea-15e5-48c7-9dba-98cda3dce49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:25.204631 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994032ea-15e5-48c7-9dba-98cda3dce49c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:25.204801 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994032ea-15e5-48c7-9dba-98cda3dce49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:25.205989 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994032ea-15e5-48c7-9dba-98cda3dce49c admin admin] PATH_INFO: `/v3/projects/33fafedbd8e641588884554063403a51` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:25.209398 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994032ea-15e5-48c7-9dba-98cda3dce49c admin admin] RBAC: Authorizing `identity:delete_project(project_id=33fafedbd8e641588884554063403a51)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:25.215759 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994032ea-15e5-48c7-9dba-98cda3dce49c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:25.377066 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-994032ea-15e5-48c7-9dba-98cda3dce49c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33fafedbd8e641588884554063403a51', 'request_id': 'req-994032ea-15e5-48c7-9dba-98cda3dce49c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:25.399586 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-994032ea-15e5-48c7-9dba-98cda3dce49c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33fafedbd8e641588884554063403a51', 'request_id': 'req-994032ea-15e5-48c7-9dba-98cda3dce49c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:25.492067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-994032ea-15e5-48c7-9dba-98cda3dce49c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33fafedbd8e641588884554063403a51', 'request_id': 'req-994032ea-15e5-48c7-9dba-98cda3dce49c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:25.500841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:25.512545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-994032ea-15e5-48c7-9dba-98cda3dce49c admin admin] The token cache is being invalidate because project 33fafedbd8e641588884554063403a51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:25:25.512919 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-994032ea-15e5-48c7-9dba-98cda3dce49c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:25.521489 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-994032ea-15e5-48c7-9dba-98cda3dce49c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:25.526515 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1078/2174] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:25:25 2022] DELETE /identity/v3/projects/33fafedbd8e641588884554063403a51 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:25:25.527693 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9bad3-99c0-4800-83ef-1655242dada0 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:25.528016 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9bad3-99c0-4800-83ef-1655242dada0 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:25.528298 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9bad3-99c0-4800-83ef-1655242dada0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:25.581766 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-c7d9bad3-99c0-4800-83ef-1655242dada0 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:25.581766 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c7d9bad3-99c0-4800-83ef-1655242dada0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:25.586065 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:25.728422 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1097/2175] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:25:25.732749 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fcdec-444f-439e-b42a-a38c2bcd9e94 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:25.733324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fcdec-444f-439e-b42a-a38c2bcd9e94 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:25.733324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fcdec-444f-439e-b42a-a38c2bcd9e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:25.762612 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-318fcdec-444f-439e-b42a-a38c2bcd9e94 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:25.765536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-318fcdec-444f-439e-b42a-a38c2bcd9e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:25.785735 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1079/2176] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:25.795142 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9bad3-99c0-4800-83ef-1655242dada0 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:25.805255 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9bad3-99c0-4800-83ef-1655242dada0 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:25.816647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671d04e-3dfd-412c-a976-b1ff644a3d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:25.817322 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671d04e-3dfd-412c-a976-b1ff644a3d54 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:25.817639 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671d04e-3dfd-412c-a976-b1ff644a3d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:25.818964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671d04e-3dfd-412c-a976-b1ff644a3d54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:25.819799 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671d04e-3dfd-412c-a976-b1ff644a3d54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:25:25.820608 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671d04e-3dfd-412c-a976-b1ff644a3d54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:25.822122 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671d04e-3dfd-412c-a976-b1ff644a3d54 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:25.849074 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1098/2177] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:25:25.854091 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fcdec-444f-439e-b42a-a38c2bcd9e94 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:25.865470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fcdec-444f-439e-b42a-a38c2bcd9e94 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:25.873707 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a291c40-53a4-4682-8d49-717fe0611fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:25.874383 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a291c40-53a4-4682-8d49-717fe0611fbe admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:25.875361 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a291c40-53a4-4682-8d49-717fe0611fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:25.875361 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a291c40-53a4-4682-8d49-717fe0611fbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:25.875695 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a291c40-53a4-4682-8d49-717fe0611fbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:25.878130 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a291c40-53a4-4682-8d49-717fe0611fbe admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:26.107318 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1080/2178] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:25:25 2022] POST /identity/v3/projects => generated 371 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:25:26.108466 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671d04e-3dfd-412c-a976-b1ff644a3d54 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:26.132108 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671d04e-3dfd-412c-a976-b1ff644a3d54 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:26.248726 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381afdfd-cd93-4410-b269-49813ab2330b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:26.250676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381afdfd-cd93-4410-b269-49813ab2330b admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:26.251252 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381afdfd-cd93-4410-b269-49813ab2330b admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:26.251753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381afdfd-cd93-4410-b269-49813ab2330b admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:26.254908 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381afdfd-cd93-4410-b269-49813ab2330b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:26.257870 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381afdfd-cd93-4410-b269-49813ab2330b admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:26.348367 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1099/2179] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:25:26 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:25:26.353007 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a291c40-53a4-4682-8d49-717fe0611fbe admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:26.363931 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a291c40-53a4-4682-8d49-717fe0611fbe admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:26.369848 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c677c-6434-4ada-bf51-3624e4098956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:26.371166 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c677c-6434-4ada-bf51-3624e4098956 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:26.372071 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c677c-6434-4ada-bf51-3624e4098956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:26.372353 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c677c-6434-4ada-bf51-3624e4098956 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:26.373287 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c677c-6434-4ada-bf51-3624e4098956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:26.375932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c677c-6434-4ada-bf51-3624e4098956 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:26.394416 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1081/2180] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:25:26.398913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381afdfd-cd93-4410-b269-49813ab2330b admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:26.414449 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381afdfd-cd93-4410-b269-49813ab2330b admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:26.420332 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e043c-d2f3-43ae-b9fa-5ff805d73da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:26.421115 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e043c-d2f3-43ae-b9fa-5ff805d73da5 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:26.421462 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e043c-d2f3-43ae-b9fa-5ff805d73da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:26.421806 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e043c-d2f3-43ae-b9fa-5ff805d73da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:26.422641 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e043c-d2f3-43ae-b9fa-5ff805d73da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:26.424381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e043c-d2f3-43ae-b9fa-5ff805d73da5 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:26.448140 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1100/2181] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:25:26.449738 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c677c-6434-4ada-bf51-3624e4098956 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:26.470618 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c677c-6434-4ada-bf51-3624e4098956 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:26.483988 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fcc54-97d2-45f8-a770-41b46108eb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:26.485355 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fcc54-97d2-45f8-a770-41b46108eb13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:26.486145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fcc54-97d2-45f8-a770-41b46108eb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:26.486697 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fcc54-97d2-45f8-a770-41b46108eb13 admin admin] PATH_INFO: `/v3/projects/06f57bbb327f4ffea465315f546f24a8/users/ccd665ac694340bfb99d8f5dbcb4f5f3/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:26.508189 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fcc54-97d2-45f8-a770-41b46108eb13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f57bbb327f4ffea465315f546f24a8, user_id=ccd665ac694340bfb99d8f5dbcb4f5f3, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:26.511226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fcc54-97d2-45f8-a770-41b46108eb13 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:26.626519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48a292-8581-4259-8ff4-132ca6b3101a None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:26.626920 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48a292-8581-4259-8ff4-132ca6b3101a None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:26.627668 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48a292-8581-4259-8ff4-132ca6b3101a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:26.629168 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1082/2182] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:25:26 2022] PUT /identity/v3/projects/06f57bbb327f4ffea465315f546f24a8/users/ccd665ac694340bfb99d8f5dbcb4f5f3/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:25:26.652078 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-bf48a292-8581-4259-8ff4-132ca6b3101a None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:26.653717 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-bf48a292-8581-4259-8ff4-132ca6b3101a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:26.795848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1101/2183] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:26.817423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fcc54-97d2-45f8-a770-41b46108eb13 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:26.819600 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-181fcc54-97d2-45f8-a770-41b46108eb13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:26.958297 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fcc54-97d2-45f8-a770-41b46108eb13 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:26.962899 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49163188-1514-47db-8af8-a86889d266b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:26.963812 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49163188-1514-47db-8af8-a86889d266b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:26.964275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49163188-1514-47db-8af8-a86889d266b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:26.964621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49163188-1514-47db-8af8-a86889d266b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:26.991623 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49163188-1514-47db-8af8-a86889d266b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:26.993315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49163188-1514-47db-8af8-a86889d266b5 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:27.008455 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1083/2184] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:25:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:25:35.974803 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d25c2-a668-4f09-a833-87efaec52a06 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:35.975367 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d25c2-a668-4f09-a833-87efaec52a06 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:35.975367 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d25c2-a668-4f09-a833-87efaec52a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:36.083441 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-594d25c2-a668-4f09-a833-87efaec52a06 None None] MFA Rules not processed for user `ccd665ac694340bfb99d8f5dbcb4f5f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:36.084860 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-594d25c2-a668-4f09-a833-87efaec52a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:36.096561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:36.262994 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1102/2185] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:36.267534 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49163188-1514-47db-8af8-a86889d266b5 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:36.280799 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49163188-1514-47db-8af8-a86889d266b5 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:36.287265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aecd58-3ad5-4e5e-9fde-e61c0139d1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:36.289435 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aecd58-3ad5-4e5e-9fde-e61c0139d1b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:36.290112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aecd58-3ad5-4e5e-9fde-e61c0139d1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:36.291120 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aecd58-3ad5-4e5e-9fde-e61c0139d1b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:36.293777 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aecd58-3ad5-4e5e-9fde-e61c0139d1b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:36.296035 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aecd58-3ad5-4e5e-9fde-e61c0139d1b7 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:36.437548 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1084/2186] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:25:36 2022] POST /identity/v3/projects => generated 373 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:25:36.442071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d25c2-a668-4f09-a833-87efaec52a06 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:36.465379 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d25c2-a668-4f09-a833-87efaec52a06 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:36.563392 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac63f65-634c-40c2-af85-7aa19052e081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:36.564272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac63f65-634c-40c2-af85-7aa19052e081 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:36.564616 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac63f65-634c-40c2-af85-7aa19052e081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:36.564901 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac63f65-634c-40c2-af85-7aa19052e081 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:36.565668 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac63f65-634c-40c2-af85-7aa19052e081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:36.567789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac63f65-634c-40c2-af85-7aa19052e081 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:36.706144 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1103/2187] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:25:36 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:25:36.707341 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aecd58-3ad5-4e5e-9fde-e61c0139d1b7 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:36.724436 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aecd58-3ad5-4e5e-9fde-e61c0139d1b7 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:36.738624 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acbbbe-4748-402e-a869-0b06484478b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:36.739310 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acbbbe-4748-402e-a869-0b06484478b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:36.739595 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acbbbe-4748-402e-a869-0b06484478b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:36.739886 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acbbbe-4748-402e-a869-0b06484478b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:36.740641 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81acbbbe-4748-402e-a869-0b06484478b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:36.742846 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81acbbbe-4748-402e-a869-0b06484478b6 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:36.777124 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1085/2188] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:25:36.781323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac63f65-634c-40c2-af85-7aa19052e081 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:36.798112 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac63f65-634c-40c2-af85-7aa19052e081 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:36.812215 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9fb72-3f33-4b41-aaff-757547d9e5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:36.813386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9fb72-3f33-4b41-aaff-757547d9e5df admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:36.813846 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9fb72-3f33-4b41-aaff-757547d9e5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:36.814482 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9fb72-3f33-4b41-aaff-757547d9e5df admin admin] PATH_INFO: `/v3/projects/1129d6675ec943bb89c8d64d98629146/users/f00e153b15824dada3c0ee4fb1556eab/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:36.844853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9fb72-3f33-4b41-aaff-757547d9e5df admin admin] RBAC: Authorizing `identity:create_grant(project_id=1129d6675ec943bb89c8d64d98629146, user_id=f00e153b15824dada3c0ee4fb1556eab, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:36.850364 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9fb72-3f33-4b41-aaff-757547d9e5df admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:36.946853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1104/2189] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:25:36 2022] PUT /identity/v3/projects/1129d6675ec943bb89c8d64d98629146/users/f00e153b15824dada3c0ee4fb1556eab/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:25:36.951418 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acbbbe-4748-402e-a869-0b06484478b6 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:36.966697 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acbbbe-4748-402e-a869-0b06484478b6 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:37.110948 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78ce94-bd27-40b5-94b4-db292398f987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:37.111796 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78ce94-bd27-40b5-94b4-db292398f987 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:37.112236 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78ce94-bd27-40b5-94b4-db292398f987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:37.112581 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78ce94-bd27-40b5-94b4-db292398f987 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:37.113436 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78ce94-bd27-40b5-94b4-db292398f987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:37.115144 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78ce94-bd27-40b5-94b4-db292398f987 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:37.123490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:37.147314 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1086/2190] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:25:37.147770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9fb72-3f33-4b41-aaff-757547d9e5df admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:37.165323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9fb72-3f33-4b41-aaff-757547d9e5df admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:37.199125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b600f7e-ad8b-42fd-b719-cb39f663d404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:37.200140 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b600f7e-ad8b-42fd-b719-cb39f663d404 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:37.200427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b600f7e-ad8b-42fd-b719-cb39f663d404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:37.200703 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b600f7e-ad8b-42fd-b719-cb39f663d404 admin admin] PATH_INFO: `/v3/projects/1129d6675ec943bb89c8d64d98629146/users/f00e153b15824dada3c0ee4fb1556eab/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:37.202753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b600f7e-ad8b-42fd-b719-cb39f663d404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1129d6675ec943bb89c8d64d98629146, user_id=f00e153b15824dada3c0ee4fb1556eab, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:37.206192 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b600f7e-ad8b-42fd-b719-cb39f663d404 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:37.220043 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1105/2191] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:25:37 2022] PUT /identity/v3/projects/1129d6675ec943bb89c8d64d98629146/users/f00e153b15824dada3c0ee4fb1556eab/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:25:41.603361 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a863b82-e93e-467a-9533-d133ff4be186 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:41.603942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a863b82-e93e-467a-9533-d133ff4be186 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:41.605071 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a863b82-e93e-467a-9533-d133ff4be186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:41.643207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-9a863b82-e93e-467a-9533-d133ff4be186 None None] MFA Rules not processed for user `c998847bbf28471b8df1260e807e0bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:41.649727 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9a863b82-e93e-467a-9533-d133ff4be186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:41.748012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1087/2192] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:44.698330 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b600f7e-ad8b-42fd-b719-cb39f663d404 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:44.701855 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-1b600f7e-ad8b-42fd-b719-cb39f663d404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:44.782713 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b23db-08dd-45e3-9581-9c516350aa4d None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:44.783242 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b23db-08dd-45e3-9581-9c516350aa4d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:44.783343 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b23db-08dd-45e3-9581-9c516350aa4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:44.804283 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:44.818428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-686b23db-08dd-45e3-9581-9c516350aa4d None None] MFA Rules not processed for user `f00e153b15824dada3c0ee4fb1556eab`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:44.821895 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-686b23db-08dd-45e3-9581-9c516350aa4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:44.843079 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b600f7e-ad8b-42fd-b719-cb39f663d404 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:44.848538 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d0f85-9c7a-430b-b453-ecb5123dcc3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ebc95c1b3284c1d8321900cf442a811', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:44.850405 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d0f85-9c7a-430b-b453-ecb5123dcc3f service placement] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:44.850405 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d0f85-9c7a-430b-b453-ecb5123dcc3f service placement] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:44.850405 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d0f85-9c7a-430b-b453-ecb5123dcc3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:44.851742 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-ea9d0f85-9c7a-430b-b453-ecb5123dcc3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:44.864836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d0f85-9c7a-430b-b453-ecb5123dcc3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:44.866636 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d0f85-9c7a-430b-b453-ecb5123dcc3f service placement] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:44.877944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1106/2193] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:25:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:25:44.900505 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1088/2194] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:25:44.915623 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d0f85-9c7a-430b-b453-ecb5123dcc3f service placement] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:44.917149 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-ea9d0f85-9c7a-430b-b453-ecb5123dcc3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:45.026391 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d0f85-9c7a-430b-b453-ecb5123dcc3f service placement] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:45.032333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598d0c4-0834-438a-86e7-067919247ffa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:45.032998 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598d0c4-0834-438a-86e7-067919247ffa service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:45.033283 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598d0c4-0834-438a-86e7-067919247ffa service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:45.033565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598d0c4-0834-438a-86e7-067919247ffa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:45.113579 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598d0c4-0834-438a-86e7-067919247ffa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:45.115415 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598d0c4-0834-438a-86e7-067919247ffa service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:45.126425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1107/2195] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:25:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:25:46.903775 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c7e97-ad6b-4bfb-98bc-c653f14d1f37 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:46.904253 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c7e97-ad6b-4bfb-98bc-c653f14d1f37 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:46.904387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c7e97-ad6b-4bfb-98bc-c653f14d1f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:46.949330 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-b40c7e97-ad6b-4bfb-98bc-c653f14d1f37 None None] MFA Rules not processed for user `235042beafd246c5b227b3926098c8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:46.951637 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b40c7e97-ad6b-4bfb-98bc-c653f14d1f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:47.040352 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1089/2196] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jun 2 19:25:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:25:47.042136 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598d0c4-0834-438a-86e7-067919247ffa service nova] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:47.043625 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-f598d0c4-0834-438a-86e7-067919247ffa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:47.134470 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:47.180946 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598d0c4-0834-438a-86e7-067919247ffa service nova] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:47.188903 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad4ce0-b26b-4d80-a036-e0532b2db16e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ba0ab9510d49c4ab4c634e82790efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:47.190589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad4ce0-b26b-4d80-a036-e0532b2db16e service swift] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:47.196886 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad4ce0-b26b-4d80-a036-e0532b2db16e service swift] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:47.197410 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad4ce0-b26b-4d80-a036-e0532b2db16e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:47.223351 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad4ce0-b26b-4d80-a036-e0532b2db16e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:47.225203 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad4ce0-b26b-4d80-a036-e0532b2db16e service swift] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:47.236276 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1108/2197] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jun 2 19:25:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 19:25:48.480210 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c7e97-ad6b-4bfb-98bc-c653f14d1f37 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:48.482027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b40c7e97-ad6b-4bfb-98bc-c653f14d1f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:48.565444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:48.696098 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c7e97-ad6b-4bfb-98bc-c653f14d1f37 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:48.708287 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0482e-8912-4755-82da-a04b706a5437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:48.709122 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0482e-8912-4755-82da-a04b706a5437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:48.709412 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0482e-8912-4755-82da-a04b706a5437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:48.709688 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0482e-8912-4755-82da-a04b706a5437 admin admin] PATH_INFO: `/v3/users/16d60d70038d4ff7a882d35d818fd661` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:48.712429 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0482e-8912-4755-82da-a04b706a5437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16d60d70038d4ff7a882d35d818fd661)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:48.717441 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0482e-8912-4755-82da-a04b706a5437 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:48.856365 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c4ed9-1ff3-4771-af86-a7164bcab7eb None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:48.860509 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c4ed9-1ff3-4771-af86-a7164bcab7eb None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:48.860509 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c4ed9-1ff3-4771-af86-a7164bcab7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:48.892555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-3b8c4ed9-1ff3-4771-af86-a7164bcab7eb None None] MFA Rules not processed for user `ccd665ac694340bfb99d8f5dbcb4f5f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:48.896291 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-3b8c4ed9-1ff3-4771-af86-a7164bcab7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:48.923507 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1109/2198] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:48.984565 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-8cd0482e-8912-4755-82da-a04b706a5437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16d60d70038d4ff7a882d35d818fd661'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:48.995036 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-8cd0482e-8912-4755-82da-a04b706a5437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16d60d70038d4ff7a882d35d818fd661'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:48.995886 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-8cd0482e-8912-4755-82da-a04b706a5437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16d60d70038d4ff7a882d35d818fd661'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:48.996588 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-8cd0482e-8912-4755-82da-a04b706a5437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16d60d70038d4ff7a882d35d818fd661'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:49.014894 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-8cd0482e-8912-4755-82da-a04b706a5437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16d60d70038d4ff7a882d35d818fd661'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:49.137243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1090/2199] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:25:48 2022] DELETE /identity/v3/users/16d60d70038d4ff7a882d35d818fd661 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:25:49.141927 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c21da8-68e7-4529-8da4-7a29d8985f7c None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:49.142239 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c21da8-68e7-4529-8da4-7a29d8985f7c None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:49.142517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c21da8-68e7-4529-8da4-7a29d8985f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:49.227524 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-71c21da8-68e7-4529-8da4-7a29d8985f7c None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:49.249093 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-71c21da8-68e7-4529-8da4-7a29d8985f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:49.489647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1110/2200] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:49.502022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0482e-8912-4755-82da-a04b706a5437 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:49.504039 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8cd0482e-8912-4755-82da-a04b706a5437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:49.673019 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0482e-8912-4755-82da-a04b706a5437 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:49.685300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb1131-bd27-4227-bd25-50c58adf4d44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:49.686585 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb1131-bd27-4227-bd25-50c58adf4d44 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:49.688810 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb1131-bd27-4227-bd25-50c58adf4d44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:49.689436 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb1131-bd27-4227-bd25-50c58adf4d44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:49.725156 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb1131-bd27-4227-bd25-50c58adf4d44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:49.726691 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb1131-bd27-4227-bd25-50c58adf4d44 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:49.795095 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1091/2201] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:25:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:25:50.508998 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c21da8-68e7-4529-8da4-7a29d8985f7c None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:50.516165 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-71c21da8-68e7-4529-8da4-7a29d8985f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:50.531070 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c21da8-68e7-4529-8da4-7a29d8985f7c None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:50.542594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7dd6c5-d2e5-410f-85e2-1006c9fa4734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:50.544948 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dd6c5-d2e5-410f-85e2-1006c9fa4734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:50.545762 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dd6c5-d2e5-410f-85e2-1006c9fa4734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:50.546151 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dd6c5-d2e5-410f-85e2-1006c9fa4734 admin admin] PATH_INFO: `/v3/projects/f1420743836f47a0a0287c4c275fc40a` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:50.548542 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7dd6c5-d2e5-410f-85e2-1006c9fa4734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1420743836f47a0a0287c4c275fc40a)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:50.551347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7dd6c5-d2e5-410f-85e2-1006c9fa4734 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:50.705698 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-3d7dd6c5-d2e5-410f-85e2-1006c9fa4734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1420743836f47a0a0287c4c275fc40a', 'request_id': 'req-3d7dd6c5-d2e5-410f-85e2-1006c9fa4734'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:50.794965 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-3d7dd6c5-d2e5-410f-85e2-1006c9fa4734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1420743836f47a0a0287c4c275fc40a', 'request_id': 'req-3d7dd6c5-d2e5-410f-85e2-1006c9fa4734'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:50.807913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-3d7dd6c5-d2e5-410f-85e2-1006c9fa4734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1420743836f47a0a0287c4c275fc40a', 'request_id': 'req-3d7dd6c5-d2e5-410f-85e2-1006c9fa4734'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:50.846154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-3d7dd6c5-d2e5-410f-85e2-1006c9fa4734 admin admin] The token cache is being invalidate because project f1420743836f47a0a0287c4c275fc40a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:25:50.847023 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-3d7dd6c5-d2e5-410f-85e2-1006c9fa4734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:50.847985 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-3d7dd6c5-d2e5-410f-85e2-1006c9fa4734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:25:50.856796 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3ecde-b3f3-4cb3-a579-b23362165bd9 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:50.857736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3ecde-b3f3-4cb3-a579-b23362165bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:50.858243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3ecde-b3f3-4cb3-a579-b23362165bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:50.860070 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1111/2202] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:25:50 2022] DELETE /identity/v3/projects/f1420743836f47a0a0287c4c275fc40a => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:25:50.881949 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-05d3ecde-b3f3-4cb3-a579-b23362165bd9 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:50.883554 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-05d3ecde-b3f3-4cb3-a579-b23362165bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:50.948983 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:51.081013 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1092/2203] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:51.084124 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815fb02-35c1-4146-80fe-d4c60f8e160f None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:51.084618 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815fb02-35c1-4146-80fe-d4c60f8e160f None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:51.084909 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815fb02-35c1-4146-80fe-d4c60f8e160f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:51.113900 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-e815fb02-35c1-4146-80fe-d4c60f8e160f None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:51.115478 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-e815fb02-35c1-4146-80fe-d4c60f8e160f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:51.130445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1112/2204] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:51.131962 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3ecde-b3f3-4cb3-a579-b23362165bd9 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:51.145945 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3ecde-b3f3-4cb3-a579-b23362165bd9 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:51.156677 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056712d-baf9-4375-9c99-bd4c0fcf5e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:51.157638 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056712d-baf9-4375-9c99-bd4c0fcf5e16 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:51.158024 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056712d-baf9-4375-9c99-bd4c0fcf5e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:51.158401 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056712d-baf9-4375-9c99-bd4c0fcf5e16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:51.159270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056712d-baf9-4375-9c99-bd4c0fcf5e16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:25:51.159699 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056712d-baf9-4375-9c99-bd4c0fcf5e16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:51.161553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056712d-baf9-4375-9c99-bd4c0fcf5e16 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:51.193460 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1093/2205] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:25:51.198918 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815fb02-35c1-4146-80fe-d4c60f8e160f None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:51.222767 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815fb02-35c1-4146-80fe-d4c60f8e160f None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:51.232637 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81d9e0-d891-4f1a-9ca5-4facb43b3145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:51.233865 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81d9e0-d891-4f1a-9ca5-4facb43b3145 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:51.234466 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81d9e0-d891-4f1a-9ca5-4facb43b3145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:51.235108 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81d9e0-d891-4f1a-9ca5-4facb43b3145 admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:51.236104 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81d9e0-d891-4f1a-9ca5-4facb43b3145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:51.238330 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81d9e0-d891-4f1a-9ca5-4facb43b3145 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:51.685626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1113/2206] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:25:51 2022] POST /identity/v3/projects => generated 375 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:25:51.689927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056712d-baf9-4375-9c99-bd4c0fcf5e16 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:51.704037 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056712d-baf9-4375-9c99-bd4c0fcf5e16 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:51.802911 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69942341-2d42-4b1c-a84c-6ba976ba5b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:51.803788 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69942341-2d42-4b1c-a84c-6ba976ba5b80 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:51.804225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69942341-2d42-4b1c-a84c-6ba976ba5b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:51.804647 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69942341-2d42-4b1c-a84c-6ba976ba5b80 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:51.805573 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69942341-2d42-4b1c-a84c-6ba976ba5b80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:51.807907 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69942341-2d42-4b1c-a84c-6ba976ba5b80 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:51.919242 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1094/2207] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:25:51 2022] POST /identity/v3/users => generated 288 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:25:51.923356 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81d9e0-d891-4f1a-9ca5-4facb43b3145 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:51.933890 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81d9e0-d891-4f1a-9ca5-4facb43b3145 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:51.938722 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81525e30-155e-4fc5-bdf9-d7fc81713a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:51.939389 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81525e30-155e-4fc5-bdf9-d7fc81713a33 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:51.939669 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81525e30-155e-4fc5-bdf9-d7fc81713a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:51.939948 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81525e30-155e-4fc5-bdf9-d7fc81713a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:51.940706 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81525e30-155e-4fc5-bdf9-d7fc81713a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:51.942310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81525e30-155e-4fc5-bdf9-d7fc81713a33 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:51.954056 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1114/2208] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:25:51.961257 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69942341-2d42-4b1c-a84c-6ba976ba5b80 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:51.972790 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69942341-2d42-4b1c-a84c-6ba976ba5b80 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:51.981924 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd763f60-a914-435c-83d3-9ae729a18cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:51.982606 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd763f60-a914-435c-83d3-9ae729a18cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:51.982887 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd763f60-a914-435c-83d3-9ae729a18cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:51.983158 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd763f60-a914-435c-83d3-9ae729a18cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:51.983889 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd763f60-a914-435c-83d3-9ae729a18cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:51.985545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd763f60-a914-435c-83d3-9ae729a18cd8 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:51.996310 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1095/2209] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:25:52.011705 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81525e30-155e-4fc5-bdf9-d7fc81713a33 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:52.015851 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81525e30-155e-4fc5-bdf9-d7fc81713a33 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:52.021133 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974110ef-ad25-4dee-be9c-2f534f484e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:52.022267 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974110ef-ad25-4dee-be9c-2f534f484e18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:52.022551 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974110ef-ad25-4dee-be9c-2f534f484e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:52.022827 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974110ef-ad25-4dee-be9c-2f534f484e18 admin admin] PATH_INFO: `/v3/projects/3e609ac00a214d329faa15b921cc896c/users/73a2041baaa541029e3391469c5a9784/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:52.033885 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:52.045546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974110ef-ad25-4dee-be9c-2f534f484e18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e609ac00a214d329faa15b921cc896c, user_id=73a2041baaa541029e3391469c5a9784, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:52.048474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974110ef-ad25-4dee-be9c-2f534f484e18 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:52.176600 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1115/2210] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:25:51 2022] PUT /identity/v3/projects/3e609ac00a214d329faa15b921cc896c/users/73a2041baaa541029e3391469c5a9784/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:25:52.178207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12935ab4-50f9-48ee-8de6-6aa41ed5b45f None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:52.178499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12935ab4-50f9-48ee-8de6-6aa41ed5b45f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:52.178806 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12935ab4-50f9-48ee-8de6-6aa41ed5b45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:52.214248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-12935ab4-50f9-48ee-8de6-6aa41ed5b45f None None] MFA Rules not processed for user `73a2041baaa541029e3391469c5a9784`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:25:52.220077 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-12935ab4-50f9-48ee-8de6-6aa41ed5b45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:52.351082 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1096/2211] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:25:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:25:52.365204 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974110ef-ad25-4dee-be9c-2f534f484e18 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:52.367025 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-974110ef-ad25-4dee-be9c-2f534f484e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:52.435773 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974110ef-ad25-4dee-be9c-2f534f484e18 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:52.440955 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827155e1-dddf-4e3d-8da5-315af4cc8cbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:52.441626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827155e1-dddf-4e3d-8da5-315af4cc8cbb service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:52.441950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827155e1-dddf-4e3d-8da5-315af4cc8cbb service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:52.442247 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827155e1-dddf-4e3d-8da5-315af4cc8cbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:52.452661 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827155e1-dddf-4e3d-8da5-315af4cc8cbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:52.454241 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827155e1-dddf-4e3d-8da5-315af4cc8cbb service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:52.469227 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1116/2212] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:25:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:26:02.347382 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=74,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:26:02.895258 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=31,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:26:07.233645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12935ab4-50f9-48ee-8de6-6aa41ed5b45f None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:26:07.305103 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12935ab4-50f9-48ee-8de6-6aa41ed5b45f None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:26:07.310350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33877c88-4b90-4b4c-b295-a3b081518960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:26:07.311227 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33877c88-4b90-4b4c-b295-a3b081518960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:07.311509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33877c88-4b90-4b4c-b295-a3b081518960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:07.311784 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33877c88-4b90-4b4c-b295-a3b081518960 admin admin] PATH_INFO: `/v3/users/73a2041baaa541029e3391469c5a9784` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:07.313013 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33877c88-4b90-4b4c-b295-a3b081518960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73a2041baaa541029e3391469c5a9784)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:26:07.314968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33877c88-4b90-4b4c-b295-a3b081518960 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:26:07.508416 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-33877c88-4b90-4b4c-b295-a3b081518960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73a2041baaa541029e3391469c5a9784'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:26:07.515536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-33877c88-4b90-4b4c-b295-a3b081518960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73a2041baaa541029e3391469c5a9784'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:26:07.516328 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-33877c88-4b90-4b4c-b295-a3b081518960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73a2041baaa541029e3391469c5a9784'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:26:07.516957 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-33877c88-4b90-4b4c-b295-a3b081518960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73a2041baaa541029e3391469c5a9784'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:26:07.529514 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-33877c88-4b90-4b4c-b295-a3b081518960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73a2041baaa541029e3391469c5a9784'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:26:07.626198 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1097/2213] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:26:07 2022] DELETE /identity/v3/users/73a2041baaa541029e3391469c5a9784 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:26:07.630773 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21924e07-7967-440d-9828-f6358785d0fd None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:07.631292 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21924e07-7967-440d-9828-f6358785d0fd None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:07.631397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21924e07-7967-440d-9828-f6358785d0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:07.648552 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-21924e07-7967-440d-9828-f6358785d0fd None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:26:07.650334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-21924e07-7967-440d-9828-f6358785d0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:26:07.713180 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1117/2214] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:26:07.723488 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33877c88-4b90-4b4c-b295-a3b081518960 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:26:07.725006 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-33877c88-4b90-4b4c-b295-a3b081518960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:26:07.791347 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33877c88-4b90-4b4c-b295-a3b081518960 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:26:07.795083 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf988a1b-80e4-4b2e-88ad-d9a6eaa82f87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:26:07.795821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf988a1b-80e4-4b2e-88ad-d9a6eaa82f87 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:07.796165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf988a1b-80e4-4b2e-88ad-d9a6eaa82f87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:07.800839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf988a1b-80e4-4b2e-88ad-d9a6eaa82f87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:07.812715 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf988a1b-80e4-4b2e-88ad-d9a6eaa82f87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:26:07.814255 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf988a1b-80e4-4b2e-88ad-d9a6eaa82f87 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:26:07.825804 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1098/2215] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:26:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:26:08.278594 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21924e07-7967-440d-9828-f6358785d0fd None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:26:08.280448 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-21924e07-7967-440d-9828-f6358785d0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:26:08.292858 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21924e07-7967-440d-9828-f6358785d0fd None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:26:08.298391 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478560b0-9a02-4648-98da-c92af8fcc99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:26:08.299281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478560b0-9a02-4648-98da-c92af8fcc99b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:08.299677 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478560b0-9a02-4648-98da-c92af8fcc99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:08.300273 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478560b0-9a02-4648-98da-c92af8fcc99b admin admin] PATH_INFO: `/v3/projects/3e609ac00a214d329faa15b921cc896c` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:08.301169 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478560b0-9a02-4648-98da-c92af8fcc99b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e609ac00a214d329faa15b921cc896c)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:26:08.303132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478560b0-9a02-4648-98da-c92af8fcc99b admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:26:08.440271 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-478560b0-9a02-4648-98da-c92af8fcc99b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e609ac00a214d329faa15b921cc896c', 'request_id': 'req-478560b0-9a02-4648-98da-c92af8fcc99b'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:26:08.517367 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-478560b0-9a02-4648-98da-c92af8fcc99b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e609ac00a214d329faa15b921cc896c', 'request_id': 'req-478560b0-9a02-4648-98da-c92af8fcc99b'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:26:08.523236 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-478560b0-9a02-4648-98da-c92af8fcc99b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e609ac00a214d329faa15b921cc896c', 'request_id': 'req-478560b0-9a02-4648-98da-c92af8fcc99b'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:26:08.534441 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-478560b0-9a02-4648-98da-c92af8fcc99b admin admin] The token cache is being invalidate because project 3e609ac00a214d329faa15b921cc896c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:26:08.534728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-478560b0-9a02-4648-98da-c92af8fcc99b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:26:08.535363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-478560b0-9a02-4648-98da-c92af8fcc99b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:26:08.536995 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1118/2216] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:26:08 2022] DELETE /identity/v3/projects/3e609ac00a214d329faa15b921cc896c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:26:08.544134 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48203fff-0fe3-4385-8b96-538ded9a9f38 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:08.544683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48203fff-0fe3-4385-8b96-538ded9a9f38 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:08.544824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48203fff-0fe3-4385-8b96-538ded9a9f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:08.562798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-48203fff-0fe3-4385-8b96-538ded9a9f38 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:26:08.563984 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-48203fff-0fe3-4385-8b96-538ded9a9f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:26:08.580980 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:26:08.624714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1099/2217] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:26:08.632261 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcd5fb-1e19-4fe9-8a86-2af7dd95e82a None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:08.632761 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcd5fb-1e19-4fe9-8a86-2af7dd95e82a None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:08.632883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcd5fb-1e19-4fe9-8a86-2af7dd95e82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:08.651195 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-e7fcd5fb-1e19-4fe9-8a86-2af7dd95e82a None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:26:08.652458 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-e7fcd5fb-1e19-4fe9-8a86-2af7dd95e82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:26:08.660633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1119/2218] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:26:08.664944 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48203fff-0fe3-4385-8b96-538ded9a9f38 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:26:08.675186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48203fff-0fe3-4385-8b96-538ded9a9f38 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:26:08.679987 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21853a2-71f3-4c84-80cc-387ad8249f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:26:08.680671 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21853a2-71f3-4c84-80cc-387ad8249f1e admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:08.681568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21853a2-71f3-4c84-80cc-387ad8249f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:08.681847 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21853a2-71f3-4c84-80cc-387ad8249f1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:08.682579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21853a2-71f3-4c84-80cc-387ad8249f1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:26:08.682887 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21853a2-71f3-4c84-80cc-387ad8249f1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:26:08.684586 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21853a2-71f3-4c84-80cc-387ad8249f1e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:26:08.697489 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1100/2219] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:26:08.701824 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcd5fb-1e19-4fe9-8a86-2af7dd95e82a None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:26:08.711284 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcd5fb-1e19-4fe9-8a86-2af7dd95e82a None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:26:08.716028 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c2f2a-634e-4d41-a0ce-c9b076db2f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:26:08.716678 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c2f2a-634e-4d41-a0ce-c9b076db2f03 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:08.716950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c2f2a-634e-4d41-a0ce-c9b076db2f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:08.717401 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c2f2a-634e-4d41-a0ce-c9b076db2f03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:08.718094 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c2f2a-634e-4d41-a0ce-c9b076db2f03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:26:08.720015 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c2f2a-634e-4d41-a0ce-c9b076db2f03 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:26:08.805153 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1120/2220] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:26:08 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:26:08.810066 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21853a2-71f3-4c84-80cc-387ad8249f1e admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:26:08.820292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21853a2-71f3-4c84-80cc-387ad8249f1e admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:26:08.880045 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8f2f0-856e-45a3-8a3b-6bceced2a42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:26:08.880730 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8f2f0-856e-45a3-8a3b-6bceced2a42a admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:08.881007 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8f2f0-856e-45a3-8a3b-6bceced2a42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:08.881280 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8f2f0-856e-45a3-8a3b-6bceced2a42a admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:08.881990 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8f2f0-856e-45a3-8a3b-6bceced2a42a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:26:08.883923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8f2f0-856e-45a3-8a3b-6bceced2a42a admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:26:09.003371 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1101/2221] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:26:08 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:26:09.010158 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c2f2a-634e-4d41-a0ce-c9b076db2f03 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:26:09.021149 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c2f2a-634e-4d41-a0ce-c9b076db2f03 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:26:09.026929 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be897b40-0388-458f-8192-4e0ab2c8e13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:26:09.027582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be897b40-0388-458f-8192-4e0ab2c8e13f admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:09.027866 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be897b40-0388-458f-8192-4e0ab2c8e13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:09.028187 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be897b40-0388-458f-8192-4e0ab2c8e13f admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:09.028915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be897b40-0388-458f-8192-4e0ab2c8e13f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:26:09.030603 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be897b40-0388-458f-8192-4e0ab2c8e13f admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:26:09.042149 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1121/2222] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:26:09.046288 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8f2f0-856e-45a3-8a3b-6bceced2a42a admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:26:09.056690 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8f2f0-856e-45a3-8a3b-6bceced2a42a admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:26:09.061369 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0140aa-e335-4728-8134-dbfc1a890113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:26:09.064622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0140aa-e335-4728-8134-dbfc1a890113 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:09.064622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0140aa-e335-4728-8134-dbfc1a890113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:09.064622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0140aa-e335-4728-8134-dbfc1a890113 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:09.064622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0140aa-e335-4728-8134-dbfc1a890113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:26:09.065302 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0140aa-e335-4728-8134-dbfc1a890113 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:26:09.076119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1102/2223] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:26:09.080326 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be897b40-0388-458f-8192-4e0ab2c8e13f admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:26:09.090813 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be897b40-0388-458f-8192-4e0ab2c8e13f admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:26:09.095655 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69519d-b701-4d97-80ee-115d1e98602c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:26:09.096560 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69519d-b701-4d97-80ee-115d1e98602c admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:09.096834 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69519d-b701-4d97-80ee-115d1e98602c admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:09.097106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69519d-b701-4d97-80ee-115d1e98602c admin admin] PATH_INFO: `/v3/projects/c29ae6d5357b46d1954cd7759038c85b/users/994fb70de2844ee78bd7253da4014857/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:09.113029 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69519d-b701-4d97-80ee-115d1e98602c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c29ae6d5357b46d1954cd7759038c85b, user_id=994fb70de2844ee78bd7253da4014857, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:26:09.115692 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69519d-b701-4d97-80ee-115d1e98602c admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:26:09.204088 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1122/2224] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:26:09 2022] PUT /identity/v3/projects/c29ae6d5357b46d1954cd7759038c85b/users/994fb70de2844ee78bd7253da4014857/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:26:09.214957 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360328ac-5326-4979-a1b3-f6827454dfe1 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:09.215248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360328ac-5326-4979-a1b3-f6827454dfe1 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:09.215527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360328ac-5326-4979-a1b3-f6827454dfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:09.241979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-360328ac-5326-4979-a1b3-f6827454dfe1 None None] MFA Rules not processed for user `994fb70de2844ee78bd7253da4014857`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:26:09.243167 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-360328ac-5326-4979-a1b3-f6827454dfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:26:09.312680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1103/2225] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:26:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:26:09.324147 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69519d-b701-4d97-80ee-115d1e98602c admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:26:09.326361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-6a69519d-b701-4d97-80ee-115d1e98602c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:26:09.349234 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:26:09.387609 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69519d-b701-4d97-80ee-115d1e98602c admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:26:09.392154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf91cb-dd54-4b90-9f7b-19c50860881d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:26:09.392825 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf91cb-dd54-4b90-9f7b-19c50860881d service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:09.393108 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf91cb-dd54-4b90-9f7b-19c50860881d service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:09.393386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf91cb-dd54-4b90-9f7b-19c50860881d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:09.403214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf91cb-dd54-4b90-9f7b-19c50860881d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:26:09.404646 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf91cb-dd54-4b90-9f7b-19c50860881d service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:26:09.414643 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1123/2226] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:26:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:26:11.106230 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269c7d5-9b98-4219-8c48-f09372860030 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:11.107148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269c7d5-9b98-4219-8c48-f09372860030 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:11.107148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269c7d5-9b98-4219-8c48-f09372860030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:11.125511 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-4269c7d5-9b98-4219-8c48-f09372860030 None None] MFA Rules not processed for user `994fb70de2844ee78bd7253da4014857`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:26:11.126693 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4269c7d5-9b98-4219-8c48-f09372860030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:26:11.134005 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1104/2227] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:26:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:26:18.419021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd8b75-53ed-4956-9d85-e3aad483143b None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:18.419570 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd8b75-53ed-4956-9d85-e3aad483143b None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:18.419570 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd8b75-53ed-4956-9d85-e3aad483143b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:18.439382 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-9cdd8b75-53ed-4956-9d85-e3aad483143b None None] MFA Rules not processed for user `27c5deeab63347048484a02f6bdbab29`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:26:18.441333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-9cdd8b75-53ed-4956-9d85-e3aad483143b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:26:18.547337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1124/2228] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:26:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:26:21.120167 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:26:28.534052 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=42 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:26:30.438130 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269c7d5-9b98-4219-8c48-f09372860030 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:26:30.441580 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4269c7d5-9b98-4219-8c48-f09372860030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:26:30.513504 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269c7d5-9b98-4219-8c48-f09372860030 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:26:30.517762 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddabf6c-e417-4729-82d1-8c200243c22e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:26:30.518503 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddabf6c-e417-4729-82d1-8c200243c22e service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:30.518854 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddabf6c-e417-4729-82d1-8c200243c22e service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:30.519203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddabf6c-e417-4729-82d1-8c200243c22e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:30.521343 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1ddabf6c-e417-4729-82d1-8c200243c22e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:26:30.592825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddabf6c-e417-4729-82d1-8c200243c22e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:26:30.594321 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddabf6c-e417-4729-82d1-8c200243c22e service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:26:30.611337 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1105/2229] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:26:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:26:40.606313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=50 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:26:41.355959 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd8b75-53ed-4956-9d85-e3aad483143b None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:26:41.365785 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd8b75-53ed-4956-9d85-e3aad483143b None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:26:41.369753 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52477d99-e75f-434b-8881-b3f164a702e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:26:41.370971 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52477d99-e75f-434b-8881-b3f164a702e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:41.371257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52477d99-e75f-434b-8881-b3f164a702e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:41.371535 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52477d99-e75f-434b-8881-b3f164a702e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:41.373392 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-52477d99-e75f-434b-8881-b3f164a702e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:26:41.439686 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52477d99-e75f-434b-8881-b3f164a702e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:26:41.441093 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52477d99-e75f-434b-8881-b3f164a702e9 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:26:41.450932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1125/2230] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:26:41 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:26:42.425032 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c101f9-92f1-4bf6-a903-a7f716588a62 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:42.425901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c101f9-92f1-4bf6-a903-a7f716588a62 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:42.426186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c101f9-92f1-4bf6-a903-a7f716588a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:42.456539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-86c101f9-92f1-4bf6-a903-a7f716588a62 None None] MFA Rules not processed for user `235042beafd246c5b227b3926098c8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:26:42.457922 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-86c101f9-92f1-4bf6-a903-a7f716588a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:26:42.536274 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1106/2231] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jun 2 19:26:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:26:42.572877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52477d99-e75f-434b-8881-b3f164a702e9 service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:26:42.574424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-52477d99-e75f-434b-8881-b3f164a702e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:26:42.649411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52477d99-e75f-434b-8881-b3f164a702e9 service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:26:42.655137 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5772d-49e4-409d-be69-1e86c2a95e73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ba0ab9510d49c4ab4c634e82790efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:26:42.655793 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5772d-49e4-409d-be69-1e86c2a95e73 service swift] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:42.656107 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5772d-49e4-409d-be69-1e86c2a95e73 service swift] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:42.656388 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5772d-49e4-409d-be69-1e86c2a95e73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:42.668189 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5772d-49e4-409d-be69-1e86c2a95e73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:26:42.669947 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5772d-49e4-409d-be69-1e86c2a95e73 service swift] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:26:42.678419 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1126/2232] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jun 2 19:26:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 19:26:43.877959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea3236-e8a2-4d8a-ad5e-5fcf6af13374 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:43.878530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea3236-e8a2-4d8a-ad5e-5fcf6af13374 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:43.878530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea3236-e8a2-4d8a-ad5e-5fcf6af13374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:43.907051 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-03ea3236-e8a2-4d8a-ad5e-5fcf6af13374 None None] MFA Rules not processed for user `235042beafd246c5b227b3926098c8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:26:43.908675 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-03ea3236-e8a2-4d8a-ad5e-5fcf6af13374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:26:43.924584 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1107/2233] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jun 2 19:26:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:26:43.933399 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5772d-49e4-409d-be69-1e86c2a95e73 service swift] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:26:43.945290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5772d-49e4-409d-be69-1e86c2a95e73 service swift] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:26:43.953390 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c471f9-2f37-4224-9748-dafbb0eb84dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ba0ab9510d49c4ab4c634e82790efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:26:43.954734 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c471f9-2f37-4224-9748-dafbb0eb84dc service swift] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:43.955086 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c471f9-2f37-4224-9748-dafbb0eb84dc service swift] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:43.955443 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c471f9-2f37-4224-9748-dafbb0eb84dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:43.975625 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c471f9-2f37-4224-9748-dafbb0eb84dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:26:43.977442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c471f9-2f37-4224-9748-dafbb0eb84dc service swift] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:26:43.990647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1127/2234] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jun 2 19:26:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 19:26:45.528893 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94db8d5-f22b-477b-831f-22ca46aa1a84 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:45.529669 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94db8d5-f22b-477b-831f-22ca46aa1a84 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:45.529669 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94db8d5-f22b-477b-831f-22ca46aa1a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:45.561543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-a94db8d5-f22b-477b-831f-22ca46aa1a84 None None] MFA Rules not processed for user `235042beafd246c5b227b3926098c8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:26:45.563279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a94db8d5-f22b-477b-831f-22ca46aa1a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:26:45.596278 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1108/2235] 10.222.0.45 () {58 vars in 967 bytes} [Thu Jun 2 19:26:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:26:45.623296 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c471f9-2f37-4224-9748-dafbb0eb84dc service swift] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:26:45.641088 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c471f9-2f37-4224-9748-dafbb0eb84dc service swift] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:26:45.654258 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24fd82-3214-4941-8b64-4105a74a4ebd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ba0ab9510d49c4ab4c634e82790efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:26:45.655258 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24fd82-3214-4941-8b64-4105a74a4ebd service swift] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:45.655647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24fd82-3214-4941-8b64-4105a74a4ebd service swift] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:45.658260 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24fd82-3214-4941-8b64-4105a74a4ebd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:45.673535 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24fd82-3214-4941-8b64-4105a74a4ebd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:26:45.675445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24fd82-3214-4941-8b64-4105a74a4ebd service swift] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:26:45.706786 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1128/2236] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jun 2 19:26:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 19:26:46.531717 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739d0df-51fb-4a28-90ab-ab70429e2abb None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:46.532339 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739d0df-51fb-4a28-90ab-ab70429e2abb None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:46.532339 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739d0df-51fb-4a28-90ab-ab70429e2abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:46.559252 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-c739d0df-51fb-4a28-90ab-ab70429e2abb None None] MFA Rules not processed for user `235042beafd246c5b227b3926098c8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:26:46.560643 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c739d0df-51fb-4a28-90ab-ab70429e2abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:26:46.568556 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1109/2237] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jun 2 19:26:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:26:46.581986 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24fd82-3214-4941-8b64-4105a74a4ebd service swift] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:26:46.593609 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24fd82-3214-4941-8b64-4105a74a4ebd service swift] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:26:46.603826 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1cc5b6-50b9-4103-b806-61bee8a54832 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ba0ab9510d49c4ab4c634e82790efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:26:46.605288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cc5b6-50b9-4103-b806-61bee8a54832 service swift] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:46.605694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cc5b6-50b9-4103-b806-61bee8a54832 service swift] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:46.606074 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cc5b6-50b9-4103-b806-61bee8a54832 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:46.616655 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1cc5b6-50b9-4103-b806-61bee8a54832 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:26:46.618293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1cc5b6-50b9-4103-b806-61bee8a54832 service swift] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:26:46.628719 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1129/2238] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jun 2 19:26:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 19:26:47.640953 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fda5d-9efa-4a24-9695-e381c66de488 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:47.641644 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fda5d-9efa-4a24-9695-e381c66de488 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:47.641644 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fda5d-9efa-4a24-9695-e381c66de488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:47.662342 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f83fda5d-9efa-4a24-9695-e381c66de488 None None] MFA Rules not processed for user `235042beafd246c5b227b3926098c8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:26:47.663944 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f83fda5d-9efa-4a24-9695-e381c66de488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:26:47.682526 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1110/2239] 10.222.0.45 () {58 vars in 967 bytes} [Thu Jun 2 19:26:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:26:47.694151 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1cc5b6-50b9-4103-b806-61bee8a54832 service swift] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:26:47.717914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1cc5b6-50b9-4103-b806-61bee8a54832 service swift] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:26:47.737551 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f904a27-d0b9-4527-9f01-eb145bbcc04b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ba0ab9510d49c4ab4c634e82790efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:26:47.738226 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f904a27-d0b9-4527-9f01-eb145bbcc04b service swift] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:47.738796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f904a27-d0b9-4527-9f01-eb145bbcc04b service swift] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:47.739107 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f904a27-d0b9-4527-9f01-eb145bbcc04b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:47.757776 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f904a27-d0b9-4527-9f01-eb145bbcc04b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:26:47.760314 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f904a27-d0b9-4527-9f01-eb145bbcc04b service swift] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:26:47.775388 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1130/2240] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jun 2 19:26:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 19:26:51.331918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fda5d-9efa-4a24-9695-e381c66de488 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:26:51.411831 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fda5d-9efa-4a24-9695-e381c66de488 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:26:51.420544 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02990136-44fb-4852-adec-c2c6678f8abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:26:51.422190 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02990136-44fb-4852-adec-c2c6678f8abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:51.422897 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02990136-44fb-4852-adec-c2c6678f8abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:51.423610 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02990136-44fb-4852-adec-c2c6678f8abb admin admin] PATH_INFO: `/v3/users/994fb70de2844ee78bd7253da4014857` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:51.426005 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02990136-44fb-4852-adec-c2c6678f8abb admin admin] RBAC: Authorizing `identity:delete_user(user_id=994fb70de2844ee78bd7253da4014857)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:26:51.430057 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02990136-44fb-4852-adec-c2c6678f8abb admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:26:51.621720 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-02990136-44fb-4852-adec-c2c6678f8abb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '994fb70de2844ee78bd7253da4014857'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:26:51.631771 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-02990136-44fb-4852-adec-c2c6678f8abb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '994fb70de2844ee78bd7253da4014857'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:26:51.632754 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-02990136-44fb-4852-adec-c2c6678f8abb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '994fb70de2844ee78bd7253da4014857'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:26:51.633372 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-02990136-44fb-4852-adec-c2c6678f8abb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '994fb70de2844ee78bd7253da4014857'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:26:51.646932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-02990136-44fb-4852-adec-c2c6678f8abb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '994fb70de2844ee78bd7253da4014857'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:26:51.712429 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:26:51.727879 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1111/2241] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:26:51 2022] DELETE /identity/v3/users/994fb70de2844ee78bd7253da4014857 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:26:51.733184 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d52da4-8ce9-4186-bd36-2b6f50120f21 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:51.734285 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d52da4-8ce9-4186-bd36-2b6f50120f21 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:51.734572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d52da4-8ce9-4186-bd36-2b6f50120f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:51.757311 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-08d52da4-8ce9-4186-bd36-2b6f50120f21 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:26:51.758670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-08d52da4-8ce9-4186-bd36-2b6f50120f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:26:51.795835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:26:51.844529 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1131/2242] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:26:51.854270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02990136-44fb-4852-adec-c2c6678f8abb admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:26:51.858538 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-02990136-44fb-4852-adec-c2c6678f8abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:26:51.937221 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02990136-44fb-4852-adec-c2c6678f8abb admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:26:51.941500 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f3c82-2059-4eeb-9691-81cb0b90c5f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:26:51.942163 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f3c82-2059-4eeb-9691-81cb0b90c5f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:51.942470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f3c82-2059-4eeb-9691-81cb0b90c5f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:51.942753 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f3c82-2059-4eeb-9691-81cb0b90c5f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:51.954053 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f3c82-2059-4eeb-9691-81cb0b90c5f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:26:51.955611 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f3c82-2059-4eeb-9691-81cb0b90c5f7 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:26:51.969657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1112/2243] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:26:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:26:52.240683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d52da4-8ce9-4186-bd36-2b6f50120f21 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:26:52.243891 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-08d52da4-8ce9-4186-bd36-2b6f50120f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:26:52.280266 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d52da4-8ce9-4186-bd36-2b6f50120f21 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:26:52.288554 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85436f5f-09de-4980-8349-b5a2d2dca5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:26:52.289444 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85436f5f-09de-4980-8349-b5a2d2dca5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:52.289731 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85436f5f-09de-4980-8349-b5a2d2dca5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:52.290012 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85436f5f-09de-4980-8349-b5a2d2dca5e4 admin admin] PATH_INFO: `/v3/projects/c29ae6d5357b46d1954cd7759038c85b` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:52.295008 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85436f5f-09de-4980-8349-b5a2d2dca5e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c29ae6d5357b46d1954cd7759038c85b)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:26:52.296705 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85436f5f-09de-4980-8349-b5a2d2dca5e4 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:26:52.447606 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-85436f5f-09de-4980-8349-b5a2d2dca5e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c29ae6d5357b46d1954cd7759038c85b', 'request_id': 'req-85436f5f-09de-4980-8349-b5a2d2dca5e4'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:26:52.511446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-85436f5f-09de-4980-8349-b5a2d2dca5e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c29ae6d5357b46d1954cd7759038c85b', 'request_id': 'req-85436f5f-09de-4980-8349-b5a2d2dca5e4'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:26:52.523325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-85436f5f-09de-4980-8349-b5a2d2dca5e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c29ae6d5357b46d1954cd7759038c85b', 'request_id': 'req-85436f5f-09de-4980-8349-b5a2d2dca5e4'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:26:52.537171 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-85436f5f-09de-4980-8349-b5a2d2dca5e4 admin admin] The token cache is being invalidate because project c29ae6d5357b46d1954cd7759038c85b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:26:52.537875 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-85436f5f-09de-4980-8349-b5a2d2dca5e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:26:52.538754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-85436f5f-09de-4980-8349-b5a2d2dca5e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:26:52.541307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1132/2244] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:26:52 2022] DELETE /identity/v3/projects/c29ae6d5357b46d1954cd7759038c85b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:27:01.479178 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cc473-330f-4c11-bb01-104a7180ab68 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:27:01.479760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cc473-330f-4c11-bb01-104a7180ab68 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:27:01.479760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cc473-330f-4c11-bb01-104a7180ab68 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:27:01.481240 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1113/2245] 10.222.0.45 () {54 vars in 921 bytes} [Thu Jun 2 19:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:27:01.488453 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce9a61-ed3a-4b38-9218-e7d18997750e None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:27:01.489007 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce9a61-ed3a-4b38-9218-e7d18997750e None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:27:01.489007 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce9a61-ed3a-4b38-9218-e7d18997750e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:27:01.527852 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-87ce9a61-ed3a-4b38-9218-e7d18997750e None None] MFA Rules not processed for user `575f61ef70314f86b5d9dad3ba1b3aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:27:01.530016 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-87ce9a61-ed3a-4b38-9218-e7d18997750e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:27:01.600574 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1133/2246] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jun 2 19:27:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:27:01.612395 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cc473-330f-4c11-bb01-104a7180ab68 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:27:01.614087 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0a1cc473-330f-4c11-bb01-104a7180ab68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:27:01.674443 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cc473-330f-4c11-bb01-104a7180ab68 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:27:01.678238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e8fac-ea2e-4bad-9c19-b19bf744b00d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '226743f4f93c44c5aef5919a7813bd3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:27:01.678887 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e8fac-ea2e-4bad-9c19-b19bf744b00d service glance] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:27:01.679168 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e8fac-ea2e-4bad-9c19-b19bf744b00d service glance] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:27:01.679442 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e8fac-ea2e-4bad-9c19-b19bf744b00d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:27:01.690513 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e8fac-ea2e-4bad-9c19-b19bf744b00d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:27:01.691940 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e8fac-ea2e-4bad-9c19-b19bf744b00d service glance] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:27:01.703932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1114/2247] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:27:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:27:01.924514 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fddc9-83c0-442e-b335-2723babe0ff3 None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:27:01.924939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fddc9-83c0-442e-b335-2723babe0ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:27:01.925356 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fddc9-83c0-442e-b335-2723babe0ff3 None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:27:01.926890 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1134/2248] 10.222.0.45 () {54 vars in 921 bytes} [Thu Jun 2 19:27:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:27:01.932407 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3e9e3-6996-40b8-9f85-07dae07bdbb8 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:27:01.933003 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3e9e3-6996-40b8-9f85-07dae07bdbb8 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:27:01.933348 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3e9e3-6996-40b8-9f85-07dae07bdbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:27:01.954893 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-0cd3e9e3-6996-40b8-9f85-07dae07bdbb8 None None] MFA Rules not processed for user `2efd679ca9314c8591cabbca15f8c61b`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:27:01.956022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0cd3e9e3-6996-40b8-9f85-07dae07bdbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:27:02.015757 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1115/2249] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jun 2 19:27:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:27:02.028263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fddc9-83c0-442e-b335-2723babe0ff3 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:27:02.030746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-ce9fddc9-83c0-442e-b335-2723babe0ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:27:02.044881 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fddc9-83c0-442e-b335-2723babe0ff3 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:27:02.052329 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994265b2-e4f4-4ee3-b91d-5c87469be541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:27:02.052329 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994265b2-e4f4-4ee3-b91d-5c87469be541 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:27:02.052329 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994265b2-e4f4-4ee3-b91d-5c87469be541 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:27:02.052329 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994265b2-e4f4-4ee3-b91d-5c87469be541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:27:02.057777 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994265b2-e4f4-4ee3-b91d-5c87469be541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:27:02.059238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994265b2-e4f4-4ee3-b91d-5c87469be541 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:27:02.068181 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1135/2250] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:27:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:27:02.158865 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f7fc2-bd29-4f1e-ade3-b9d52b9cc9c7 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:27:02.159154 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f7fc2-bd29-4f1e-ade3-b9d52b9cc9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:27:02.159487 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f7fc2-bd29-4f1e-ade3-b9d52b9cc9c7 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:27:02.161010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1116/2251] 10.222.0.45 () {54 vars in 921 bytes} [Thu Jun 2 19:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:27:02.173688 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c41cc-1a13-4451-9042-55cac3a5f3b3 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:27:02.173973 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c41cc-1a13-4451-9042-55cac3a5f3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:27:02.174276 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c41cc-1a13-4451-9042-55cac3a5f3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:27:02.192081 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-ac2c41cc-1a13-4451-9042-55cac3a5f3b3 None None] MFA Rules not processed for user `575f61ef70314f86b5d9dad3ba1b3aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:27:02.193297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-ac2c41cc-1a13-4451-9042-55cac3a5f3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:27:02.212943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1136/2252] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jun 2 19:27:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:27:02.223973 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f7fc2-bd29-4f1e-ade3-b9d52b9cc9c7 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:27:02.234869 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f7fc2-bd29-4f1e-ade3-b9d52b9cc9c7 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:27:02.238373 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107737d-2111-46a2-9c0a-d52852f43fc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:27:02.239012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107737d-2111-46a2-9c0a-d52852f43fc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:27:02.239288 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107737d-2111-46a2-9c0a-d52852f43fc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:27:02.239557 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107737d-2111-46a2-9c0a-d52852f43fc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:27:02.254003 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107737d-2111-46a2-9c0a-d52852f43fc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:27:02.255437 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107737d-2111-46a2-9c0a-d52852f43fc8 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:27:02.267052 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1117/2253] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:27:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:27:05.760626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb841a7b-f905-4eaf-8da6-b65dcb1300c3 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:27:05.761094 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb841a7b-f905-4eaf-8da6-b65dcb1300c3 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:27:05.761188 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb841a7b-f905-4eaf-8da6-b65dcb1300c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:27:05.779591 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-fb841a7b-f905-4eaf-8da6-b65dcb1300c3 None None] MFA Rules not processed for user `235042beafd246c5b227b3926098c8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:27:05.780811 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-fb841a7b-f905-4eaf-8da6-b65dcb1300c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:27:05.789369 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:27:05.837671 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1137/2254] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jun 2 19:27:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:27:05.850255 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107737d-2111-46a2-9c0a-d52852f43fc8 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:27:05.851599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8107737d-2111-46a2-9c0a-d52852f43fc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:27:05.894107 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:27:05.918477 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107737d-2111-46a2-9c0a-d52852f43fc8 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:27:05.924182 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db133901-5d7a-447f-905d-ca2dbd99a198 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ba0ab9510d49c4ab4c634e82790efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:27:05.924838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db133901-5d7a-447f-905d-ca2dbd99a198 service swift] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:27:05.925116 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db133901-5d7a-447f-905d-ca2dbd99a198 service swift] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:27:05.925389 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db133901-5d7a-447f-905d-ca2dbd99a198 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:27:05.933599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db133901-5d7a-447f-905d-ca2dbd99a198 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:27:05.935175 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db133901-5d7a-447f-905d-ca2dbd99a198 service swift] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:27:05.943126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1118/2255] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jun 2 19:27:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 19:27:15.887843 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=19 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:27:15.940503 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=14 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:27:33.671330 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8dff2-3425-466a-bc4a-c230b615a495 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:27:33.671866 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8dff2-3425-466a-bc4a-c230b615a495 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:27:33.671866 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8dff2-3425-466a-bc4a-c230b615a495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:27:33.690025 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-c1d8dff2-3425-466a-bc4a-c230b615a495 None None] MFA Rules not processed for user `235042beafd246c5b227b3926098c8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:27:33.691292 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c1d8dff2-3425-466a-bc4a-c230b615a495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:27:33.699076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1138/2256] 10.222.0.45 () {58 vars in 967 bytes} [Thu Jun 2 19:27:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:27:33.711859 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db133901-5d7a-447f-905d-ca2dbd99a198 service swift] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:27:33.723030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db133901-5d7a-447f-905d-ca2dbd99a198 service swift] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:27:33.728209 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eed94e-64dd-492d-b0f4-868c52afa2ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ba0ab9510d49c4ab4c634e82790efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:27:33.728851 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eed94e-64dd-492d-b0f4-868c52afa2ec service swift] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:27:33.729135 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eed94e-64dd-492d-b0f4-868c52afa2ec service swift] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:27:33.729408 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eed94e-64dd-492d-b0f4-868c52afa2ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:27:33.738092 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eed94e-64dd-492d-b0f4-868c52afa2ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:27:33.739738 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eed94e-64dd-492d-b0f4-868c52afa2ec service swift] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:27:33.747780 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1119/2257] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jun 2 19:27:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 19:27:43.684818 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:27:43.744620 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=6 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:27:46.812435 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d5230-3ddc-4053-88d5-67ac223c6fbc None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:27:46.812877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d5230-3ddc-4053-88d5-67ac223c6fbc None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:27:46.812991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d5230-3ddc-4053-88d5-67ac223c6fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:27:46.830989 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-733d5230-3ddc-4053-88d5-67ac223c6fbc None None] MFA Rules not processed for user `8fce5ea9cc1346b89cce855aaaa77466`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:27:46.832205 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-733d5230-3ddc-4053-88d5-67ac223c6fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:27:46.884402 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1139/2258] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:27:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:27:54.991136 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eed94e-64dd-492d-b0f4-868c52afa2ec service swift] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:27:54.992566 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-36eed94e-64dd-492d-b0f4-868c52afa2ec service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:27:55.053740 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eed94e-64dd-492d-b0f4-868c52afa2ec service swift] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:27:55.057278 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54543b-70de-4317-8463-0492f4c57c6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:27:55.057925 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54543b-70de-4317-8463-0492f4c57c6d service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:27:55.058206 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54543b-70de-4317-8463-0492f4c57c6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:27:55.058484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54543b-70de-4317-8463-0492f4c57c6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:27:55.060557 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-bd54543b-70de-4317-8463-0492f4c57c6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:27:55.074320 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54543b-70de-4317-8463-0492f4c57c6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:27:55.075755 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54543b-70de-4317-8463-0492f4c57c6d service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:27:55.086596 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1120/2259] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:27:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:27:56.877871 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=25 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:27:59.018467 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d5230-3ddc-4053-88d5-67ac223c6fbc None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:27:59.028079 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d5230-3ddc-4053-88d5-67ac223c6fbc None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:27:59.032201 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399e36c-8786-4e12-92c5-f6a8c5cb8465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:27:59.032839 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399e36c-8786-4e12-92c5-f6a8c5cb8465 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:27:59.033120 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399e36c-8786-4e12-92c5-f6a8c5cb8465 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:27:59.033396 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399e36c-8786-4e12-92c5-f6a8c5cb8465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:27:59.035170 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-3399e36c-8786-4e12-92c5-f6a8c5cb8465 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:27:59.048658 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399e36c-8786-4e12-92c5-f6a8c5cb8465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:27:59.050017 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399e36c-8786-4e12-92c5-f6a8c5cb8465 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:27:59.061011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1140/2260] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:27:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:28:05.081874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=26 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:28:09.056030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=6 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:28:19.327072 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54543b-70de-4317-8463-0492f4c57c6d service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:28:19.328629 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-bd54543b-70de-4317-8463-0492f4c57c6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:28:19.340793 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54543b-70de-4317-8463-0492f4c57c6d service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:28:19.344384 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aaaa53-0ba8-460c-8f7e-a9d635a73511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:28:19.345682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaaa53-0ba8-460c-8f7e-a9d635a73511 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:28:19.345964 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaaa53-0ba8-460c-8f7e-a9d635a73511 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:28:19.346232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaaa53-0ba8-460c-8f7e-a9d635a73511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:28:19.347988 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-87aaaa53-0ba8-460c-8f7e-a9d635a73511 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:28:19.357327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aaaa53-0ba8-460c-8f7e-a9d635a73511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:28:19.358721 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aaaa53-0ba8-460c-8f7e-a9d635a73511 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:28:19.366725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1121/2261] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:28:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:28:29.363077 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=6 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:28:30.579030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399e36c-8786-4e12-92c5-f6a8c5cb8465 service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:28:30.580474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-3399e36c-8786-4e12-92c5-f6a8c5cb8465 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:28:30.593958 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399e36c-8786-4e12-92c5-f6a8c5cb8465 service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:28:30.599871 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20367ad9-948a-4f29-b7d7-ce5e0924081c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:28:30.600576 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20367ad9-948a-4f29-b7d7-ce5e0924081c service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:28:30.600863 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20367ad9-948a-4f29-b7d7-ce5e0924081c service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:28:30.601140 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20367ad9-948a-4f29-b7d7-ce5e0924081c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:28:30.602912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-20367ad9-948a-4f29-b7d7-ce5e0924081c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:28:30.664854 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20367ad9-948a-4f29-b7d7-ce5e0924081c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:28:30.666521 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20367ad9-948a-4f29-b7d7-ce5e0924081c service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:28:30.677423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1141/2262] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:28:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:28:34.289335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aaaa53-0ba8-460c-8f7e-a9d635a73511 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:28:34.305076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aaaa53-0ba8-460c-8f7e-a9d635a73511 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:28:34.312079 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a16d1-499b-46d6-bb29-9597066b3531 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:28:34.312982 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a16d1-499b-46d6-bb29-9597066b3531 service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:28:34.313523 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a16d1-499b-46d6-bb29-9597066b3531 service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:28:34.313989 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a16d1-499b-46d6-bb29-9597066b3531 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:28:34.316072 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8e1a16d1-499b-46d6-bb29-9597066b3531 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:28:34.330695 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a16d1-499b-46d6-bb29-9597066b3531 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:28:34.333753 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a16d1-499b-46d6-bb29-9597066b3531 service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:28:34.346769 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1122/2263] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:28:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:28:40.672211 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=28 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:28:43.071272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20367ad9-948a-4f29-b7d7-ce5e0924081c service nova] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:28:43.084387 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20367ad9-948a-4f29-b7d7-ce5e0924081c service nova] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:28:43.091763 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d3a5c-e5ee-4ae2-ab5c-064946f19db7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:28:43.092615 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d3a5c-e5ee-4ae2-ab5c-064946f19db7 service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:28:43.092938 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d3a5c-e5ee-4ae2-ab5c-064946f19db7 service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:28:43.093141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d3a5c-e5ee-4ae2-ab5c-064946f19db7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:28:43.095046 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-589d3a5c-e5ee-4ae2-ab5c-064946f19db7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:28:43.109368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d3a5c-e5ee-4ae2-ab5c-064946f19db7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:28:43.120525 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d3a5c-e5ee-4ae2-ab5c-064946f19db7 service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:28:43.124033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1142/2264] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:28:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:28:44.341358 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=6 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:28:47.368127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f5e59-39a4-49b6-b570-7577ec9e2cf5 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:28:47.368127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f5e59-39a4-49b6-b570-7577ec9e2cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:28:47.368127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f5e59-39a4-49b6-b570-7577ec9e2cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:28:47.382875 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-011f5e59-39a4-49b6-b570-7577ec9e2cf5 None None] MFA Rules not processed for user `27c5deeab63347048484a02f6bdbab29`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:28:47.384133 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-011f5e59-39a4-49b6-b570-7577ec9e2cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:28:47.391161 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1123/2265] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:28:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:28:47.707425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d3a5c-e5ee-4ae2-ab5c-064946f19db7 service nova] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:28:47.717003 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d3a5c-e5ee-4ae2-ab5c-064946f19db7 service nova] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:28:47.721877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8dbf6-f769-4b02-85a6-03088de6f3a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:28:47.723186 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8dbf6-f769-4b02-85a6-03088de6f3a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:28:47.723474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8dbf6-f769-4b02-85a6-03088de6f3a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:28:47.723755 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8dbf6-f769-4b02-85a6-03088de6f3a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:28:47.725621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c4f8dbf6-f769-4b02-85a6-03088de6f3a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:28:47.735854 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8dbf6-f769-4b02-85a6-03088de6f3a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:28:47.737334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8dbf6-f769-4b02-85a6-03088de6f3a5 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:28:47.745840 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1143/2266] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:28:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:28:48.131012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f5e59-39a4-49b6-b570-7577ec9e2cf5 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:28:48.132502 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-011f5e59-39a4-49b6-b570-7577ec9e2cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:28:48.216792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f5e59-39a4-49b6-b570-7577ec9e2cf5 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:28:48.221861 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d3c59-877a-4e48-9538-f7c67c8d3c62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ebc95c1b3284c1d8321900cf442a811', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:28:48.223020 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d3c59-877a-4e48-9538-f7c67c8d3c62 service placement] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:28:48.223296 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d3c59-877a-4e48-9538-f7c67c8d3c62 service placement] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:28:48.223567 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d3c59-877a-4e48-9538-f7c67c8d3c62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:28:48.225376 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-408d3c59-877a-4e48-9538-f7c67c8d3c62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:28:48.236855 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d3c59-877a-4e48-9538-f7c67c8d3c62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:28:48.239893 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d3c59-877a-4e48-9538-f7c67c8d3c62 service placement] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:28:48.248889 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1124/2267] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:28:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:28:52.619088 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8dbf6-f769-4b02-85a6-03088de6f3a5 service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:28:52.620813 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c4f8dbf6-f769-4b02-85a6-03088de6f3a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:28:52.639924 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8dbf6-f769-4b02-85a6-03088de6f3a5 service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:28:52.653269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62db6b-60d3-48ad-8849-d338d03d0135 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:28:52.653943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62db6b-60d3-48ad-8849-d338d03d0135 service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:28:52.654223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62db6b-60d3-48ad-8849-d338d03d0135 service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:28:52.654495 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62db6b-60d3-48ad-8849-d338d03d0135 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:28:52.656741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-fc62db6b-60d3-48ad-8849-d338d03d0135 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:28:52.719596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62db6b-60d3-48ad-8849-d338d03d0135 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:28:52.721315 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62db6b-60d3-48ad-8849-d338d03d0135 service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:28:52.732604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1144/2268] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:28:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:28:58.244744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=35 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:28:59.690753 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d3c59-877a-4e48-9538-f7c67c8d3c62 service placement] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:28:59.704685 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d3c59-877a-4e48-9538-f7c67c8d3c62 service placement] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:28:59.710983 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec0dfd-6472-40f3-929e-2bcdfb5eb5a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:28:59.711632 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec0dfd-6472-40f3-929e-2bcdfb5eb5a8 service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:28:59.711913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec0dfd-6472-40f3-929e-2bcdfb5eb5a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:28:59.712254 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec0dfd-6472-40f3-929e-2bcdfb5eb5a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:28:59.714202 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-05ec0dfd-6472-40f3-929e-2bcdfb5eb5a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:28:59.727825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec0dfd-6472-40f3-929e-2bcdfb5eb5a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:28:59.729581 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec0dfd-6472-40f3-929e-2bcdfb5eb5a8 service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:28:59.741266 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1125/2269] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:28:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:28:59.827483 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62db6b-60d3-48ad-8849-d338d03d0135 service nova] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:28:59.831221 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-fc62db6b-60d3-48ad-8849-d338d03d0135 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:28:59.840987 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62db6b-60d3-48ad-8849-d338d03d0135 service nova] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:28:59.844767 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41478499-b635-4f25-a271-c14e59a72ee9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:28:59.845444 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41478499-b635-4f25-a271-c14e59a72ee9 service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:28:59.845856 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41478499-b635-4f25-a271-c14e59a72ee9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:28:59.845991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41478499-b635-4f25-a271-c14e59a72ee9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:28:59.847849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-41478499-b635-4f25-a271-c14e59a72ee9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:28:59.860177 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41478499-b635-4f25-a271-c14e59a72ee9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:28:59.861784 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41478499-b635-4f25-a271-c14e59a72ee9 service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:28:59.872063 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1145/2270] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:28:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:29:07.990517 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35176d36-f0da-4fb2-bbdd-e086ce42e158 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:07.991090 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35176d36-f0da-4fb2-bbdd-e086ce42e158 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:07.991271 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35176d36-f0da-4fb2-bbdd-e086ce42e158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:08.014113 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-35176d36-f0da-4fb2-bbdd-e086ce42e158 None None] MFA Rules not processed for user `f8890c84089c48d291b3ff73e9b2e423`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:29:08.015717 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-35176d36-f0da-4fb2-bbdd-e086ce42e158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:08.024833 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1126/2271] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:29:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:29:09.867671 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=46 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:18.008343 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=9 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:24.888632 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41478499-b635-4f25-a271-c14e59a72ee9 service cinder] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:24.898919 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41478499-b635-4f25-a271-c14e59a72ee9 service cinder] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:24.902649 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c5b78-cda6-4cb0-88b6-a579bbaa2b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:24.903306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c5b78-cda6-4cb0-88b6-a579bbaa2b47 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:24.903853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c5b78-cda6-4cb0-88b6-a579bbaa2b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:24.904158 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c5b78-cda6-4cb0-88b6-a579bbaa2b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:24.905997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-1f8c5b78-cda6-4cb0-88b6-a579bbaa2b47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:24.975171 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c5b78-cda6-4cb0-88b6-a579bbaa2b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:24.976684 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c5b78-cda6-4cb0-88b6-a579bbaa2b47 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:24.988380 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1146/2272] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:29:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:29:28.869850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35176d36-f0da-4fb2-bbdd-e086ce42e158 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:28.882431 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35176d36-f0da-4fb2-bbdd-e086ce42e158 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:28.890956 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6fd81-b96d-4049-9c5c-24b7878f23d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:28.892558 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6fd81-b96d-4049-9c5c-24b7878f23d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:28.893058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6fd81-b96d-4049-9c5c-24b7878f23d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:28.894227 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6fd81-b96d-4049-9c5c-24b7878f23d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:28.897207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-71a6fd81-b96d-4049-9c5c-24b7878f23d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:28.974182 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6fd81-b96d-4049-9c5c-24b7878f23d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:28.976386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6fd81-b96d-4049-9c5c-24b7878f23d4 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:28.990615 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1127/2273] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:29:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:29:31.064757 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c5b78-cda6-4cb0-88b6-a579bbaa2b47 service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:31.077616 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c5b78-cda6-4cb0-88b6-a579bbaa2b47 service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:31.083860 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba46db-b61b-4a7e-b0ce-2db5969a1472 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ebc95c1b3284c1d8321900cf442a811', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:31.084720 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba46db-b61b-4a7e-b0ce-2db5969a1472 service placement] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:31.085074 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba46db-b61b-4a7e-b0ce-2db5969a1472 service placement] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:31.085409 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba46db-b61b-4a7e-b0ce-2db5969a1472 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:31.087425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5dba46db-b61b-4a7e-b0ce-2db5969a1472 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:31.117139 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba46db-b61b-4a7e-b0ce-2db5969a1472 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:31.119205 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba46db-b61b-4a7e-b0ce-2db5969a1472 service placement] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:31.131272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1147/2274] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:29:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:29:31.199830 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6fd81-b96d-4049-9c5c-24b7878f23d4 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:31.201364 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-71a6fd81-b96d-4049-9c5c-24b7878f23d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:31.220434 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6fd81-b96d-4049-9c5c-24b7878f23d4 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:31.225739 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36faaa-3525-45de-a489-907af621652d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:31.226712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36faaa-3525-45de-a489-907af621652d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:31.227060 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36faaa-3525-45de-a489-907af621652d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:31.227402 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36faaa-3525-45de-a489-907af621652d admin admin] PATH_INFO: `/v3/users/8fce5ea9cc1346b89cce855aaaa77466` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:31.228762 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36faaa-3525-45de-a489-907af621652d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fce5ea9cc1346b89cce855aaaa77466)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:31.231424 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36faaa-3525-45de-a489-907af621652d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:31.383044 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a36faaa-3525-45de-a489-907af621652d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fce5ea9cc1346b89cce855aaaa77466'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:31.391132 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a36faaa-3525-45de-a489-907af621652d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fce5ea9cc1346b89cce855aaaa77466'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:31.391848 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a36faaa-3525-45de-a489-907af621652d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fce5ea9cc1346b89cce855aaaa77466'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:31.392937 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a36faaa-3525-45de-a489-907af621652d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fce5ea9cc1346b89cce855aaaa77466'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:31.405657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a36faaa-3525-45de-a489-907af621652d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fce5ea9cc1346b89cce855aaaa77466'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:31.489923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1128/2275] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:29:31 2022] DELETE /identity/v3/users/8fce5ea9cc1346b89cce855aaaa77466 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:29:31.818013 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba46db-b61b-4a7e-b0ce-2db5969a1472 service placement] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:31.838627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba46db-b61b-4a7e-b0ce-2db5969a1472 service placement] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:31.915646 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72500242-778f-46e8-bd7b-97412baecfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:31.916561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72500242-778f-46e8-bd7b-97412baecfd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:31.916842 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72500242-778f-46e8-bd7b-97412baecfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:31.917117 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72500242-778f-46e8-bd7b-97412baecfd3 admin admin] PATH_INFO: `/v3/projects/7b00525fe239473b834f484d0726af59` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:31.918363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72500242-778f-46e8-bd7b-97412baecfd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b00525fe239473b834f484d0726af59)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:31.920574 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72500242-778f-46e8-bd7b-97412baecfd3 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:32.082099 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-72500242-778f-46e8-bd7b-97412baecfd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b00525fe239473b834f484d0726af59', 'request_id': 'req-72500242-778f-46e8-bd7b-97412baecfd3'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:32.136785 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-72500242-778f-46e8-bd7b-97412baecfd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b00525fe239473b834f484d0726af59', 'request_id': 'req-72500242-778f-46e8-bd7b-97412baecfd3'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:32.146043 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-72500242-778f-46e8-bd7b-97412baecfd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b00525fe239473b834f484d0726af59', 'request_id': 'req-72500242-778f-46e8-bd7b-97412baecfd3'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:32.172367 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-72500242-778f-46e8-bd7b-97412baecfd3 admin admin] The token cache is being invalidate because project 7b00525fe239473b834f484d0726af59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:29:32.172880 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-72500242-778f-46e8-bd7b-97412baecfd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:32.173930 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-72500242-778f-46e8-bd7b-97412baecfd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:32.181930 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1148/2276] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:29:31 2022] DELETE /identity/v3/projects/7b00525fe239473b834f484d0726af59 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:29:32.183655 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06352985-1f2f-495b-800e-d81c12577930 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:32.189267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06352985-1f2f-495b-800e-d81c12577930 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:32.189267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06352985-1f2f-495b-800e-d81c12577930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:32.204866 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-06352985-1f2f-495b-800e-d81c12577930 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:29:32.206089 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-06352985-1f2f-495b-800e-d81c12577930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:32.278108 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1129/2277] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:29:32.289170 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc034e6f-0346-4949-b072-3e9b518698ff None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:32.289501 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc034e6f-0346-4949-b072-3e9b518698ff None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:32.289749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc034e6f-0346-4949-b072-3e9b518698ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:32.310535 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-dc034e6f-0346-4949-b072-3e9b518698ff None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:29:32.311762 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-dc034e6f-0346-4949-b072-3e9b518698ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:32.320917 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1149/2278] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:29:32.325874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06352985-1f2f-495b-800e-d81c12577930 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:32.345046 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06352985-1f2f-495b-800e-d81c12577930 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:32.361224 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe1a4a-1ea7-4c56-8980-fe7ade83ee3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:32.362826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe1a4a-1ea7-4c56-8980-fe7ade83ee3f admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:32.363182 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe1a4a-1ea7-4c56-8980-fe7ade83ee3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:32.363528 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe1a4a-1ea7-4c56-8980-fe7ade83ee3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:32.364526 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe1a4a-1ea7-4c56-8980-fe7ade83ee3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:29:32.364904 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe1a4a-1ea7-4c56-8980-fe7ade83ee3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:32.366599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe1a4a-1ea7-4c56-8980-fe7ade83ee3f admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:32.374009 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:32.380063 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1130/2279] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:29:32.384853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc034e6f-0346-4949-b072-3e9b518698ff None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:32.390578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:32.394944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc034e6f-0346-4949-b072-3e9b518698ff None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:32.400368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be8e12-71af-4035-9c53-dd9443b83254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:32.401031 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be8e12-71af-4035-9c53-dd9443b83254 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:32.401312 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be8e12-71af-4035-9c53-dd9443b83254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:32.401590 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be8e12-71af-4035-9c53-dd9443b83254 admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:32.402283 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be8e12-71af-4035-9c53-dd9443b83254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:32.404278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be8e12-71af-4035-9c53-dd9443b83254 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:32.508609 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1150/2280] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:29:32 2022] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:29:32.512865 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe1a4a-1ea7-4c56-8980-fe7ade83ee3f admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:32.524127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe1a4a-1ea7-4c56-8980-fe7ade83ee3f admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:32.603677 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdf621-90a4-4d4a-86ef-3ea5490155a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:32.604628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdf621-90a4-4d4a-86ef-3ea5490155a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:32.604913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdf621-90a4-4d4a-86ef-3ea5490155a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:32.605188 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdf621-90a4-4d4a-86ef-3ea5490155a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:32.605904 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdf621-90a4-4d4a-86ef-3ea5490155a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:32.607862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdf621-90a4-4d4a-86ef-3ea5490155a2 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:32.707448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1131/2281] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:29:32 2022] POST /identity/v3/users => generated 284 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:29:32.711537 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be8e12-71af-4035-9c53-dd9443b83254 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:32.726877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be8e12-71af-4035-9c53-dd9443b83254 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:32.731563 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65cb21-5476-4e9d-9f81-456cde567914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:32.732264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65cb21-5476-4e9d-9f81-456cde567914 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:32.732548 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65cb21-5476-4e9d-9f81-456cde567914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:32.732824 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65cb21-5476-4e9d-9f81-456cde567914 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:32.733749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65cb21-5476-4e9d-9f81-456cde567914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:32.735533 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65cb21-5476-4e9d-9f81-456cde567914 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:32.746651 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1151/2282] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:29:32.752060 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdf621-90a4-4d4a-86ef-3ea5490155a2 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:32.764075 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdf621-90a4-4d4a-86ef-3ea5490155a2 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:32.772138 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c1f84-1178-4554-bb6e-6e8ff53483b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:32.772822 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c1f84-1178-4554-bb6e-6e8ff53483b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:32.778313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c1f84-1178-4554-bb6e-6e8ff53483b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:32.778313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c1f84-1178-4554-bb6e-6e8ff53483b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:32.778313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c1f84-1178-4554-bb6e-6e8ff53483b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:32.780272 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c1f84-1178-4554-bb6e-6e8ff53483b0 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:32.798605 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1132/2283] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:29:32.803024 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65cb21-5476-4e9d-9f81-456cde567914 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:32.818272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65cb21-5476-4e9d-9f81-456cde567914 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:32.829578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2d02c-0af9-42c1-b96d-4b702943020b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:32.830804 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2d02c-0af9-42c1-b96d-4b702943020b admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:32.831286 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2d02c-0af9-42c1-b96d-4b702943020b admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:32.831568 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2d02c-0af9-42c1-b96d-4b702943020b admin admin] PATH_INFO: `/v3/projects/63f46de437d148cd935e2af66034d8b2/users/60672355097c44fdaa2b63fb5216655f/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:32.849760 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2d02c-0af9-42c1-b96d-4b702943020b admin admin] RBAC: Authorizing `identity:create_grant(project_id=63f46de437d148cd935e2af66034d8b2, user_id=60672355097c44fdaa2b63fb5216655f, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:32.852221 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2d02c-0af9-42c1-b96d-4b702943020b admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:32.934569 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1152/2284] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:29:32 2022] PUT /identity/v3/projects/63f46de437d148cd935e2af66034d8b2/users/60672355097c44fdaa2b63fb5216655f/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:29:32.953074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2feb1-b48c-450d-bcde-8e4a882b12c0 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:32.953074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2feb1-b48c-450d-bcde-8e4a882b12c0 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:32.953074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2feb1-b48c-450d-bcde-8e4a882b12c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:32.988373 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-77d2feb1-b48c-450d-bcde-8e4a882b12c0 None None] MFA Rules not processed for user `60672355097c44fdaa2b63fb5216655f`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:29:32.990331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-77d2feb1-b48c-450d-bcde-8e4a882b12c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:33.067457 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1133/2285] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:29:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:29:33.078586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2d02c-0af9-42c1-b96d-4b702943020b admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:33.080767 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-e2e2d02c-0af9-42c1-b96d-4b702943020b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:33.178103 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2d02c-0af9-42c1-b96d-4b702943020b admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:33.182413 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069035e-dae5-41d4-84e2-daca5468c37c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:33.183415 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069035e-dae5-41d4-84e2-daca5468c37c service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:33.183866 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069035e-dae5-41d4-84e2-daca5468c37c service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:33.184358 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069035e-dae5-41d4-84e2-daca5468c37c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:33.194165 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069035e-dae5-41d4-84e2-daca5468c37c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:33.197980 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069035e-dae5-41d4-84e2-daca5468c37c service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:33.214709 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1153/2286] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:29:33 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:29:37.955413 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86fbf0-8e82-440a-9954-c0e1b2d7d173 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:37.955961 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86fbf0-8e82-440a-9954-c0e1b2d7d173 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:37.956099 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86fbf0-8e82-440a-9954-c0e1b2d7d173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:37.974470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-4a86fbf0-8e82-440a-9954-c0e1b2d7d173 None None] MFA Rules not processed for user `35658a179ed84e2d949312d9bde201a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:29:37.975660 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4a86fbf0-8e82-440a-9954-c0e1b2d7d173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:38.029946 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1134/2287] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:29:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:29:38.361285 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069035e-dae5-41d4-84e2-daca5468c37c service cinder] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:38.363336 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-8069035e-dae5-41d4-84e2-daca5468c37c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:38.426077 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069035e-dae5-41d4-84e2-daca5468c37c service cinder] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:38.430235 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b41a1e-b9bb-4be7-917c-65507bc4f92d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:38.430873 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b41a1e-b9bb-4be7-917c-65507bc4f92d service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:38.431155 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b41a1e-b9bb-4be7-917c-65507bc4f92d service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:38.431427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b41a1e-b9bb-4be7-917c-65507bc4f92d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:38.433283 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-66b41a1e-b9bb-4be7-917c-65507bc4f92d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:38.442740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b41a1e-b9bb-4be7-917c-65507bc4f92d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:38.444529 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b41a1e-b9bb-4be7-917c-65507bc4f92d service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:38.452434 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1154/2288] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:29:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:29:39.532334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd83e90-6150-4c3f-b440-44cbcd4e5d71 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:39.532828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd83e90-6150-4c3f-b440-44cbcd4e5d71 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:39.533121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd83e90-6150-4c3f-b440-44cbcd4e5d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:39.552934 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-ecd83e90-6150-4c3f-b440-44cbcd4e5d71 None None] MFA Rules not processed for user `235042beafd246c5b227b3926098c8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:29:39.553210 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ecd83e90-6150-4c3f-b440-44cbcd4e5d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:39.559469 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:39.617470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1135/2289] 10.222.0.45 () {58 vars in 967 bytes} [Thu Jun 2 19:29:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:29:39.757552 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b41a1e-b9bb-4be7-917c-65507bc4f92d service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:39.758990 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-66b41a1e-b9bb-4be7-917c-65507bc4f92d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:39.808390 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:39.833469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b41a1e-b9bb-4be7-917c-65507bc4f92d service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:39.839701 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab979ba-d327-476a-bd74-3d64a24b7fb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ba0ab9510d49c4ab4c634e82790efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:39.840647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab979ba-d327-476a-bd74-3d64a24b7fb8 service swift] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:39.840934 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab979ba-d327-476a-bd74-3d64a24b7fb8 service swift] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:39.841264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab979ba-d327-476a-bd74-3d64a24b7fb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:39.851473 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab979ba-d327-476a-bd74-3d64a24b7fb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:39.853131 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab979ba-d327-476a-bd74-3d64a24b7fb8 service swift] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:39.862956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1155/2290] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jun 2 19:29:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 19:29:43.529830 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd83e90-6150-4c3f-b440-44cbcd4e5d71 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:43.599598 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd83e90-6150-4c3f-b440-44cbcd4e5d71 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:43.604756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8d706-9c5b-4057-ae09-b531024c09e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:43.605655 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8d706-9c5b-4057-ae09-b531024c09e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:43.605993 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8d706-9c5b-4057-ae09-b531024c09e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:43.606207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8d706-9c5b-4057-ae09-b531024c09e7 admin admin] PATH_INFO: `/v3/users/60672355097c44fdaa2b63fb5216655f` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:43.607462 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8d706-9c5b-4057-ae09-b531024c09e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60672355097c44fdaa2b63fb5216655f)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:43.612853 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8d706-9c5b-4057-ae09-b531024c09e7 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:43.845949 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-f0d8d706-9c5b-4057-ae09-b531024c09e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60672355097c44fdaa2b63fb5216655f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:43.859114 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-f0d8d706-9c5b-4057-ae09-b531024c09e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60672355097c44fdaa2b63fb5216655f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:43.864310 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-f0d8d706-9c5b-4057-ae09-b531024c09e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60672355097c44fdaa2b63fb5216655f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:43.866398 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-f0d8d706-9c5b-4057-ae09-b531024c09e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60672355097c44fdaa2b63fb5216655f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:43.898402 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-f0d8d706-9c5b-4057-ae09-b531024c09e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60672355097c44fdaa2b63fb5216655f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:43.983129 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1136/2291] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:29:43 2022] DELETE /identity/v3/users/60672355097c44fdaa2b63fb5216655f => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:29:43.989877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fcddc-38f2-4e3b-a72b-be2407cff746 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:43.990383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fcddc-38f2-4e3b-a72b-be2407cff746 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:43.990498 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fcddc-38f2-4e3b-a72b-be2407cff746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:44.012738 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-084fcddc-38f2-4e3b-a72b-be2407cff746 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:29:44.014296 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-084fcddc-38f2-4e3b-a72b-be2407cff746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:44.123131 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1156/2292] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:29:44.135089 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8d706-9c5b-4057-ae09-b531024c09e7 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:44.137495 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f0d8d706-9c5b-4057-ae09-b531024c09e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:44.184434 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:44.205068 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8d706-9c5b-4057-ae09-b531024c09e7 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:44.209898 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466cb3c-717a-4a6f-810b-76dc2e7a0dd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:44.210573 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466cb3c-717a-4a6f-810b-76dc2e7a0dd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:44.210875 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466cb3c-717a-4a6f-810b-76dc2e7a0dd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:44.211226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466cb3c-717a-4a6f-810b-76dc2e7a0dd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:44.221639 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466cb3c-717a-4a6f-810b-76dc2e7a0dd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:44.223153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466cb3c-717a-4a6f-810b-76dc2e7a0dd3 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:44.236041 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1137/2293] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:29:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:29:44.756649 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fcddc-38f2-4e3b-a72b-be2407cff746 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:44.758517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-084fcddc-38f2-4e3b-a72b-be2407cff746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:44.773933 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fcddc-38f2-4e3b-a72b-be2407cff746 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:44.779941 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95708469-c23c-4384-a685-6fbd91fcb361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:44.781222 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95708469-c23c-4384-a685-6fbd91fcb361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:44.781687 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95708469-c23c-4384-a685-6fbd91fcb361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:44.782019 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95708469-c23c-4384-a685-6fbd91fcb361 admin admin] PATH_INFO: `/v3/projects/63f46de437d148cd935e2af66034d8b2` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:44.783359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95708469-c23c-4384-a685-6fbd91fcb361 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63f46de437d148cd935e2af66034d8b2)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:44.785379 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95708469-c23c-4384-a685-6fbd91fcb361 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:44.883912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-95708469-c23c-4384-a685-6fbd91fcb361 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63f46de437d148cd935e2af66034d8b2', 'request_id': 'req-95708469-c23c-4384-a685-6fbd91fcb361'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:44.930828 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-95708469-c23c-4384-a685-6fbd91fcb361 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63f46de437d148cd935e2af66034d8b2', 'request_id': 'req-95708469-c23c-4384-a685-6fbd91fcb361'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:44.938617 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-95708469-c23c-4384-a685-6fbd91fcb361 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63f46de437d148cd935e2af66034d8b2', 'request_id': 'req-95708469-c23c-4384-a685-6fbd91fcb361'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:44.954604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-95708469-c23c-4384-a685-6fbd91fcb361 admin admin] The token cache is being invalidate because project 63f46de437d148cd935e2af66034d8b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:29:44.955267 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-95708469-c23c-4384-a685-6fbd91fcb361 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:44.956079 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-95708469-c23c-4384-a685-6fbd91fcb361 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:44.961016 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1157/2294] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:29:44 2022] DELETE /identity/v3/projects/63f46de437d148cd935e2af66034d8b2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:29:44.974507 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457bf32-2fb7-49f9-ad93-72f84e5dc903 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:44.974507 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457bf32-2fb7-49f9-ad93-72f84e5dc903 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:44.974507 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457bf32-2fb7-49f9-ad93-72f84e5dc903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:44.988139 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-7457bf32-2fb7-49f9-ad93-72f84e5dc903 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:29:44.989952 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7457bf32-2fb7-49f9-ad93-72f84e5dc903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:45.055800 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1138/2295] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:29:45.063915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559dcdf-ce53-463f-9129-0cf2e1f0c42a None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:45.065955 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559dcdf-ce53-463f-9129-0cf2e1f0c42a None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:45.065955 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559dcdf-ce53-463f-9129-0cf2e1f0c42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:45.084945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-7559dcdf-ce53-463f-9129-0cf2e1f0c42a None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:29:45.086395 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-7559dcdf-ce53-463f-9129-0cf2e1f0c42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:45.094723 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1158/2296] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:29:45.099576 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457bf32-2fb7-49f9-ad93-72f84e5dc903 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:45.109623 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457bf32-2fb7-49f9-ad93-72f84e5dc903 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:45.115623 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be199f1c-2387-43e6-916b-7713bb5a8599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:45.116320 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be199f1c-2387-43e6-916b-7713bb5a8599 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:45.116755 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be199f1c-2387-43e6-916b-7713bb5a8599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:45.116935 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be199f1c-2387-43e6-916b-7713bb5a8599 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:45.117664 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be199f1c-2387-43e6-916b-7713bb5a8599 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:29:45.118017 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be199f1c-2387-43e6-916b-7713bb5a8599 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:45.119742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be199f1c-2387-43e6-916b-7713bb5a8599 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:45.137342 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1139/2297] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:29:45.138470 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559dcdf-ce53-463f-9129-0cf2e1f0c42a None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:45.151418 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559dcdf-ce53-463f-9129-0cf2e1f0c42a None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:45.157280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d172e01-9df7-4681-ade0-68032a4a8918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:45.157978 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d172e01-9df7-4681-ade0-68032a4a8918 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:45.158265 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d172e01-9df7-4681-ade0-68032a4a8918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:45.158542 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d172e01-9df7-4681-ade0-68032a4a8918 admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:45.159253 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d172e01-9df7-4681-ade0-68032a4a8918 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:45.161755 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d172e01-9df7-4681-ade0-68032a4a8918 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:45.243263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1159/2298] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:29:45 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:29:45.247693 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be199f1c-2387-43e6-916b-7713bb5a8599 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:45.259526 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be199f1c-2387-43e6-916b-7713bb5a8599 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:45.363024 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e239e-bc5e-4603-9657-7e0054ef87b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:45.364369 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e239e-bc5e-4603-9657-7e0054ef87b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:45.365441 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e239e-bc5e-4603-9657-7e0054ef87b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:45.366033 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e239e-bc5e-4603-9657-7e0054ef87b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:45.368232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e239e-bc5e-4603-9657-7e0054ef87b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:45.371603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e239e-bc5e-4603-9657-7e0054ef87b1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:45.451572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1140/2299] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:29:45 2022] POST /identity/v3/users => generated 290 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:29:45.455838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d172e01-9df7-4681-ade0-68032a4a8918 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:45.468511 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d172e01-9df7-4681-ade0-68032a4a8918 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:45.475969 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8c4aa-761f-4fc1-a01a-98912802b78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:45.478654 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8c4aa-761f-4fc1-a01a-98912802b78b admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:45.478654 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8c4aa-761f-4fc1-a01a-98912802b78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:45.478654 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8c4aa-761f-4fc1-a01a-98912802b78b admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:45.479060 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8c4aa-761f-4fc1-a01a-98912802b78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:45.480746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8c4aa-761f-4fc1-a01a-98912802b78b admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:45.492708 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1160/2300] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:29:45.496674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e239e-bc5e-4603-9657-7e0054ef87b1 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:45.512103 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e239e-bc5e-4603-9657-7e0054ef87b1 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:45.520537 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e59688a-774d-4ac2-bb6c-1dfc009d9fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:45.521452 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59688a-774d-4ac2-bb6c-1dfc009d9fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:45.521738 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59688a-774d-4ac2-bb6c-1dfc009d9fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:45.522010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59688a-774d-4ac2-bb6c-1dfc009d9fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:45.522745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e59688a-774d-4ac2-bb6c-1dfc009d9fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:45.525064 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e59688a-774d-4ac2-bb6c-1dfc009d9fd8 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:45.539407 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1141/2301] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:29:45.540648 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8c4aa-761f-4fc1-a01a-98912802b78b admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:45.551532 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8c4aa-761f-4fc1-a01a-98912802b78b admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:45.557175 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b9780-8e0d-405c-9167-fb383941e1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:45.558002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b9780-8e0d-405c-9167-fb383941e1ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:45.558279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b9780-8e0d-405c-9167-fb383941e1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:45.558552 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b9780-8e0d-405c-9167-fb383941e1ba admin admin] PATH_INFO: `/v3/projects/9f0807a1524d41f9b237204d5a4a7ff2/users/308a16547e4e4f6bbf31b583c24bfb43/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:45.576664 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b9780-8e0d-405c-9167-fb383941e1ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f0807a1524d41f9b237204d5a4a7ff2, user_id=308a16547e4e4f6bbf31b583c24bfb43, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:45.579339 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b9780-8e0d-405c-9167-fb383941e1ba admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:45.582082 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:45.698971 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1161/2302] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:29:45 2022] PUT /identity/v3/projects/9f0807a1524d41f9b237204d5a4a7ff2/users/308a16547e4e4f6bbf31b583c24bfb43/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:29:45.711505 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07b005-4a43-410f-b706-0da41a8cf7fd None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:45.711929 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07b005-4a43-410f-b706-0da41a8cf7fd None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:45.712529 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07b005-4a43-410f-b706-0da41a8cf7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:45.771456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-0b07b005-4a43-410f-b706-0da41a8cf7fd None None] MFA Rules not processed for user `308a16547e4e4f6bbf31b583c24bfb43`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:29:45.775465 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0b07b005-4a43-410f-b706-0da41a8cf7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:45.825907 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:45.872720 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1142/2303] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:29:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:29:45.877560 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b9780-8e0d-405c-9167-fb383941e1ba admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:45.942870 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b9780-8e0d-405c-9167-fb383941e1ba admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:45.948069 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737551ab-9b97-4026-9778-945f379a922a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:45.948798 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737551ab-9b97-4026-9778-945f379a922a admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:45.949078 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737551ab-9b97-4026-9778-945f379a922a admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:45.949353 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737551ab-9b97-4026-9778-945f379a922a admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:45.950058 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737551ab-9b97-4026-9778-945f379a922a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:45.951964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737551ab-9b97-4026-9778-945f379a922a admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:46.035152 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1162/2304] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:29:45 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:29:46.039339 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07b005-4a43-410f-b706-0da41a8cf7fd None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:46.050236 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07b005-4a43-410f-b706-0da41a8cf7fd None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:46.109455 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b32f0-424c-47d7-b6fc-38a2c77aacfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:46.110065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b32f0-424c-47d7-b6fc-38a2c77aacfa admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:46.110354 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b32f0-424c-47d7-b6fc-38a2c77aacfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:46.110632 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b32f0-424c-47d7-b6fc-38a2c77aacfa admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:46.111459 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b32f0-424c-47d7-b6fc-38a2c77aacfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:46.114232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b32f0-424c-47d7-b6fc-38a2c77aacfa admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:46.200552 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1143/2305] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:29:46 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:29:46.204562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737551ab-9b97-4026-9778-945f379a922a admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:46.216091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737551ab-9b97-4026-9778-945f379a922a admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:46.227481 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a64e60-67f9-46cc-b409-679825e39a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:46.231671 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a64e60-67f9-46cc-b409-679825e39a4a admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:46.231671 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a64e60-67f9-46cc-b409-679825e39a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:46.233536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a64e60-67f9-46cc-b409-679825e39a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:46.233536 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a64e60-67f9-46cc-b409-679825e39a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:46.234559 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a64e60-67f9-46cc-b409-679825e39a4a admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:46.246682 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1163/2306] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:29:46.250810 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b32f0-424c-47d7-b6fc-38a2c77aacfa admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:46.264495 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b32f0-424c-47d7-b6fc-38a2c77aacfa admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:46.269434 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57bbb9-6ca8-4b6d-9f75-f17f052fd840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:46.271060 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57bbb9-6ca8-4b6d-9f75-f17f052fd840 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:46.271292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57bbb9-6ca8-4b6d-9f75-f17f052fd840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:46.271632 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57bbb9-6ca8-4b6d-9f75-f17f052fd840 admin admin] PATH_INFO: `/v3/projects/5f5e205ee71b400ea4766c68e6070d0b/users/c510c368de924b738d1d42f906f3a789/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:46.289176 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57bbb9-6ca8-4b6d-9f75-f17f052fd840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f5e205ee71b400ea4766c68e6070d0b, user_id=c510c368de924b738d1d42f906f3a789, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:46.296080 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57bbb9-6ca8-4b6d-9f75-f17f052fd840 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:46.364854 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1144/2307] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:29:46 2022] PUT /identity/v3/projects/5f5e205ee71b400ea4766c68e6070d0b/users/c510c368de924b738d1d42f906f3a789/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:29:46.366321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a64e60-67f9-46cc-b409-679825e39a4a admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:46.386635 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a64e60-67f9-46cc-b409-679825e39a4a admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:46.465995 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7b9e8-7eb7-4762-9e79-9eb2838ed721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:46.465995 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7b9e8-7eb7-4762-9e79-9eb2838ed721 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:46.465995 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7b9e8-7eb7-4762-9e79-9eb2838ed721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:46.465995 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7b9e8-7eb7-4762-9e79-9eb2838ed721 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:46.467199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7b9e8-7eb7-4762-9e79-9eb2838ed721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:46.469469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7b9e8-7eb7-4762-9e79-9eb2838ed721 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:46.488036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1164/2308] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:29:46.490541 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57bbb9-6ca8-4b6d-9f75-f17f052fd840 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:46.505136 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57bbb9-6ca8-4b6d-9f75-f17f052fd840 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:46.508607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8f747-4828-48ba-b574-2aa8994e40c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:46.509609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8f747-4828-48ba-b574-2aa8994e40c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:46.509796 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8f747-4828-48ba-b574-2aa8994e40c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:46.510071 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8f747-4828-48ba-b574-2aa8994e40c1 admin admin] PATH_INFO: `/v3/projects/5f5e205ee71b400ea4766c68e6070d0b/users/c510c368de924b738d1d42f906f3a789/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:46.512597 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8f747-4828-48ba-b574-2aa8994e40c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f5e205ee71b400ea4766c68e6070d0b, user_id=c510c368de924b738d1d42f906f3a789, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:46.515396 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8f747-4828-48ba-b574-2aa8994e40c1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:46.537144 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1145/2309] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:29:46 2022] PUT /identity/v3/projects/5f5e205ee71b400ea4766c68e6070d0b/users/c510c368de924b738d1d42f906f3a789/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:29:46.548818 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a06c4d-1389-4aa8-82ec-0a5fc6c3e2f4 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:46.549188 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a06c4d-1389-4aa8-82ec-0a5fc6c3e2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:46.549535 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a06c4d-1389-4aa8-82ec-0a5fc6c3e2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:46.579651 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-16a06c4d-1389-4aa8-82ec-0a5fc6c3e2f4 None None] MFA Rules not processed for user `c510c368de924b738d1d42f906f3a789`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:29:46.581109 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-16a06c4d-1389-4aa8-82ec-0a5fc6c3e2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:46.671327 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:46.690799 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1165/2310] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:29:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:29:46.703753 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8f747-4828-48ba-b574-2aa8994e40c1 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:46.705633 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b0d8f747-4828-48ba-b574-2aa8994e40c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:46.776554 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8f747-4828-48ba-b574-2aa8994e40c1 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:46.780723 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f9e87-d094-40ba-8510-35171d9a2498 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:46.781393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f9e87-d094-40ba-8510-35171d9a2498 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:46.781677 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f9e87-d094-40ba-8510-35171d9a2498 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:46.781954 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f9e87-d094-40ba-8510-35171d9a2498 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:46.795071 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f9e87-d094-40ba-8510-35171d9a2498 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:46.796821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f9e87-d094-40ba-8510-35171d9a2498 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:46.810281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1146/2311] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:29:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:29:47.045123 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a06c4d-1389-4aa8-82ec-0a5fc6c3e2f4 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:47.055803 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a06c4d-1389-4aa8-82ec-0a5fc6c3e2f4 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:47.060385 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba24ca-0316-4e02-98cb-126cc85389a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:47.061056 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba24ca-0316-4e02-98cb-126cc85389a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:47.061340 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba24ca-0316-4e02-98cb-126cc85389a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:47.061616 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba24ca-0316-4e02-98cb-126cc85389a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:47.119823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba24ca-0316-4e02-98cb-126cc85389a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:47.121221 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba24ca-0316-4e02-98cb-126cc85389a5 service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:47.130917 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1166/2312] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:29:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:29:51.317603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f9e87-d094-40ba-8510-35171d9a2498 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:51.319488 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ab8f9e87-d094-40ba-8510-35171d9a2498 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:51.355609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:51.395325 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f9e87-d094-40ba-8510-35171d9a2498 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:51.400879 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cda25c-ab0e-4dab-abf8-06ca06aa0bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:51.401883 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cda25c-ab0e-4dab-abf8-06ca06aa0bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:51.406871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cda25c-ab0e-4dab-abf8-06ca06aa0bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:51.406871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cda25c-ab0e-4dab-abf8-06ca06aa0bf1 admin admin] PATH_INFO: `/v3/users/c998847bbf28471b8df1260e807e0bd1` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:51.406871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cda25c-ab0e-4dab-abf8-06ca06aa0bf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c998847bbf28471b8df1260e807e0bd1)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:51.406871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cda25c-ab0e-4dab-abf8-06ca06aa0bf1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:51.625276 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c4cda25c-ab0e-4dab-abf8-06ca06aa0bf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c998847bbf28471b8df1260e807e0bd1'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:51.635089 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c4cda25c-ab0e-4dab-abf8-06ca06aa0bf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c998847bbf28471b8df1260e807e0bd1'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:51.635927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c4cda25c-ab0e-4dab-abf8-06ca06aa0bf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c998847bbf28471b8df1260e807e0bd1'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:51.636711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c4cda25c-ab0e-4dab-abf8-06ca06aa0bf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c998847bbf28471b8df1260e807e0bd1'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:51.659070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c4cda25c-ab0e-4dab-abf8-06ca06aa0bf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c998847bbf28471b8df1260e807e0bd1'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:51.752064 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1147/2313] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:29:51 2022] DELETE /identity/v3/users/c998847bbf28471b8df1260e807e0bd1 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:29:52.081289 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba24ca-0316-4e02-98cb-126cc85389a5 service cinder] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:52.101784 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba24ca-0316-4e02-98cb-126cc85389a5 service cinder] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:52.167249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e3fb0-6b09-4a0b-a094-da18ced154bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:52.169092 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e3fb0-6b09-4a0b-a094-da18ced154bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:52.169381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e3fb0-6b09-4a0b-a094-da18ced154bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:52.169835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e3fb0-6b09-4a0b-a094-da18ced154bb admin admin] PATH_INFO: `/v3/projects/958764b19ee344de88ee55921bc99ccd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:52.171597 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e3fb0-6b09-4a0b-a094-da18ced154bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=958764b19ee344de88ee55921bc99ccd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:52.173564 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e3fb0-6b09-4a0b-a094-da18ced154bb admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:52.321988 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-fa7e3fb0-6b09-4a0b-a094-da18ced154bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '958764b19ee344de88ee55921bc99ccd', 'request_id': 'req-fa7e3fb0-6b09-4a0b-a094-da18ced154bb'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:52.381846 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-fa7e3fb0-6b09-4a0b-a094-da18ced154bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '958764b19ee344de88ee55921bc99ccd', 'request_id': 'req-fa7e3fb0-6b09-4a0b-a094-da18ced154bb'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:52.386023 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-fa7e3fb0-6b09-4a0b-a094-da18ced154bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '958764b19ee344de88ee55921bc99ccd', 'request_id': 'req-fa7e3fb0-6b09-4a0b-a094-da18ced154bb'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:52.400225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-fa7e3fb0-6b09-4a0b-a094-da18ced154bb admin admin] The token cache is being invalidate because project 958764b19ee344de88ee55921bc99ccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:29:52.405057 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-fa7e3fb0-6b09-4a0b-a094-da18ced154bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:52.405057 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-fa7e3fb0-6b09-4a0b-a094-da18ced154bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:52.405057 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1167/2314] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:29:52 2022] DELETE /identity/v3/projects/958764b19ee344de88ee55921bc99ccd => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:29:52.408420 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cda25c-ab0e-4dab-abf8-06ca06aa0bf1 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:52.409879 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c4cda25c-ab0e-4dab-abf8-06ca06aa0bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:52.423953 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cda25c-ab0e-4dab-abf8-06ca06aa0bf1 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:52.495348 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efe287-2275-4404-8e3d-f469a83b2430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:52.496812 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efe287-2275-4404-8e3d-f469a83b2430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:52.497278 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efe287-2275-4404-8e3d-f469a83b2430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:52.497758 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efe287-2275-4404-8e3d-f469a83b2430 admin admin] PATH_INFO: `/v3/users/21a5dc56fc334170984813d6063c0256` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:52.499040 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efe287-2275-4404-8e3d-f469a83b2430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21a5dc56fc334170984813d6063c0256)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:52.501680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efe287-2275-4404-8e3d-f469a83b2430 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:52.736221 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-97efe287-2275-4404-8e3d-f469a83b2430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21a5dc56fc334170984813d6063c0256'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:52.739251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:52.751528 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-97efe287-2275-4404-8e3d-f469a83b2430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21a5dc56fc334170984813d6063c0256'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:52.751528 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-97efe287-2275-4404-8e3d-f469a83b2430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21a5dc56fc334170984813d6063c0256'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:52.751528 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-97efe287-2275-4404-8e3d-f469a83b2430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21a5dc56fc334170984813d6063c0256'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:52.762676 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-97efe287-2275-4404-8e3d-f469a83b2430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21a5dc56fc334170984813d6063c0256'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:52.867383 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1148/2315] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:29:52 2022] DELETE /identity/v3/users/21a5dc56fc334170984813d6063c0256 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:29:53.171149 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e3fb0-6b09-4a0b-a094-da18ced154bb admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:53.172647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-fa7e3fb0-6b09-4a0b-a094-da18ced154bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:53.199065 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e3fb0-6b09-4a0b-a094-da18ced154bb admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:53.235606 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:53.283860 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b7ded-0e44-47c5-b681-dcdea8ae6fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:53.284923 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b7ded-0e44-47c5-b681-dcdea8ae6fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:53.285321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b7ded-0e44-47c5-b681-dcdea8ae6fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:53.285607 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b7ded-0e44-47c5-b681-dcdea8ae6fb6 admin admin] PATH_INFO: `/v3/projects/da478c0cb4f44fe4a1adb7571ae4e4a9` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:53.286810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b7ded-0e44-47c5-b681-dcdea8ae6fb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da478c0cb4f44fe4a1adb7571ae4e4a9)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:53.288844 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b7ded-0e44-47c5-b681-dcdea8ae6fb6 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:53.407825 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-e00b7ded-0e44-47c5-b681-dcdea8ae6fb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da478c0cb4f44fe4a1adb7571ae4e4a9', 'request_id': 'req-e00b7ded-0e44-47c5-b681-dcdea8ae6fb6'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:53.484948 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-e00b7ded-0e44-47c5-b681-dcdea8ae6fb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da478c0cb4f44fe4a1adb7571ae4e4a9', 'request_id': 'req-e00b7ded-0e44-47c5-b681-dcdea8ae6fb6'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:53.491984 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-e00b7ded-0e44-47c5-b681-dcdea8ae6fb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da478c0cb4f44fe4a1adb7571ae4e4a9', 'request_id': 'req-e00b7ded-0e44-47c5-b681-dcdea8ae6fb6'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:53.505302 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-e00b7ded-0e44-47c5-b681-dcdea8ae6fb6 admin admin] The token cache is being invalidate because project da478c0cb4f44fe4a1adb7571ae4e4a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:29:53.508316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-e00b7ded-0e44-47c5-b681-dcdea8ae6fb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:53.508316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-e00b7ded-0e44-47c5-b681-dcdea8ae6fb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:53.508316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1168/2316] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:29:53 2022] DELETE /identity/v3/projects/da478c0cb4f44fe4a1adb7571ae4e4a9 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:29:55.964124 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efe287-2275-4404-8e3d-f469a83b2430 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:55.966268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-97efe287-2275-4404-8e3d-f469a83b2430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:55.980649 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efe287-2275-4404-8e3d-f469a83b2430 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:56.050852 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea1d5a-b97a-4e3a-9ec3-705c8f3b1c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:56.053493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea1d5a-b97a-4e3a-9ec3-705c8f3b1c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:56.054007 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea1d5a-b97a-4e3a-9ec3-705c8f3b1c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:56.054887 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea1d5a-b97a-4e3a-9ec3-705c8f3b1c1c admin admin] PATH_INFO: `/v3/users/308a16547e4e4f6bbf31b583c24bfb43` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:56.056872 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea1d5a-b97a-4e3a-9ec3-705c8f3b1c1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=308a16547e4e4f6bbf31b583c24bfb43)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:56.060937 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea1d5a-b97a-4e3a-9ec3-705c8f3b1c1c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:56.235264 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-02ea1d5a-b97a-4e3a-9ec3-705c8f3b1c1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '308a16547e4e4f6bbf31b583c24bfb43'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:56.245980 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-02ea1d5a-b97a-4e3a-9ec3-705c8f3b1c1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '308a16547e4e4f6bbf31b583c24bfb43'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:56.246805 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-02ea1d5a-b97a-4e3a-9ec3-705c8f3b1c1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '308a16547e4e4f6bbf31b583c24bfb43'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:56.247833 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-02ea1d5a-b97a-4e3a-9ec3-705c8f3b1c1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '308a16547e4e4f6bbf31b583c24bfb43'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:56.274074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-02ea1d5a-b97a-4e3a-9ec3-705c8f3b1c1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '308a16547e4e4f6bbf31b583c24bfb43'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:56.337013 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1149/2317] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:29:55 2022] DELETE /identity/v3/users/308a16547e4e4f6bbf31b583c24bfb43 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:29:56.341841 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f447f2-4cfc-4729-80fc-7a0834d1e083 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:56.346400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f447f2-4cfc-4729-80fc-7a0834d1e083 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:56.346400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f447f2-4cfc-4729-80fc-7a0834d1e083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:56.360851 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-79f447f2-4cfc-4729-80fc-7a0834d1e083 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:29:56.362074 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-79f447f2-4cfc-4729-80fc-7a0834d1e083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:56.423754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1169/2318] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:29:56.433585 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea1d5a-b97a-4e3a-9ec3-705c8f3b1c1c admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:56.435138 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-02ea1d5a-b97a-4e3a-9ec3-705c8f3b1c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:56.491766 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:56.496018 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea1d5a-b97a-4e3a-9ec3-705c8f3b1c1c admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:56.499868 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20c757-1c56-4e4e-badf-d529a21d245e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:56.500565 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20c757-1c56-4e4e-badf-d529a21d245e service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:56.500842 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20c757-1c56-4e4e-badf-d529a21d245e service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:56.501404 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20c757-1c56-4e4e-badf-d529a21d245e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:56.511148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20c757-1c56-4e4e-badf-d529a21d245e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:56.512628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20c757-1c56-4e4e-badf-d529a21d245e service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:56.522588 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1150/2319] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:29:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:29:56.921301 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f447f2-4cfc-4729-80fc-7a0834d1e083 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:56.922751 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-79f447f2-4cfc-4729-80fc-7a0834d1e083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:56.935539 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f447f2-4cfc-4729-80fc-7a0834d1e083 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:56.940216 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4147b77-f709-4d19-8a86-6d210ace9dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:56.941349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4147b77-f709-4d19-8a86-6d210ace9dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:56.941899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4147b77-f709-4d19-8a86-6d210ace9dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:56.942075 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4147b77-f709-4d19-8a86-6d210ace9dd8 admin admin] PATH_INFO: `/v3/projects/9f0807a1524d41f9b237204d5a4a7ff2` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:56.943304 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4147b77-f709-4d19-8a86-6d210ace9dd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f0807a1524d41f9b237204d5a4a7ff2)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:56.945576 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4147b77-f709-4d19-8a86-6d210ace9dd8 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:57.066351 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:57.070688 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-a4147b77-f709-4d19-8a86-6d210ace9dd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f0807a1524d41f9b237204d5a4a7ff2', 'request_id': 'req-a4147b77-f709-4d19-8a86-6d210ace9dd8'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:57.142341 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-a4147b77-f709-4d19-8a86-6d210ace9dd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f0807a1524d41f9b237204d5a4a7ff2', 'request_id': 'req-a4147b77-f709-4d19-8a86-6d210ace9dd8'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:57.148713 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-a4147b77-f709-4d19-8a86-6d210ace9dd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f0807a1524d41f9b237204d5a4a7ff2', 'request_id': 'req-a4147b77-f709-4d19-8a86-6d210ace9dd8'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:57.162003 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-a4147b77-f709-4d19-8a86-6d210ace9dd8 admin admin] The token cache is being invalidate because project 9f0807a1524d41f9b237204d5a4a7ff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:29:57.162297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-a4147b77-f709-4d19-8a86-6d210ace9dd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:57.162960 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-a4147b77-f709-4d19-8a86-6d210ace9dd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:57.166819 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1170/2320] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:29:56 2022] DELETE /identity/v3/projects/9f0807a1524d41f9b237204d5a4a7ff2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:29:57.168676 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20c757-1c56-4e4e-badf-d529a21d245e service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:57.179349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20c757-1c56-4e4e-badf-d529a21d245e service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:57.273246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414c589-d2ad-42a4-9806-930287028115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:57.274049 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414c589-d2ad-42a4-9806-930287028115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:57.274346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414c589-d2ad-42a4-9806-930287028115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:57.274613 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414c589-d2ad-42a4-9806-930287028115 admin admin] PATH_INFO: `/v3/users/c510c368de924b738d1d42f906f3a789` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:57.275894 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414c589-d2ad-42a4-9806-930287028115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c510c368de924b738d1d42f906f3a789)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:57.277897 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414c589-d2ad-42a4-9806-930287028115 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:57.477905 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a414c589-d2ad-42a4-9806-930287028115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c510c368de924b738d1d42f906f3a789'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:57.485106 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a414c589-d2ad-42a4-9806-930287028115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c510c368de924b738d1d42f906f3a789'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:57.485783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a414c589-d2ad-42a4-9806-930287028115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c510c368de924b738d1d42f906f3a789'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:57.486401 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a414c589-d2ad-42a4-9806-930287028115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c510c368de924b738d1d42f906f3a789'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:57.499415 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a414c589-d2ad-42a4-9806-930287028115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c510c368de924b738d1d42f906f3a789'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:57.600947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1151/2321] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:29:57 2022] DELETE /identity/v3/users/c510c368de924b738d1d42f906f3a789 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:29:58.126236 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4147b77-f709-4d19-8a86-6d210ace9dd8 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:58.127876 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-a4147b77-f709-4d19-8a86-6d210ace9dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:58.140884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4147b77-f709-4d19-8a86-6d210ace9dd8 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:58.196798 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4333aec-ce9b-416f-aa4a-0df5094c0351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:58.197650 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4333aec-ce9b-416f-aa4a-0df5094c0351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:58.197924 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4333aec-ce9b-416f-aa4a-0df5094c0351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:58.198194 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4333aec-ce9b-416f-aa4a-0df5094c0351 admin admin] PATH_INFO: `/v3/projects/5f5e205ee71b400ea4766c68e6070d0b` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:58.199360 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4333aec-ce9b-416f-aa4a-0df5094c0351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f5e205ee71b400ea4766c68e6070d0b)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:58.201290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4333aec-ce9b-416f-aa4a-0df5094c0351 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:58.322990 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-a4333aec-ce9b-416f-aa4a-0df5094c0351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f5e205ee71b400ea4766c68e6070d0b', 'request_id': 'req-a4333aec-ce9b-416f-aa4a-0df5094c0351'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:58.404913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-a4333aec-ce9b-416f-aa4a-0df5094c0351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f5e205ee71b400ea4766c68e6070d0b', 'request_id': 'req-a4333aec-ce9b-416f-aa4a-0df5094c0351'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:58.412320 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-a4333aec-ce9b-416f-aa4a-0df5094c0351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f5e205ee71b400ea4766c68e6070d0b', 'request_id': 'req-a4333aec-ce9b-416f-aa4a-0df5094c0351'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:58.425285 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-a4333aec-ce9b-416f-aa4a-0df5094c0351 admin admin] The token cache is being invalidate because project 5f5e205ee71b400ea4766c68e6070d0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:29:58.425576 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-a4333aec-ce9b-416f-aa4a-0df5094c0351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:58.426852 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-a4333aec-ce9b-416f-aa4a-0df5094c0351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:58.428505 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1171/2322] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:29:58 2022] DELETE /identity/v3/projects/5f5e205ee71b400ea4766c68e6070d0b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:29:58.433856 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2194c4-ca97-4ab6-b3bc-fcaea882e04b None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:58.434983 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2194c4-ca97-4ab6-b3bc-fcaea882e04b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:58.434983 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2194c4-ca97-4ab6-b3bc-fcaea882e04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:58.454606 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-9a2194c4-ca97-4ab6-b3bc-fcaea882e04b None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:29:58.455874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9a2194c4-ca97-4ab6-b3bc-fcaea882e04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:58.518288 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1152/2323] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:29:58.526449 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fd057-aae1-4dd1-a8c1-bc31d395295e None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:58.526737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fd057-aae1-4dd1-a8c1-bc31d395295e None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:58.527015 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fd057-aae1-4dd1-a8c1-bc31d395295e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:58.547365 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-4a3fd057-aae1-4dd1-a8c1-bc31d395295e None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:29:58.548642 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-4a3fd057-aae1-4dd1-a8c1-bc31d395295e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:58.558330 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1172/2324] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:29:58.562842 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2194c4-ca97-4ab6-b3bc-fcaea882e04b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:58.573293 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2194c4-ca97-4ab6-b3bc-fcaea882e04b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:58.578057 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37964d7-ea25-4ae8-bfc8-b8c358dd57ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:58.578728 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37964d7-ea25-4ae8-bfc8-b8c358dd57ec admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:58.579010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37964d7-ea25-4ae8-bfc8-b8c358dd57ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:58.579285 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37964d7-ea25-4ae8-bfc8-b8c358dd57ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:58.580040 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37964d7-ea25-4ae8-bfc8-b8c358dd57ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:29:58.580353 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37964d7-ea25-4ae8-bfc8-b8c358dd57ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:58.581988 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37964d7-ea25-4ae8-bfc8-b8c358dd57ec admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:58.584820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:58.594479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1153/2325] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:29:58.602526 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fd057-aae1-4dd1-a8c1-bc31d395295e None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:58.611819 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fd057-aae1-4dd1-a8c1-bc31d395295e None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:58.617618 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fda0d3-7887-47d4-b266-fd65d036590f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:58.618357 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fda0d3-7887-47d4-b266-fd65d036590f admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:58.618638 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fda0d3-7887-47d4-b266-fd65d036590f admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:58.618909 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fda0d3-7887-47d4-b266-fd65d036590f admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:58.619599 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fda0d3-7887-47d4-b266-fd65d036590f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:58.621622 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fda0d3-7887-47d4-b266-fd65d036590f admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:58.703277 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1173/2326] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:29:58 2022] POST /identity/v3/projects => generated 357 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:29:58.707325 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37964d7-ea25-4ae8-bfc8-b8c358dd57ec admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:58.717354 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37964d7-ea25-4ae8-bfc8-b8c358dd57ec admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:58.778471 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3dc35c-936d-43fe-8b86-ce18e5039c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:58.779149 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3dc35c-936d-43fe-8b86-ce18e5039c0e admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:58.779463 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3dc35c-936d-43fe-8b86-ce18e5039c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:58.779741 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3dc35c-936d-43fe-8b86-ce18e5039c0e admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:58.780474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3dc35c-936d-43fe-8b86-ce18e5039c0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:58.782421 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3dc35c-936d-43fe-8b86-ce18e5039c0e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:58.897185 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1154/2327] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:29:58 2022] POST /identity/v3/users => generated 279 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:29:58.901357 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fda0d3-7887-47d4-b266-fd65d036590f admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:58.912451 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fda0d3-7887-47d4-b266-fd65d036590f admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:58.917055 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63df1c-dc40-49b3-b1f6-ee07ff34f39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:58.917732 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63df1c-dc40-49b3-b1f6-ee07ff34f39c admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:58.918010 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63df1c-dc40-49b3-b1f6-ee07ff34f39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:58.918285 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63df1c-dc40-49b3-b1f6-ee07ff34f39c admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:58.919017 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63df1c-dc40-49b3-b1f6-ee07ff34f39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:58.920663 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63df1c-dc40-49b3-b1f6-ee07ff34f39c admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:58.931484 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1174/2328] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:29:58.935437 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3dc35c-936d-43fe-8b86-ce18e5039c0e admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:58.945936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3dc35c-936d-43fe-8b86-ce18e5039c0e admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:58.951191 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983d93e-a91d-4279-9f79-61a8203ce0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:58.951867 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983d93e-a91d-4279-9f79-61a8203ce0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:58.952186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983d93e-a91d-4279-9f79-61a8203ce0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:58.952463 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983d93e-a91d-4279-9f79-61a8203ce0a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:58.953230 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983d93e-a91d-4279-9f79-61a8203ce0a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:58.957711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983d93e-a91d-4279-9f79-61a8203ce0a6 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:58.967925 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1155/2329] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:29:58.971154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63df1c-dc40-49b3-b1f6-ee07ff34f39c admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:58.981785 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63df1c-dc40-49b3-b1f6-ee07ff34f39c admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:58.986834 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac661da-d547-42cf-97be-c9a182b52261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:58.987728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac661da-d547-42cf-97be-c9a182b52261 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:58.988036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac661da-d547-42cf-97be-c9a182b52261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:58.988338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac661da-d547-42cf-97be-c9a182b52261 admin admin] PATH_INFO: `/v3/projects/bab54aeba99e40c4a6b80b6a1db6ba58/users/dd97098cb7234461b1322c0c287c1300/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:59.003459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac661da-d547-42cf-97be-c9a182b52261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab54aeba99e40c4a6b80b6a1db6ba58, user_id=dd97098cb7234461b1322c0c287c1300, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:59.006249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac661da-d547-42cf-97be-c9a182b52261 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:59.074004 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:59.079960 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1175/2330] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:29:58 2022] PUT /identity/v3/projects/bab54aeba99e40c4a6b80b6a1db6ba58/users/dd97098cb7234461b1322c0c287c1300/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:29:59.092490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868e5d7-5ae3-4fe7-9cf4-f3af7afed006 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:59.092804 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868e5d7-5ae3-4fe7-9cf4-f3af7afed006 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:59.093088 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868e5d7-5ae3-4fe7-9cf4-f3af7afed006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:59.122634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-1868e5d7-5ae3-4fe7-9cf4-f3af7afed006 None None] MFA Rules not processed for user `dd97098cb7234461b1322c0c287c1300`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:29:59.123984 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1868e5d7-5ae3-4fe7-9cf4-f3af7afed006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:59.203519 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1156/2331] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:29:59 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:29:59.209001 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac661da-d547-42cf-97be-c9a182b52261 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:59.273595 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac661da-d547-42cf-97be-c9a182b52261 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:59.279238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62068e81-1fab-4389-8b6d-93cfd68a5d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:59.279903 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62068e81-1fab-4389-8b6d-93cfd68a5d53 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:59.280256 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62068e81-1fab-4389-8b6d-93cfd68a5d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:59.280670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62068e81-1fab-4389-8b6d-93cfd68a5d53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:59.281400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62068e81-1fab-4389-8b6d-93cfd68a5d53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:59.283429 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62068e81-1fab-4389-8b6d-93cfd68a5d53 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:59.378312 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1176/2332] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:29:59 2022] POST /identity/v3/projects => generated 355 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:29:59.383530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868e5d7-5ae3-4fe7-9cf4-f3af7afed006 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:59.397110 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868e5d7-5ae3-4fe7-9cf4-f3af7afed006 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:59.459575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f01312-9596-4383-9637-f920a98e347e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:59.460452 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f01312-9596-4383-9637-f920a98e347e admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:59.460786 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f01312-9596-4383-9637-f920a98e347e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:59.461068 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f01312-9596-4383-9637-f920a98e347e admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:59.461787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f01312-9596-4383-9637-f920a98e347e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:59.463848 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f01312-9596-4383-9637-f920a98e347e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:59.472899 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:59.618011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1157/2333] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:29:59 2022] POST /identity/v3/users => generated 284 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:29:59.621364 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62068e81-1fab-4389-8b6d-93cfd68a5d53 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:59.635508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62068e81-1fab-4389-8b6d-93cfd68a5d53 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:59.640161 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc865a0-e77b-44f4-920a-58014b44a636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:59.640832 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc865a0-e77b-44f4-920a-58014b44a636 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:59.641124 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc865a0-e77b-44f4-920a-58014b44a636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:59.641396 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc865a0-e77b-44f4-920a-58014b44a636 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:59.642125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc865a0-e77b-44f4-920a-58014b44a636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:59.643735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc865a0-e77b-44f4-920a-58014b44a636 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:59.658160 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1177/2334] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:29:59.662203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f01312-9596-4383-9637-f920a98e347e admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:59.674820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f01312-9596-4383-9637-f920a98e347e admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:59.680155 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e992a0-49ac-4d69-98e6-ca488d34fadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:59.681201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e992a0-49ac-4d69-98e6-ca488d34fadb admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:59.681485 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e992a0-49ac-4d69-98e6-ca488d34fadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:59.681923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e992a0-49ac-4d69-98e6-ca488d34fadb admin admin] PATH_INFO: `/v3/projects/06c0bb00190d436c9404c1ba5d92a514/users/91206e087dff481f8700d1208d418a14/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:59.698958 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e992a0-49ac-4d69-98e6-ca488d34fadb admin admin] RBAC: Authorizing `identity:create_grant(project_id=06c0bb00190d436c9404c1ba5d92a514, user_id=91206e087dff481f8700d1208d418a14, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:59.701655 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e992a0-49ac-4d69-98e6-ca488d34fadb admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:59.766105 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1158/2335] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:29:59 2022] PUT /identity/v3/projects/06c0bb00190d436c9404c1ba5d92a514/users/91206e087dff481f8700d1208d418a14/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:29:59.770188 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc865a0-e77b-44f4-920a-58014b44a636 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:59.783624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc865a0-e77b-44f4-920a-58014b44a636 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:59.846644 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04595a7f-31bc-4aed-9965-711a0a85e0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:59.847308 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04595a7f-31bc-4aed-9965-711a0a85e0ee admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:59.847588 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04595a7f-31bc-4aed-9965-711a0a85e0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:59.848520 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04595a7f-31bc-4aed-9965-711a0a85e0ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:59.849242 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04595a7f-31bc-4aed-9965-711a0a85e0ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:59.850837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04595a7f-31bc-4aed-9965-711a0a85e0ee admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:59.860909 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1178/2336] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:29:59.865679 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e992a0-49ac-4d69-98e6-ca488d34fadb admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:59.876099 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e992a0-49ac-4d69-98e6-ca488d34fadb admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:59.880737 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49fb2f4-2979-464c-8f4c-39ac70d58303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:59.881611 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fb2f4-2979-464c-8f4c-39ac70d58303 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:59.881909 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fb2f4-2979-464c-8f4c-39ac70d58303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:59.882166 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fb2f4-2979-464c-8f4c-39ac70d58303 admin admin] PATH_INFO: `/v3/projects/06c0bb00190d436c9404c1ba5d92a514/users/91206e087dff481f8700d1208d418a14/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:59.884346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49fb2f4-2979-464c-8f4c-39ac70d58303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06c0bb00190d436c9404c1ba5d92a514, user_id=91206e087dff481f8700d1208d418a14, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:59.889922 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49fb2f4-2979-464c-8f4c-39ac70d58303 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:59.897555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1159/2337] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:29:59 2022] PUT /identity/v3/projects/06c0bb00190d436c9404c1ba5d92a514/users/91206e087dff481f8700d1208d418a14/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:29:59.907718 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d79d37-5393-4921-884a-8db47be2d9b4 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:59.908034 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d79d37-5393-4921-884a-8db47be2d9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:59.908319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d79d37-5393-4921-884a-8db47be2d9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:59.936999 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-93d79d37-5393-4921-884a-8db47be2d9b4 None None] MFA Rules not processed for user `91206e087dff481f8700d1208d418a14`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:29:59.938215 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-93d79d37-5393-4921-884a-8db47be2d9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:59.998882 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:00.009627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1179/2338] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:29:59 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:30:00.022391 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49fb2f4-2979-464c-8f4c-39ac70d58303 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:00.024240 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d49fb2f4-2979-464c-8f4c-39ac70d58303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:00.087306 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49fb2f4-2979-464c-8f4c-39ac70d58303 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:00.091128 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40561a00-f4c4-4124-9fb8-e5d56ebb6acd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:00.091941 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40561a00-f4c4-4124-9fb8-e5d56ebb6acd service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:00.092255 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40561a00-f4c4-4124-9fb8-e5d56ebb6acd service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:00.092526 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40561a00-f4c4-4124-9fb8-e5d56ebb6acd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:00.102299 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40561a00-f4c4-4124-9fb8-e5d56ebb6acd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:00.103961 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40561a00-f4c4-4124-9fb8-e5d56ebb6acd service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:00.114081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1160/2339] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:30:00 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:30:00.305554 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d79d37-5393-4921-884a-8db47be2d9b4 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:00.315551 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d79d37-5393-4921-884a-8db47be2d9b4 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:00.319461 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b0e90-7347-4e9a-9bc9-773183625cf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:00.320531 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b0e90-7347-4e9a-9bc9-773183625cf8 service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:00.320531 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b0e90-7347-4e9a-9bc9-773183625cf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:00.320729 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b0e90-7347-4e9a-9bc9-773183625cf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:00.386302 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b0e90-7347-4e9a-9bc9-773183625cf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:00.387762 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b0e90-7347-4e9a-9bc9-773183625cf8 service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:00.398436 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1180/2340] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:30:00 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:30:10.109230 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:INSERT=3,keystone:SELECT=43 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:10.393266 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=31 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:17.894633 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40561a00-f4c4-4124-9fb8-e5d56ebb6acd service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:17.962138 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40561a00-f4c4-4124-9fb8-e5d56ebb6acd service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:17.966718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5319b4-dab3-4d37-8d36-41085bfc95dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:17.967583 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5319b4-dab3-4d37-8d36-41085bfc95dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:17.967862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5319b4-dab3-4d37-8d36-41085bfc95dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:17.968169 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5319b4-dab3-4d37-8d36-41085bfc95dd admin admin] PATH_INFO: `/v3/users/dd97098cb7234461b1322c0c287c1300` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:17.969452 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5319b4-dab3-4d37-8d36-41085bfc95dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd97098cb7234461b1322c0c287c1300)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:17.971444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5319b4-dab3-4d37-8d36-41085bfc95dd admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:18.132901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3e5319b4-dab3-4d37-8d36-41085bfc95dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd97098cb7234461b1322c0c287c1300'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:18.140271 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3e5319b4-dab3-4d37-8d36-41085bfc95dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd97098cb7234461b1322c0c287c1300'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:18.140956 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3e5319b4-dab3-4d37-8d36-41085bfc95dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd97098cb7234461b1322c0c287c1300'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:18.141605 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3e5319b4-dab3-4d37-8d36-41085bfc95dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd97098cb7234461b1322c0c287c1300'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:18.153817 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3e5319b4-dab3-4d37-8d36-41085bfc95dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd97098cb7234461b1322c0c287c1300'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:18.259567 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1161/2341] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:30:17 2022] DELETE /identity/v3/users/dd97098cb7234461b1322c0c287c1300 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:30:18.261073 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d779f10-17c2-496d-9c31-7134ca699a72 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:18.261578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d779f10-17c2-496d-9c31-7134ca699a72 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:18.261684 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d779f10-17c2-496d-9c31-7134ca699a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:18.279020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-5d779f10-17c2-496d-9c31-7134ca699a72 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:30:18.282588 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5d779f10-17c2-496d-9c31-7134ca699a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:18.347065 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1181/2342] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:30:18.357832 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5319b4-dab3-4d37-8d36-41085bfc95dd admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:18.363113 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3e5319b4-dab3-4d37-8d36-41085bfc95dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:18.419921 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5319b4-dab3-4d37-8d36-41085bfc95dd admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:18.423967 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6b31d-0c87-4bfe-8dec-468516ae8a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:18.424801 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6b31d-0c87-4bfe-8dec-468516ae8a37 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:18.425127 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6b31d-0c87-4bfe-8dec-468516ae8a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:18.425888 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6b31d-0c87-4bfe-8dec-468516ae8a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:18.436310 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef6b31d-0c87-4bfe-8dec-468516ae8a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:18.437988 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef6b31d-0c87-4bfe-8dec-468516ae8a37 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:18.449169 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1162/2343] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:30:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:30:18.852840 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d779f10-17c2-496d-9c31-7134ca699a72 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:18.854535 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5d779f10-17c2-496d-9c31-7134ca699a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:18.871271 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d779f10-17c2-496d-9c31-7134ca699a72 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:18.876021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fed858-3839-444f-9d5d-a10432f7a0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:18.877261 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fed858-3839-444f-9d5d-a10432f7a0c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:18.877533 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fed858-3839-444f-9d5d-a10432f7a0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:18.877836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fed858-3839-444f-9d5d-a10432f7a0c5 admin admin] PATH_INFO: `/v3/projects/bab54aeba99e40c4a6b80b6a1db6ba58` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:18.879232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fed858-3839-444f-9d5d-a10432f7a0c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bab54aeba99e40c4a6b80b6a1db6ba58)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:18.881226 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fed858-3839-444f-9d5d-a10432f7a0c5 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:19.012025 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-c3fed858-3839-444f-9d5d-a10432f7a0c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bab54aeba99e40c4a6b80b6a1db6ba58', 'request_id': 'req-c3fed858-3839-444f-9d5d-a10432f7a0c5'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:19.089756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-c3fed858-3839-444f-9d5d-a10432f7a0c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bab54aeba99e40c4a6b80b6a1db6ba58', 'request_id': 'req-c3fed858-3839-444f-9d5d-a10432f7a0c5'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:19.096701 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-c3fed858-3839-444f-9d5d-a10432f7a0c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bab54aeba99e40c4a6b80b6a1db6ba58', 'request_id': 'req-c3fed858-3839-444f-9d5d-a10432f7a0c5'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:19.108516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-c3fed858-3839-444f-9d5d-a10432f7a0c5 admin admin] The token cache is being invalidate because project bab54aeba99e40c4a6b80b6a1db6ba58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:30:19.108806 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-c3fed858-3839-444f-9d5d-a10432f7a0c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:19.109471 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-c3fed858-3839-444f-9d5d-a10432f7a0c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:19.111035 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1182/2344] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:30:18 2022] DELETE /identity/v3/projects/bab54aeba99e40c4a6b80b6a1db6ba58 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:30:19.115082 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6b31d-0c87-4bfe-8dec-468516ae8a37 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:19.125223 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6b31d-0c87-4bfe-8dec-468516ae8a37 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:19.143979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:19.186344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fdfe3-814a-4d68-8d76-c918065216a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:19.187495 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fdfe3-814a-4d68-8d76-c918065216a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:19.187782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fdfe3-814a-4d68-8d76-c918065216a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:19.188093 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fdfe3-814a-4d68-8d76-c918065216a1 admin admin] PATH_INFO: `/v3/users/91206e087dff481f8700d1208d418a14` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:19.189370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fdfe3-814a-4d68-8d76-c918065216a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91206e087dff481f8700d1208d418a14)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:19.191317 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fdfe3-814a-4d68-8d76-c918065216a1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:19.374659 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-be1fdfe3-814a-4d68-8d76-c918065216a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91206e087dff481f8700d1208d418a14'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:19.383643 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-be1fdfe3-814a-4d68-8d76-c918065216a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91206e087dff481f8700d1208d418a14'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:19.384446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-be1fdfe3-814a-4d68-8d76-c918065216a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91206e087dff481f8700d1208d418a14'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:19.385080 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-be1fdfe3-814a-4d68-8d76-c918065216a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91206e087dff481f8700d1208d418a14'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:19.403875 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-be1fdfe3-814a-4d68-8d76-c918065216a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91206e087dff481f8700d1208d418a14'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:19.482664 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1163/2345] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:30:19 2022] DELETE /identity/v3/users/91206e087dff481f8700d1208d418a14 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:30:19.977968 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fed858-3839-444f-9d5d-a10432f7a0c5 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:19.979532 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c3fed858-3839-444f-9d5d-a10432f7a0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:19.995405 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fed858-3839-444f-9d5d-a10432f7a0c5 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:20.063135 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d955bc8-36e1-482e-a33c-d9e6a52b6411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:20.064051 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d955bc8-36e1-482e-a33c-d9e6a52b6411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:20.064332 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d955bc8-36e1-482e-a33c-d9e6a52b6411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:20.064602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d955bc8-36e1-482e-a33c-d9e6a52b6411 admin admin] PATH_INFO: `/v3/projects/06c0bb00190d436c9404c1ba5d92a514` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:20.065870 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d955bc8-36e1-482e-a33c-d9e6a52b6411 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06c0bb00190d436c9404c1ba5d92a514)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:20.067875 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d955bc8-36e1-482e-a33c-d9e6a52b6411 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:20.171515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:20.188793 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4d955bc8-36e1-482e-a33c-d9e6a52b6411 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06c0bb00190d436c9404c1ba5d92a514', 'request_id': 'req-4d955bc8-36e1-482e-a33c-d9e6a52b6411'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:20.284321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4d955bc8-36e1-482e-a33c-d9e6a52b6411 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06c0bb00190d436c9404c1ba5d92a514', 'request_id': 'req-4d955bc8-36e1-482e-a33c-d9e6a52b6411'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:20.291254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4d955bc8-36e1-482e-a33c-d9e6a52b6411 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06c0bb00190d436c9404c1ba5d92a514', 'request_id': 'req-4d955bc8-36e1-482e-a33c-d9e6a52b6411'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:20.304143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4d955bc8-36e1-482e-a33c-d9e6a52b6411 admin admin] The token cache is being invalidate because project 06c0bb00190d436c9404c1ba5d92a514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:30:20.304431 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4d955bc8-36e1-482e-a33c-d9e6a52b6411 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:20.305083 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4d955bc8-36e1-482e-a33c-d9e6a52b6411 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:20.306677 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1183/2346] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:30:19 2022] DELETE /identity/v3/projects/06c0bb00190d436c9404c1ba5d92a514 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:30:20.312948 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e620b2e-c683-4624-805e-59bd97eb2dd6 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:20.313468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e620b2e-c683-4624-805e-59bd97eb2dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:20.313586 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e620b2e-c683-4624-805e-59bd97eb2dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:20.331558 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-2e620b2e-c683-4624-805e-59bd97eb2dd6 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:30:20.332874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2e620b2e-c683-4624-805e-59bd97eb2dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:20.393446 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1164/2347] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:30:20.403166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed5514-71f3-4e39-bd09-aa590e272979 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:20.403166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed5514-71f3-4e39-bd09-aa590e272979 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:20.403166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed5514-71f3-4e39-bd09-aa590e272979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:20.422520 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-94ed5514-71f3-4e39-bd09-aa590e272979 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:30:20.423728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-94ed5514-71f3-4e39-bd09-aa590e272979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:20.431770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1184/2348] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:30:20.436459 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e620b2e-c683-4624-805e-59bd97eb2dd6 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:20.447306 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e620b2e-c683-4624-805e-59bd97eb2dd6 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:20.452209 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ff197-de69-4478-b96a-4c29f365d42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:20.452883 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ff197-de69-4478-b96a-4c29f365d42b admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:20.453167 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ff197-de69-4478-b96a-4c29f365d42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:20.453444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ff197-de69-4478-b96a-4c29f365d42b admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:20.454314 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ff197-de69-4478-b96a-4c29f365d42b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:30:20.454616 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ff197-de69-4478-b96a-4c29f365d42b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:20.456268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ff197-de69-4478-b96a-4c29f365d42b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:20.469621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1165/2349] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:30:20.475020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed5514-71f3-4e39-bd09-aa590e272979 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:20.491514 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed5514-71f3-4e39-bd09-aa590e272979 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:20.496447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffbb61-454e-417d-b92b-85b630ccf679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:20.497830 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffbb61-454e-417d-b92b-85b630ccf679 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:20.497830 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffbb61-454e-417d-b92b-85b630ccf679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:20.497830 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffbb61-454e-417d-b92b-85b630ccf679 admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:20.498320 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdffbb61-454e-417d-b92b-85b630ccf679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:20.500293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdffbb61-454e-417d-b92b-85b630ccf679 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:20.590511 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1185/2350] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:30:20 2022] POST /identity/v3/projects => generated 369 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:30:20.595846 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ff197-de69-4478-b96a-4c29f365d42b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:20.610588 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ff197-de69-4478-b96a-4c29f365d42b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:20.638152 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:20.668754 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e60563-1c3e-40da-9ebf-e9cdc726b8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:20.669427 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e60563-1c3e-40da-9ebf-e9cdc726b8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:20.669709 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e60563-1c3e-40da-9ebf-e9cdc726b8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:20.669981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e60563-1c3e-40da-9ebf-e9cdc726b8d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:20.670685 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e60563-1c3e-40da-9ebf-e9cdc726b8d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:20.672767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e60563-1c3e-40da-9ebf-e9cdc726b8d1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:20.747835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1166/2351] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:30:20 2022] POST /identity/v3/users => generated 285 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:30:20.751855 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffbb61-454e-417d-b92b-85b630ccf679 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:20.762860 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffbb61-454e-417d-b92b-85b630ccf679 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:20.767633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001b5aa-15fd-4d7f-b8b2-eb62fea6d020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:20.770028 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001b5aa-15fd-4d7f-b8b2-eb62fea6d020 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:20.770028 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001b5aa-15fd-4d7f-b8b2-eb62fea6d020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:20.770028 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001b5aa-15fd-4d7f-b8b2-eb62fea6d020 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:20.770028 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001b5aa-15fd-4d7f-b8b2-eb62fea6d020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:20.772087 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001b5aa-15fd-4d7f-b8b2-eb62fea6d020 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:20.782846 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1186/2352] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:30:20.786849 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e60563-1c3e-40da-9ebf-e9cdc726b8d1 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:20.797379 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e60563-1c3e-40da-9ebf-e9cdc726b8d1 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:20.801964 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121980f-90de-4598-91b4-0e4207315daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:20.803403 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121980f-90de-4598-91b4-0e4207315daf admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:20.803403 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121980f-90de-4598-91b4-0e4207315daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:20.803403 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121980f-90de-4598-91b4-0e4207315daf admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:20.803859 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121980f-90de-4598-91b4-0e4207315daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:20.805479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121980f-90de-4598-91b4-0e4207315daf admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:20.816205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1167/2353] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:30:20.821149 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001b5aa-15fd-4d7f-b8b2-eb62fea6d020 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:20.830892 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001b5aa-15fd-4d7f-b8b2-eb62fea6d020 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:20.836253 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379cb0c-cc16-4f70-9578-93d3ff74d837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:20.837114 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379cb0c-cc16-4f70-9578-93d3ff74d837 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:20.837388 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379cb0c-cc16-4f70-9578-93d3ff74d837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:20.837656 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379cb0c-cc16-4f70-9578-93d3ff74d837 admin admin] PATH_INFO: `/v3/projects/0a57c94acbe9455c8c955564a78ea5e7/users/50b02be7b1054f04883e8d64a61203d3/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:20.852770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379cb0c-cc16-4f70-9578-93d3ff74d837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a57c94acbe9455c8c955564a78ea5e7, user_id=50b02be7b1054f04883e8d64a61203d3, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:20.855355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379cb0c-cc16-4f70-9578-93d3ff74d837 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:20.953909 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1187/2354] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:30:20 2022] PUT /identity/v3/projects/0a57c94acbe9455c8c955564a78ea5e7/users/50b02be7b1054f04883e8d64a61203d3/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:30:20.965895 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b8f32-fe1a-4219-896b-46e7901b4daf None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:20.966201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b8f32-fe1a-4219-896b-46e7901b4daf None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:20.966509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b8f32-fe1a-4219-896b-46e7901b4daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:20.996926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-307b8f32-fe1a-4219-896b-46e7901b4daf None None] MFA Rules not processed for user `50b02be7b1054f04883e8d64a61203d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:30:20.998154 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-307b8f32-fe1a-4219-896b-46e7901b4daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:21.065159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1168/2355] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:30:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:30:21.070010 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379cb0c-cc16-4f70-9578-93d3ff74d837 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:21.131618 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379cb0c-cc16-4f70-9578-93d3ff74d837 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:21.136173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77eca91-02d5-4cc3-a425-23abd79f778f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:21.136821 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77eca91-02d5-4cc3-a425-23abd79f778f admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:21.137102 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77eca91-02d5-4cc3-a425-23abd79f778f admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:21.137376 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77eca91-02d5-4cc3-a425-23abd79f778f admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:21.138052 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77eca91-02d5-4cc3-a425-23abd79f778f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:21.139975 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77eca91-02d5-4cc3-a425-23abd79f778f admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:21.234687 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1188/2356] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:30:21 2022] POST /identity/v3/projects => generated 369 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:30:21.238787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b8f32-fe1a-4219-896b-46e7901b4daf None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:21.249816 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b8f32-fe1a-4219-896b-46e7901b4daf None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:21.308586 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df23d2d-47c6-4f23-94a2-0e8f396c2b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:21.309268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df23d2d-47c6-4f23-94a2-0e8f396c2b53 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:21.309552 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df23d2d-47c6-4f23-94a2-0e8f396c2b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:21.309826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df23d2d-47c6-4f23-94a2-0e8f396c2b53 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:21.310576 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df23d2d-47c6-4f23-94a2-0e8f396c2b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:21.312546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df23d2d-47c6-4f23-94a2-0e8f396c2b53 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:21.399847 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1169/2357] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:30:21 2022] POST /identity/v3/users => generated 291 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:30:21.404995 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77eca91-02d5-4cc3-a425-23abd79f778f admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:21.416239 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77eca91-02d5-4cc3-a425-23abd79f778f admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:21.420960 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2cdd4-4605-49a2-89cd-2d1172e4b883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:21.421625 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2cdd4-4605-49a2-89cd-2d1172e4b883 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:21.421907 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2cdd4-4605-49a2-89cd-2d1172e4b883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:21.422182 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2cdd4-4605-49a2-89cd-2d1172e4b883 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:21.422936 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2cdd4-4605-49a2-89cd-2d1172e4b883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:21.424613 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2cdd4-4605-49a2-89cd-2d1172e4b883 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:21.436602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1189/2358] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:30:21.441277 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df23d2d-47c6-4f23-94a2-0e8f396c2b53 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:21.452194 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df23d2d-47c6-4f23-94a2-0e8f396c2b53 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:21.457011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfeec2-f7ad-4cdf-9909-ad62b59ae5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:21.457901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfeec2-f7ad-4cdf-9909-ad62b59ae5f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:21.458185 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfeec2-f7ad-4cdf-9909-ad62b59ae5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:21.458511 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfeec2-f7ad-4cdf-9909-ad62b59ae5f0 admin admin] PATH_INFO: `/v3/projects/97727a10e32c428bb585f55342a34f7e/users/9822ed1ace4646fdb934675ccf3d0e3b/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:21.474544 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccfeec2-f7ad-4cdf-9909-ad62b59ae5f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97727a10e32c428bb585f55342a34f7e, user_id=9822ed1ace4646fdb934675ccf3d0e3b, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:21.477415 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccfeec2-f7ad-4cdf-9909-ad62b59ae5f0 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:21.602429 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1170/2359] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:30:21 2022] PUT /identity/v3/projects/97727a10e32c428bb585f55342a34f7e/users/9822ed1ace4646fdb934675ccf3d0e3b/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:30:21.606689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2cdd4-4605-49a2-89cd-2d1172e4b883 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:21.618408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2cdd4-4605-49a2-89cd-2d1172e4b883 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:21.641889 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:21.680969 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d70a3-9191-45a5-bb46-cad0e75a08d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:21.681563 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d70a3-9191-45a5-bb46-cad0e75a08d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:21.681849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d70a3-9191-45a5-bb46-cad0e75a08d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:21.682125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d70a3-9191-45a5-bb46-cad0e75a08d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:21.682865 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d70a3-9191-45a5-bb46-cad0e75a08d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:21.684520 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d70a3-9191-45a5-bb46-cad0e75a08d7 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:21.695627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1190/2360] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:30:21.702967 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfeec2-f7ad-4cdf-9909-ad62b59ae5f0 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:21.709626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:21.715887 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfeec2-f7ad-4cdf-9909-ad62b59ae5f0 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:21.721825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17493138-0694-4cb4-acb2-22c109f52e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:21.722727 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17493138-0694-4cb4-acb2-22c109f52e70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:21.723003 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17493138-0694-4cb4-acb2-22c109f52e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:21.723278 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17493138-0694-4cb4-acb2-22c109f52e70 admin admin] PATH_INFO: `/v3/projects/97727a10e32c428bb585f55342a34f7e/users/9822ed1ace4646fdb934675ccf3d0e3b/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:21.726057 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17493138-0694-4cb4-acb2-22c109f52e70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97727a10e32c428bb585f55342a34f7e, user_id=9822ed1ace4646fdb934675ccf3d0e3b, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:21.729447 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17493138-0694-4cb4-acb2-22c109f52e70 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:21.747518 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1171/2361] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:30:21 2022] PUT /identity/v3/projects/97727a10e32c428bb585f55342a34f7e/users/9822ed1ace4646fdb934675ccf3d0e3b/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:30:21.759824 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dfef8-d3ff-4471-b4b3-90ab5a7201db None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:21.760361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dfef8-d3ff-4471-b4b3-90ab5a7201db None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:21.760863 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dfef8-d3ff-4471-b4b3-90ab5a7201db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:21.800373 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-ea7dfef8-d3ff-4471-b4b3-90ab5a7201db None None] MFA Rules not processed for user `9822ed1ace4646fdb934675ccf3d0e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:30:21.801622 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-ea7dfef8-d3ff-4471-b4b3-90ab5a7201db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:21.882051 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1191/2362] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:30:21 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:30:21.899849 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17493138-0694-4cb4-acb2-22c109f52e70 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:21.901567 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-17493138-0694-4cb4-acb2-22c109f52e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:21.971274 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17493138-0694-4cb4-acb2-22c109f52e70 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:21.977661 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105780f-a935-4e51-9f4e-4dcd7e276f3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:21.978744 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105780f-a935-4e51-9f4e-4dcd7e276f3f service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:21.979032 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105780f-a935-4e51-9f4e-4dcd7e276f3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:21.979310 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105780f-a935-4e51-9f4e-4dcd7e276f3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:21.989482 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105780f-a935-4e51-9f4e-4dcd7e276f3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:21.990944 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105780f-a935-4e51-9f4e-4dcd7e276f3f service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:22.004333 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1172/2363] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:30:21 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:30:22.138895 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7dfef8-d3ff-4471-b4b3-90ab5a7201db None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:22.140478 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-ea7dfef8-d3ff-4471-b4b3-90ab5a7201db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:22.153768 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7dfef8-d3ff-4471-b4b3-90ab5a7201db None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:22.157588 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbee3c-c9d8-4b1b-a833-f2cc8af83fe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:22.158247 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbee3c-c9d8-4b1b-a833-f2cc8af83fe2 service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:22.158527 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbee3c-c9d8-4b1b-a833-f2cc8af83fe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:22.158804 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbee3c-c9d8-4b1b-a833-f2cc8af83fe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:22.223284 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbee3c-c9d8-4b1b-a833-f2cc8af83fe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:22.225240 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbee3c-c9d8-4b1b-a833-f2cc8af83fe2 service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:22.238552 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1192/2364] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:30:22 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:30:27.020108 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105780f-a935-4e51-9f4e-4dcd7e276f3f service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:27.084720 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105780f-a935-4e51-9f4e-4dcd7e276f3f service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:27.089849 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55572ca-64e9-4bc3-93e6-6206490fcaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:27.090718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55572ca-64e9-4bc3-93e6-6206490fcaae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:27.091004 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55572ca-64e9-4bc3-93e6-6206490fcaae admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:27.091286 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55572ca-64e9-4bc3-93e6-6206490fcaae admin admin] PATH_INFO: `/v3/users/50b02be7b1054f04883e8d64a61203d3` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:27.092578 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55572ca-64e9-4bc3-93e6-6206490fcaae admin admin] RBAC: Authorizing `identity:delete_user(user_id=50b02be7b1054f04883e8d64a61203d3)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:27.094512 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55572ca-64e9-4bc3-93e6-6206490fcaae admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:27.246745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d55572ca-64e9-4bc3-93e6-6206490fcaae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50b02be7b1054f04883e8d64a61203d3'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:27.254196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d55572ca-64e9-4bc3-93e6-6206490fcaae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50b02be7b1054f04883e8d64a61203d3'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:27.254830 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d55572ca-64e9-4bc3-93e6-6206490fcaae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50b02be7b1054f04883e8d64a61203d3'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:27.255426 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d55572ca-64e9-4bc3-93e6-6206490fcaae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50b02be7b1054f04883e8d64a61203d3'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:27.268789 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d55572ca-64e9-4bc3-93e6-6206490fcaae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50b02be7b1054f04883e8d64a61203d3'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:27.329869 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1173/2365] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:30:27 2022] DELETE /identity/v3/users/50b02be7b1054f04883e8d64a61203d3 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:30:27.335801 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc93eb0-24d6-4287-86b6-e054ad2761f3 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:27.336342 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc93eb0-24d6-4287-86b6-e054ad2761f3 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:27.336467 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc93eb0-24d6-4287-86b6-e054ad2761f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:27.353634 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-9fc93eb0-24d6-4287-86b6-e054ad2761f3 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:30:27.355670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-9fc93eb0-24d6-4287-86b6-e054ad2761f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:27.399674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:27.418554 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1193/2366] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:30:27.428403 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55572ca-64e9-4bc3-93e6-6206490fcaae admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:27.429811 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d55572ca-64e9-4bc3-93e6-6206490fcaae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:27.445092 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:27.494356 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55572ca-64e9-4bc3-93e6-6206490fcaae admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:27.498070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7884022-a677-4510-adce-dbd1de3e82a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:27.498722 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7884022-a677-4510-adce-dbd1de3e82a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:27.499003 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7884022-a677-4510-adce-dbd1de3e82a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:27.499279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7884022-a677-4510-adce-dbd1de3e82a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:27.509310 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7884022-a677-4510-adce-dbd1de3e82a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:27.510674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7884022-a677-4510-adce-dbd1de3e82a4 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:27.520736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1174/2367] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:30:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:30:27.921146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc93eb0-24d6-4287-86b6-e054ad2761f3 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:27.924320 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-9fc93eb0-24d6-4287-86b6-e054ad2761f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:27.939690 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc93eb0-24d6-4287-86b6-e054ad2761f3 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:27.948166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6c529-ee96-475d-bacd-dadc5609179f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:27.949706 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6c529-ee96-475d-bacd-dadc5609179f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:27.951114 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6c529-ee96-475d-bacd-dadc5609179f admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:27.951903 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6c529-ee96-475d-bacd-dadc5609179f admin admin] PATH_INFO: `/v3/projects/0a57c94acbe9455c8c955564a78ea5e7` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:27.954501 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6c529-ee96-475d-bacd-dadc5609179f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a57c94acbe9455c8c955564a78ea5e7)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:27.958228 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6c529-ee96-475d-bacd-dadc5609179f admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:28.127883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-86f6c529-ee96-475d-bacd-dadc5609179f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a57c94acbe9455c8c955564a78ea5e7', 'request_id': 'req-86f6c529-ee96-475d-bacd-dadc5609179f'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:28.192845 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-86f6c529-ee96-475d-bacd-dadc5609179f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a57c94acbe9455c8c955564a78ea5e7', 'request_id': 'req-86f6c529-ee96-475d-bacd-dadc5609179f'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:28.199738 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-86f6c529-ee96-475d-bacd-dadc5609179f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a57c94acbe9455c8c955564a78ea5e7', 'request_id': 'req-86f6c529-ee96-475d-bacd-dadc5609179f'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:28.211917 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-86f6c529-ee96-475d-bacd-dadc5609179f admin admin] The token cache is being invalidate because project 0a57c94acbe9455c8c955564a78ea5e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:30:28.212263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-86f6c529-ee96-475d-bacd-dadc5609179f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:28.212964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-86f6c529-ee96-475d-bacd-dadc5609179f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:28.214546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1194/2368] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:30:27 2022] DELETE /identity/v3/projects/0a57c94acbe9455c8c955564a78ea5e7 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:30:28.218614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7884022-a677-4510-adce-dbd1de3e82a4 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:28.230063 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7884022-a677-4510-adce-dbd1de3e82a4 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:28.295775 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d57776-a249-4013-abb6-bcb43c618f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:28.296693 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d57776-a249-4013-abb6-bcb43c618f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:28.296972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d57776-a249-4013-abb6-bcb43c618f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:28.297246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d57776-a249-4013-abb6-bcb43c618f53 admin admin] PATH_INFO: `/v3/users/9822ed1ace4646fdb934675ccf3d0e3b` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:28.298724 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d57776-a249-4013-abb6-bcb43c618f53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9822ed1ace4646fdb934675ccf3d0e3b)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:28.300596 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d57776-a249-4013-abb6-bcb43c618f53 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:28.478031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-47d57776-a249-4013-abb6-bcb43c618f53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9822ed1ace4646fdb934675ccf3d0e3b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:28.485003 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-47d57776-a249-4013-abb6-bcb43c618f53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9822ed1ace4646fdb934675ccf3d0e3b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:28.485668 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-47d57776-a249-4013-abb6-bcb43c618f53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9822ed1ace4646fdb934675ccf3d0e3b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:28.489205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-47d57776-a249-4013-abb6-bcb43c618f53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9822ed1ace4646fdb934675ccf3d0e3b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:28.498821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-47d57776-a249-4013-abb6-bcb43c618f53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9822ed1ace4646fdb934675ccf3d0e3b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:28.564485 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1175/2369] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:30:28 2022] DELETE /identity/v3/users/9822ed1ace4646fdb934675ccf3d0e3b => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:30:28.971271 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6c529-ee96-475d-bacd-dadc5609179f admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:28.977093 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-86f6c529-ee96-475d-bacd-dadc5609179f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:28.992109 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6c529-ee96-475d-bacd-dadc5609179f admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:29.055554 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5988cc4-48c2-46ae-ae15-5197d4d6157c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:29.056476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5988cc4-48c2-46ae-ae15-5197d4d6157c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:29.056766 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5988cc4-48c2-46ae-ae15-5197d4d6157c admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:29.057039 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5988cc4-48c2-46ae-ae15-5197d4d6157c admin admin] PATH_INFO: `/v3/projects/97727a10e32c428bb585f55342a34f7e` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:29.058342 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5988cc4-48c2-46ae-ae15-5197d4d6157c admin admin] RBAC: Authorizing `identity:delete_project(project_id=97727a10e32c428bb585f55342a34f7e)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:29.060486 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5988cc4-48c2-46ae-ae15-5197d4d6157c admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:29.159561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-d5988cc4-48c2-46ae-ae15-5197d4d6157c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97727a10e32c428bb585f55342a34f7e', 'request_id': 'req-d5988cc4-48c2-46ae-ae15-5197d4d6157c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:29.250257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-d5988cc4-48c2-46ae-ae15-5197d4d6157c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97727a10e32c428bb585f55342a34f7e', 'request_id': 'req-d5988cc4-48c2-46ae-ae15-5197d4d6157c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:29.257506 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-d5988cc4-48c2-46ae-ae15-5197d4d6157c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97727a10e32c428bb585f55342a34f7e', 'request_id': 'req-d5988cc4-48c2-46ae-ae15-5197d4d6157c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:29.266175 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:29.271182 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-d5988cc4-48c2-46ae-ae15-5197d4d6157c admin admin] The token cache is being invalidate because project 97727a10e32c428bb585f55342a34f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:30:29.271472 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-d5988cc4-48c2-46ae-ae15-5197d4d6157c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:29.272180 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-d5988cc4-48c2-46ae-ae15-5197d4d6157c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:29.274238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1195/2370] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:30:28 2022] DELETE /identity/v3/projects/97727a10e32c428bb585f55342a34f7e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:30:29.279213 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66225a90-1f24-4497-8130-73d29939ea8e None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:29.279903 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66225a90-1f24-4497-8130-73d29939ea8e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:29.279903 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66225a90-1f24-4497-8130-73d29939ea8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:29.299697 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-66225a90-1f24-4497-8130-73d29939ea8e None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:30:29.300988 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-66225a90-1f24-4497-8130-73d29939ea8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:29.344010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:29.383156 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1176/2371] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:30:29.394394 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27e8c9-41a6-4d73-8d10-48493a7143cc None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:29.394682 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27e8c9-41a6-4d73-8d10-48493a7143cc None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:29.394959 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27e8c9-41a6-4d73-8d10-48493a7143cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:29.414495 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-3e27e8c9-41a6-4d73-8d10-48493a7143cc None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:30:29.415627 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-3e27e8c9-41a6-4d73-8d10-48493a7143cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:29.423787 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1196/2372] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:30:29.428097 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66225a90-1f24-4497-8130-73d29939ea8e None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:29.437813 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66225a90-1f24-4497-8130-73d29939ea8e None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:29.442355 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a68a2-b239-4a80-a382-6e974ac783fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:29.443477 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a68a2-b239-4a80-a382-6e974ac783fc admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:29.443583 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a68a2-b239-4a80-a382-6e974ac783fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:29.443903 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a68a2-b239-4a80-a382-6e974ac783fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:29.445199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a68a2-b239-4a80-a382-6e974ac783fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:30:29.445498 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a68a2-b239-4a80-a382-6e974ac783fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:29.447090 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a68a2-b239-4a80-a382-6e974ac783fc admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:29.461447 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1177/2373] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:30:29.465874 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27e8c9-41a6-4d73-8d10-48493a7143cc None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:29.475307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27e8c9-41a6-4d73-8d10-48493a7143cc None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:29.480932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba963763-aca6-4f0b-9ad2-96112a9ae2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:29.481586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba963763-aca6-4f0b-9ad2-96112a9ae2d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:29.481863 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba963763-aca6-4f0b-9ad2-96112a9ae2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:29.482163 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba963763-aca6-4f0b-9ad2-96112a9ae2d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:29.482906 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba963763-aca6-4f0b-9ad2-96112a9ae2d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:29.484846 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba963763-aca6-4f0b-9ad2-96112a9ae2d1 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:29.584825 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1197/2374] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:30:29 2022] POST /identity/v3/projects => generated 399 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:30:29.591643 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a68a2-b239-4a80-a382-6e974ac783fc admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:29.603702 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a68a2-b239-4a80-a382-6e974ac783fc admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:29.670849 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e31c6-4ba9-400a-ba42-7d6300edef2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:29.671445 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e31c6-4ba9-400a-ba42-7d6300edef2d admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:29.671732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e31c6-4ba9-400a-ba42-7d6300edef2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:29.672063 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e31c6-4ba9-400a-ba42-7d6300edef2d admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:29.672786 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e31c6-4ba9-400a-ba42-7d6300edef2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:29.674792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e31c6-4ba9-400a-ba42-7d6300edef2d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:29.762257 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1178/2375] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:30:29 2022] POST /identity/v3/users => generated 300 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:30:29.766585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba963763-aca6-4f0b-9ad2-96112a9ae2d1 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:29.778219 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba963763-aca6-4f0b-9ad2-96112a9ae2d1 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:29.782967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116d2b7-c3be-4b26-845f-2d363e0a998c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:29.783632 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116d2b7-c3be-4b26-845f-2d363e0a998c admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:29.783914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116d2b7-c3be-4b26-845f-2d363e0a998c admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:29.784236 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116d2b7-c3be-4b26-845f-2d363e0a998c admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:29.784970 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116d2b7-c3be-4b26-845f-2d363e0a998c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:29.786582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116d2b7-c3be-4b26-845f-2d363e0a998c admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:29.797936 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1198/2376] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:30:29.804420 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e31c6-4ba9-400a-ba42-7d6300edef2d admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:29.813021 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e31c6-4ba9-400a-ba42-7d6300edef2d admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:29.818580 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff6795-3e36-414c-8711-5dcc209a585c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:29.818849 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff6795-3e36-414c-8711-5dcc209a585c admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:29.819078 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff6795-3e36-414c-8711-5dcc209a585c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:29.819421 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff6795-3e36-414c-8711-5dcc209a585c admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:29.820707 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff6795-3e36-414c-8711-5dcc209a585c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:29.822317 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff6795-3e36-414c-8711-5dcc209a585c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:29.833159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1179/2377] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:30:29.837396 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116d2b7-c3be-4b26-845f-2d363e0a998c admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:29.849030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116d2b7-c3be-4b26-845f-2d363e0a998c admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:29.853992 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed49734-2278-4977-a031-bf50019bb095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:29.861716 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed49734-2278-4977-a031-bf50019bb095 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:29.861716 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed49734-2278-4977-a031-bf50019bb095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:29.861716 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed49734-2278-4977-a031-bf50019bb095 admin admin] PATH_INFO: `/v3/projects/4fc31f809bab45ac8229db66253c7b20/users/9bdf717f8f59405da0790118aa12f3c5/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:29.871529 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed49734-2278-4977-a031-bf50019bb095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc31f809bab45ac8229db66253c7b20, user_id=9bdf717f8f59405da0790118aa12f3c5, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:29.874294 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed49734-2278-4977-a031-bf50019bb095 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:29.976861 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1199/2378] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:30:29 2022] PUT /identity/v3/projects/4fc31f809bab45ac8229db66253c7b20/users/9bdf717f8f59405da0790118aa12f3c5/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:30:29.987536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d277bb-9536-42ed-b9e8-609d32248516 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:29.987900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d277bb-9536-42ed-b9e8-609d32248516 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:29.988293 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d277bb-9536-42ed-b9e8-609d32248516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:30.023397 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-e9d277bb-9536-42ed-b9e8-609d32248516 None None] MFA Rules not processed for user `9bdf717f8f59405da0790118aa12f3c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:30:30.024668 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e9d277bb-9536-42ed-b9e8-609d32248516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:30.109980 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1180/2379] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:30:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:30:30.115016 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed49734-2278-4977-a031-bf50019bb095 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:30.212343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed49734-2278-4977-a031-bf50019bb095 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:30.218603 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d52c44-d09f-4e22-80b5-949a1313f1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:30.219309 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d52c44-d09f-4e22-80b5-949a1313f1f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:30.219561 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d52c44-d09f-4e22-80b5-949a1313f1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:30.219839 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d52c44-d09f-4e22-80b5-949a1313f1f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:30.221027 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d52c44-d09f-4e22-80b5-949a1313f1f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:30.222513 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d52c44-d09f-4e22-80b5-949a1313f1f1 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:30.404012 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1200/2380] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:30:30 2022] POST /identity/v3/projects => generated 401 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:30:30.405169 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d277bb-9536-42ed-b9e8-609d32248516 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:30.419088 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d277bb-9536-42ed-b9e8-609d32248516 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:30.452449 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:30.489154 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5622b7-466c-4606-ab04-f0f15ab2beec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:30.490031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5622b7-466c-4606-ab04-f0f15ab2beec admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:30.490236 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5622b7-466c-4606-ab04-f0f15ab2beec admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:30.490548 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5622b7-466c-4606-ab04-f0f15ab2beec admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:30.491484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5622b7-466c-4606-ab04-f0f15ab2beec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:30.493479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5622b7-466c-4606-ab04-f0f15ab2beec admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:30.580501 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1181/2381] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:30:30 2022] POST /identity/v3/users => generated 307 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:30:30.581763 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d52c44-d09f-4e22-80b5-949a1313f1f1 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:30.595336 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d52c44-d09f-4e22-80b5-949a1313f1f1 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:30.602232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a19ec-345c-4c99-922a-4e84cb4aa692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:30.603067 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a19ec-345c-4c99-922a-4e84cb4aa692 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:30.603443 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a19ec-345c-4c99-922a-4e84cb4aa692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:30.603859 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a19ec-345c-4c99-922a-4e84cb4aa692 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:30.605411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a19ec-345c-4c99-922a-4e84cb4aa692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:30.607372 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a19ec-345c-4c99-922a-4e84cb4aa692 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:30.620904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1201/2382] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:30:30.625231 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5622b7-466c-4606-ab04-f0f15ab2beec admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:30.637813 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5622b7-466c-4606-ab04-f0f15ab2beec admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:30.644240 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941dacc-b502-4477-8c3f-d546b367d00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:30.645664 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941dacc-b502-4477-8c3f-d546b367d00b admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:30.645955 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941dacc-b502-4477-8c3f-d546b367d00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:30.646232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941dacc-b502-4477-8c3f-d546b367d00b admin admin] PATH_INFO: `/v3/projects/e1d2c64df9b1493286a580fbcefa1a76/users/babcf07064a446b5be178a06eb5247ed/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:30.667531 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941dacc-b502-4477-8c3f-d546b367d00b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1d2c64df9b1493286a580fbcefa1a76, user_id=babcf07064a446b5be178a06eb5247ed, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:30.670104 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941dacc-b502-4477-8c3f-d546b367d00b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:30.766699 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1182/2383] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:30:30 2022] PUT /identity/v3/projects/e1d2c64df9b1493286a580fbcefa1a76/users/babcf07064a446b5be178a06eb5247ed/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:30:30.771418 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a19ec-345c-4c99-922a-4e84cb4aa692 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:30.785873 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a19ec-345c-4c99-922a-4e84cb4aa692 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:30.873856 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058e7b4-dbc7-4a61-80a8-c59cf332ea95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:30.873856 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058e7b4-dbc7-4a61-80a8-c59cf332ea95 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:30.873856 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058e7b4-dbc7-4a61-80a8-c59cf332ea95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:30.873856 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058e7b4-dbc7-4a61-80a8-c59cf332ea95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:30.874357 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058e7b4-dbc7-4a61-80a8-c59cf332ea95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:30.874461 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058e7b4-dbc7-4a61-80a8-c59cf332ea95 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:30.885793 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1202/2384] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:30:30.890207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941dacc-b502-4477-8c3f-d546b367d00b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:30.905796 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941dacc-b502-4477-8c3f-d546b367d00b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:30.910845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0a369-5eeb-488d-9383-b7ca8c138092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:30.911754 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0a369-5eeb-488d-9383-b7ca8c138092 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:30.912190 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0a369-5eeb-488d-9383-b7ca8c138092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:30.912406 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0a369-5eeb-488d-9383-b7ca8c138092 admin admin] PATH_INFO: `/v3/projects/e1d2c64df9b1493286a580fbcefa1a76/users/babcf07064a446b5be178a06eb5247ed/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:30.914681 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0a369-5eeb-488d-9383-b7ca8c138092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1d2c64df9b1493286a580fbcefa1a76, user_id=babcf07064a446b5be178a06eb5247ed, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:30.917432 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0a369-5eeb-488d-9383-b7ca8c138092 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:30.928567 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1183/2385] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:30:30 2022] PUT /identity/v3/projects/e1d2c64df9b1493286a580fbcefa1a76/users/babcf07064a446b5be178a06eb5247ed/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:30:30.941446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0220d-5b57-4d8c-9a13-951e9c168cc3 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:30.941735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0220d-5b57-4d8c-9a13-951e9c168cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:30.942013 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0220d-5b57-4d8c-9a13-951e9c168cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:30.951148 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:30.976397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-04b0220d-5b57-4d8c-9a13-951e9c168cc3 None None] MFA Rules not processed for user `babcf07064a446b5be178a06eb5247ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:30:30.977717 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-04b0220d-5b57-4d8c-9a13-951e9c168cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:31.067809 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1203/2386] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:30:30 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:30:31.079728 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0a369-5eeb-488d-9383-b7ca8c138092 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:31.082512 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c2f0a369-5eeb-488d-9383-b7ca8c138092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:31.145849 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0a369-5eeb-488d-9383-b7ca8c138092 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:31.149821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96e77e-a4a4-4603-b525-1c44576b23cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:31.150794 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96e77e-a4a4-4603-b525-1c44576b23cf service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:31.150794 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96e77e-a4a4-4603-b525-1c44576b23cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:31.151066 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96e77e-a4a4-4603-b525-1c44576b23cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:31.161694 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96e77e-a4a4-4603-b525-1c44576b23cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:31.163678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96e77e-a4a4-4603-b525-1c44576b23cf service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:31.177101 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1184/2387] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:30:31 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:30:31.428437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0220d-5b57-4d8c-9a13-951e9c168cc3 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:31.439290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0220d-5b57-4d8c-9a13-951e9c168cc3 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:31.445150 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706f82e-f672-46ad-afbe-3db9c3b6076f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:31.445855 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706f82e-f672-46ad-afbe-3db9c3b6076f service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:31.446131 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706f82e-f672-46ad-afbe-3db9c3b6076f service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:31.446403 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706f82e-f672-46ad-afbe-3db9c3b6076f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:31.516268 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706f82e-f672-46ad-afbe-3db9c3b6076f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:31.518286 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706f82e-f672-46ad-afbe-3db9c3b6076f service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:31.529385 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1204/2388] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:30:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:30:38.163172 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96e77e-a4a4-4603-b525-1c44576b23cf service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:38.243064 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96e77e-a4a4-4603-b525-1c44576b23cf service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:38.248746 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a8158-1ca6-4ae8-8c03-6847dbdfb8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:38.249885 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a8158-1ca6-4ae8-8c03-6847dbdfb8c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:38.250168 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a8158-1ca6-4ae8-8c03-6847dbdfb8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:38.250439 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a8158-1ca6-4ae8-8c03-6847dbdfb8c0 admin admin] PATH_INFO: `/v3/users/9bdf717f8f59405da0790118aa12f3c5` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:38.251848 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a8158-1ca6-4ae8-8c03-6847dbdfb8c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bdf717f8f59405da0790118aa12f3c5)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:38.254013 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a8158-1ca6-4ae8-8c03-6847dbdfb8c0 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:38.353800 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:38.457195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a36a8158-1ca6-4ae8-8c03-6847dbdfb8c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bdf717f8f59405da0790118aa12f3c5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:38.464677 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a36a8158-1ca6-4ae8-8c03-6847dbdfb8c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bdf717f8f59405da0790118aa12f3c5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:38.465893 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a36a8158-1ca6-4ae8-8c03-6847dbdfb8c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bdf717f8f59405da0790118aa12f3c5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:38.466669 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a36a8158-1ca6-4ae8-8c03-6847dbdfb8c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bdf717f8f59405da0790118aa12f3c5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:38.480647 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a36a8158-1ca6-4ae8-8c03-6847dbdfb8c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bdf717f8f59405da0790118aa12f3c5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:38.582619 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1185/2389] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:30:38 2022] DELETE /identity/v3/users/9bdf717f8f59405da0790118aa12f3c5 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:30:38.587471 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0da01a-9e64-4f73-a8d2-4a54984adc99 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:38.587922 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0da01a-9e64-4f73-a8d2-4a54984adc99 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:38.588203 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0da01a-9e64-4f73-a8d2-4a54984adc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:38.619112 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-cc0da01a-9e64-4f73-a8d2-4a54984adc99 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:30:38.620430 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-cc0da01a-9e64-4f73-a8d2-4a54984adc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:38.699327 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1205/2390] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:30:38.713470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a8158-1ca6-4ae8-8c03-6847dbdfb8c0 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:38.716096 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a36a8158-1ca6-4ae8-8c03-6847dbdfb8c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:38.791322 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a8158-1ca6-4ae8-8c03-6847dbdfb8c0 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:38.794927 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b4313-72e2-498f-9e53-17a52511589b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:38.795582 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b4313-72e2-498f-9e53-17a52511589b service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:38.795866 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b4313-72e2-498f-9e53-17a52511589b service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:38.796168 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b4313-72e2-498f-9e53-17a52511589b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:38.806697 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b4313-72e2-498f-9e53-17a52511589b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:38.808867 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b4313-72e2-498f-9e53-17a52511589b service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:38.820487 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1186/2391] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:30:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:30:39.293143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0da01a-9e64-4f73-a8d2-4a54984adc99 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:39.294116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-cc0da01a-9e64-4f73-a8d2-4a54984adc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:39.325053 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0da01a-9e64-4f73-a8d2-4a54984adc99 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:39.325053 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571c57a-5819-4b72-8ef5-e10c68ea4937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:39.325698 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571c57a-5819-4b72-8ef5-e10c68ea4937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:39.325698 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571c57a-5819-4b72-8ef5-e10c68ea4937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:39.325969 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571c57a-5819-4b72-8ef5-e10c68ea4937 admin admin] PATH_INFO: `/v3/projects/4fc31f809bab45ac8229db66253c7b20` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:39.327036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571c57a-5819-4b72-8ef5-e10c68ea4937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fc31f809bab45ac8229db66253c7b20)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:39.329495 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571c57a-5819-4b72-8ef5-e10c68ea4937 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:39.361258 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:39.467882 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-8571c57a-5819-4b72-8ef5-e10c68ea4937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fc31f809bab45ac8229db66253c7b20', 'request_id': 'req-8571c57a-5819-4b72-8ef5-e10c68ea4937'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:39.524238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-8571c57a-5819-4b72-8ef5-e10c68ea4937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fc31f809bab45ac8229db66253c7b20', 'request_id': 'req-8571c57a-5819-4b72-8ef5-e10c68ea4937'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:39.530505 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-8571c57a-5819-4b72-8ef5-e10c68ea4937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fc31f809bab45ac8229db66253c7b20', 'request_id': 'req-8571c57a-5819-4b72-8ef5-e10c68ea4937'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:39.542618 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-8571c57a-5819-4b72-8ef5-e10c68ea4937 admin admin] The token cache is being invalidate because project 4fc31f809bab45ac8229db66253c7b20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:30:39.542835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-8571c57a-5819-4b72-8ef5-e10c68ea4937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:39.543478 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-8571c57a-5819-4b72-8ef5-e10c68ea4937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:39.545039 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1206/2392] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:30:39 2022] DELETE /identity/v3/projects/4fc31f809bab45ac8229db66253c7b20 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:30:39.549066 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b4313-72e2-498f-9e53-17a52511589b service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:39.565302 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b4313-72e2-498f-9e53-17a52511589b service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:39.632227 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8bbaf-966a-4ad8-8c3e-cd7f52f75639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:39.633114 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8bbaf-966a-4ad8-8c3e-cd7f52f75639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:39.633392 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8bbaf-966a-4ad8-8c3e-cd7f52f75639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:39.633668 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8bbaf-966a-4ad8-8c3e-cd7f52f75639 admin admin] PATH_INFO: `/v3/users/babcf07064a446b5be178a06eb5247ed` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:39.635447 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8bbaf-966a-4ad8-8c3e-cd7f52f75639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=babcf07064a446b5be178a06eb5247ed)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:39.637426 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8bbaf-966a-4ad8-8c3e-cd7f52f75639 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:39.876081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-dda8bbaf-966a-4ad8-8c3e-cd7f52f75639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'babcf07064a446b5be178a06eb5247ed'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:39.877843 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:39.886753 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-dda8bbaf-966a-4ad8-8c3e-cd7f52f75639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'babcf07064a446b5be178a06eb5247ed'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:39.887499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-dda8bbaf-966a-4ad8-8c3e-cd7f52f75639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'babcf07064a446b5be178a06eb5247ed'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:39.888306 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-dda8bbaf-966a-4ad8-8c3e-cd7f52f75639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'babcf07064a446b5be178a06eb5247ed'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:39.906193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-dda8bbaf-966a-4ad8-8c3e-cd7f52f75639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'babcf07064a446b5be178a06eb5247ed'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:39.989027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1187/2393] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:30:39 2022] DELETE /identity/v3/users/babcf07064a446b5be178a06eb5247ed => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:30:40.072206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffa6fc-797e-49d1-8c7f-251155837ced None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:40.080193 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffa6fc-797e-49d1-8c7f-251155837ced None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:40.080193 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffa6fc-797e-49d1-8c7f-251155837ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:40.096150 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-82ffa6fc-797e-49d1-8c7f-251155837ced None None] MFA Rules not processed for user `27c5deeab63347048484a02f6bdbab29`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:30:40.097483 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-82ffa6fc-797e-49d1-8c7f-251155837ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:40.159666 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1207/2394] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:30:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:30:40.547860 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8bbaf-966a-4ad8-8c3e-cd7f52f75639 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:40.549347 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-dda8bbaf-966a-4ad8-8c3e-cd7f52f75639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:40.625627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8bbaf-966a-4ad8-8c3e-cd7f52f75639 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:40.632411 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f08284-2590-4bec-a7ac-ce9b0c94b443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:40.633285 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f08284-2590-4bec-a7ac-ce9b0c94b443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:40.633570 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f08284-2590-4bec-a7ac-ce9b0c94b443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:40.633871 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f08284-2590-4bec-a7ac-ce9b0c94b443 admin admin] PATH_INFO: `/v3/projects/e1d2c64df9b1493286a580fbcefa1a76` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:40.635790 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f08284-2590-4bec-a7ac-ce9b0c94b443 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1d2c64df9b1493286a580fbcefa1a76)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:40.637863 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f08284-2590-4bec-a7ac-ce9b0c94b443 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:40.762783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-43f08284-2590-4bec-a7ac-ce9b0c94b443 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1d2c64df9b1493286a580fbcefa1a76', 'request_id': 'req-43f08284-2590-4bec-a7ac-ce9b0c94b443'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:40.770024 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-43f08284-2590-4bec-a7ac-ce9b0c94b443 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1d2c64df9b1493286a580fbcefa1a76', 'request_id': 'req-43f08284-2590-4bec-a7ac-ce9b0c94b443'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:40.845631 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-43f08284-2590-4bec-a7ac-ce9b0c94b443 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1d2c64df9b1493286a580fbcefa1a76', 'request_id': 'req-43f08284-2590-4bec-a7ac-ce9b0c94b443'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:40.861992 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-43f08284-2590-4bec-a7ac-ce9b0c94b443 admin admin] The token cache is being invalidate because project e1d2c64df9b1493286a580fbcefa1a76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:30:40.862299 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-43f08284-2590-4bec-a7ac-ce9b0c94b443 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:40.862974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-43f08284-2590-4bec-a7ac-ce9b0c94b443 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:40.864584 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1188/2395] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:30:40 2022] DELETE /identity/v3/projects/e1d2c64df9b1493286a580fbcefa1a76 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:30:40.872894 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb874e-a0e6-4458-9710-6be405ff55af None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:40.873188 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb874e-a0e6-4458-9710-6be405ff55af None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:40.876531 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb874e-a0e6-4458-9710-6be405ff55af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:40.892925 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-d9eb874e-a0e6-4458-9710-6be405ff55af None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:30:40.894154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-d9eb874e-a0e6-4458-9710-6be405ff55af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:40.955861 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1208/2396] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:30:41.021601 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cf6f5-741e-4902-821c-a3a32a804988 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:41.022191 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cf6f5-741e-4902-821c-a3a32a804988 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:41.022468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cf6f5-741e-4902-821c-a3a32a804988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:41.042935 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-e78cf6f5-741e-4902-821c-a3a32a804988 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:30:41.044195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e78cf6f5-741e-4902-821c-a3a32a804988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:41.052539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1189/2397] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:30:41.057629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb874e-a0e6-4458-9710-6be405ff55af None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:41.068391 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb874e-a0e6-4458-9710-6be405ff55af None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:41.073761 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c542e5-f136-417b-a5da-cc4875f0718b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:41.074571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c542e5-f136-417b-a5da-cc4875f0718b admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:41.074861 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c542e5-f136-417b-a5da-cc4875f0718b admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:41.075140 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c542e5-f136-417b-a5da-cc4875f0718b admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:41.075877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c542e5-f136-417b-a5da-cc4875f0718b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:30:41.076277 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c542e5-f136-417b-a5da-cc4875f0718b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:41.078035 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c542e5-f136-417b-a5da-cc4875f0718b admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:41.091108 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1209/2398] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:30:41.095346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78cf6f5-741e-4902-821c-a3a32a804988 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:41.106574 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78cf6f5-741e-4902-821c-a3a32a804988 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:41.112409 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6f109-b500-4d59-8f46-6c1502552e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:41.113079 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6f109-b500-4d59-8f46-6c1502552e16 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:41.113361 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6f109-b500-4d59-8f46-6c1502552e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:41.113639 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6f109-b500-4d59-8f46-6c1502552e16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:41.114387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6f109-b500-4d59-8f46-6c1502552e16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:41.116898 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6f109-b500-4d59-8f46-6c1502552e16 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:41.228700 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1190/2399] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:30:41 2022] POST /identity/v3/projects => generated 409 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:30:41.232853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c542e5-f136-417b-a5da-cc4875f0718b admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:41.243777 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c542e5-f136-417b-a5da-cc4875f0718b admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:41.285459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:41.300735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a7446-e99b-4bf9-ae0e-293b04d278a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:41.301406 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a7446-e99b-4bf9-ae0e-293b04d278a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:41.301689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a7446-e99b-4bf9-ae0e-293b04d278a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:41.301967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a7446-e99b-4bf9-ae0e-293b04d278a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:41.302658 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a7446-e99b-4bf9-ae0e-293b04d278a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:41.305220 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a7446-e99b-4bf9-ae0e-293b04d278a4 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:41.415956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1210/2400] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:30:41 2022] POST /identity/v3/users => generated 305 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:30:41.420201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6f109-b500-4d59-8f46-6c1502552e16 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:41.430898 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6f109-b500-4d59-8f46-6c1502552e16 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:41.435564 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae1e46-c8a7-4f70-b237-57bf36d29a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:41.436371 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae1e46-c8a7-4f70-b237-57bf36d29a30 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:41.436652 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae1e46-c8a7-4f70-b237-57bf36d29a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:41.436924 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae1e46-c8a7-4f70-b237-57bf36d29a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:41.437643 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae1e46-c8a7-4f70-b237-57bf36d29a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:41.439227 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae1e46-c8a7-4f70-b237-57bf36d29a30 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:41.449914 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1191/2401] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:30:41.455778 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a7446-e99b-4bf9-ae0e-293b04d278a4 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:41.466546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a7446-e99b-4bf9-ae0e-293b04d278a4 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:41.471364 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6cd93-463e-436a-836d-dc0e1da55b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:41.472274 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6cd93-463e-436a-836d-dc0e1da55b6c admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:41.472717 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6cd93-463e-436a-836d-dc0e1da55b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:41.473380 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6cd93-463e-436a-836d-dc0e1da55b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:41.474149 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6cd93-463e-436a-836d-dc0e1da55b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:41.476425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6cd93-463e-436a-836d-dc0e1da55b6c admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:41.492416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1211/2402] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:30:41.496974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae1e46-c8a7-4f70-b237-57bf36d29a30 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:41.509540 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae1e46-c8a7-4f70-b237-57bf36d29a30 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:41.515223 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06bebf-ad6c-4a7e-a12a-0cb4fccdc775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:41.516333 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06bebf-ad6c-4a7e-a12a-0cb4fccdc775 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:41.516611 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06bebf-ad6c-4a7e-a12a-0cb4fccdc775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:41.516763 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06bebf-ad6c-4a7e-a12a-0cb4fccdc775 admin admin] PATH_INFO: `/v3/projects/2ca770bbcace453ea9c9c62557a91c4c/users/77c8f445bcf440eea96a493ce24069e5/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:41.530688 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:41.533912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06bebf-ad6c-4a7e-a12a-0cb4fccdc775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca770bbcace453ea9c9c62557a91c4c, user_id=77c8f445bcf440eea96a493ce24069e5, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:41.536642 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06bebf-ad6c-4a7e-a12a-0cb4fccdc775 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:41.661381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1192/2403] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:30:41 2022] PUT /identity/v3/projects/2ca770bbcace453ea9c9c62557a91c4c/users/77c8f445bcf440eea96a493ce24069e5/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:30:41.672726 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997ccf9-c14c-414a-acfd-caec581d0d58 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:41.673310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997ccf9-c14c-414a-acfd-caec581d0d58 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:41.673838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997ccf9-c14c-414a-acfd-caec581d0d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:41.701406 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-2997ccf9-c14c-414a-acfd-caec581d0d58 None None] MFA Rules not processed for user `77c8f445bcf440eea96a493ce24069e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:30:41.702720 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-2997ccf9-c14c-414a-acfd-caec581d0d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:41.770742 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1212/2404] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:30:41 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:30:41.775800 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06bebf-ad6c-4a7e-a12a-0cb4fccdc775 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:41.847755 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06bebf-ad6c-4a7e-a12a-0cb4fccdc775 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:41.855521 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8c362-4de6-4668-9fc1-cfedd821f1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:41.857643 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8c362-4de6-4668-9fc1-cfedd821f1de admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:41.857643 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8c362-4de6-4668-9fc1-cfedd821f1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:41.857643 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8c362-4de6-4668-9fc1-cfedd821f1de admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:41.857643 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8c362-4de6-4668-9fc1-cfedd821f1de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:41.859688 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8c362-4de6-4668-9fc1-cfedd821f1de admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:41.968280 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1193/2405] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:30:41 2022] POST /identity/v3/projects => generated 407 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:30:41.973776 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997ccf9-c14c-414a-acfd-caec581d0d58 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:41.988260 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997ccf9-c14c-414a-acfd-caec581d0d58 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:42.086953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5ef62-906f-405b-9541-65d2a0f0486f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:42.087779 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5ef62-906f-405b-9541-65d2a0f0486f admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:42.087929 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5ef62-906f-405b-9541-65d2a0f0486f admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:42.088199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5ef62-906f-405b-9541-65d2a0f0486f admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:42.088893 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5ef62-906f-405b-9541-65d2a0f0486f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:42.092171 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5ef62-906f-405b-9541-65d2a0f0486f admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:42.183148 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1213/2406] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:30:41 2022] POST /identity/v3/users => generated 310 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:30:42.187732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8c362-4de6-4668-9fc1-cfedd821f1de admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:42.209652 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8c362-4de6-4668-9fc1-cfedd821f1de admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:42.218261 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fcf97-0f3f-41cd-846e-8dd578ca92d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:42.219453 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fcf97-0f3f-41cd-846e-8dd578ca92d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:42.220174 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fcf97-0f3f-41cd-846e-8dd578ca92d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:42.220621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fcf97-0f3f-41cd-846e-8dd578ca92d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:42.222075 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736fcf97-0f3f-41cd-846e-8dd578ca92d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:42.225653 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736fcf97-0f3f-41cd-846e-8dd578ca92d2 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:42.243502 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1194/2407] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:30:42.247912 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5ef62-906f-405b-9541-65d2a0f0486f admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:42.259310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5ef62-906f-405b-9541-65d2a0f0486f admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:42.266256 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604ea8f-fdbe-4949-b1d0-39e76bb1ec2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:42.267458 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604ea8f-fdbe-4949-b1d0-39e76bb1ec2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:42.267746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604ea8f-fdbe-4949-b1d0-39e76bb1ec2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:42.268041 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604ea8f-fdbe-4949-b1d0-39e76bb1ec2a admin admin] PATH_INFO: `/v3/projects/889bf77244f548d398cda925d4ad47ff/users/872e302b06c6460dbfb35c38b2b4fa3c/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:42.285636 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604ea8f-fdbe-4949-b1d0-39e76bb1ec2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=889bf77244f548d398cda925d4ad47ff, user_id=872e302b06c6460dbfb35c38b2b4fa3c, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:42.288910 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604ea8f-fdbe-4949-b1d0-39e76bb1ec2a admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:42.365856 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1214/2408] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:30:42 2022] PUT /identity/v3/projects/889bf77244f548d398cda925d4ad47ff/users/872e302b06c6460dbfb35c38b2b4fa3c/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:30:42.370753 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fcf97-0f3f-41cd-846e-8dd578ca92d2 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:42.383448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fcf97-0f3f-41cd-846e-8dd578ca92d2 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:42.441304 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fa666-d3f5-4312-ae1c-b18d337ff722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:42.442252 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fa666-d3f5-4312-ae1c-b18d337ff722 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:42.442378 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fa666-d3f5-4312-ae1c-b18d337ff722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:42.442596 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fa666-d3f5-4312-ae1c-b18d337ff722 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:42.443631 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302fa666-d3f5-4312-ae1c-b18d337ff722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:42.445854 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302fa666-d3f5-4312-ae1c-b18d337ff722 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:42.457951 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1195/2409] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:30:42.462913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604ea8f-fdbe-4949-b1d0-39e76bb1ec2a admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:42.473944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604ea8f-fdbe-4949-b1d0-39e76bb1ec2a admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:42.478876 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf8856-c719-43bf-9819-c1de2ea5dcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:42.479759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf8856-c719-43bf-9819-c1de2ea5dcfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:42.480100 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf8856-c719-43bf-9819-c1de2ea5dcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:42.480416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf8856-c719-43bf-9819-c1de2ea5dcfe admin admin] PATH_INFO: `/v3/projects/889bf77244f548d398cda925d4ad47ff/users/872e302b06c6460dbfb35c38b2b4fa3c/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:42.482444 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf8856-c719-43bf-9819-c1de2ea5dcfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=889bf77244f548d398cda925d4ad47ff, user_id=872e302b06c6460dbfb35c38b2b4fa3c, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:42.485132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf8856-c719-43bf-9819-c1de2ea5dcfe admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:42.496353 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1215/2410] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:30:42 2022] PUT /identity/v3/projects/889bf77244f548d398cda925d4ad47ff/users/872e302b06c6460dbfb35c38b2b4fa3c/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:30:42.507902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a28b4-69f9-43e2-bf98-e1bfc90721e5 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:42.508286 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a28b4-69f9-43e2-bf98-e1bfc90721e5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:42.508585 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a28b4-69f9-43e2-bf98-e1bfc90721e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:42.535834 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-9c4a28b4-69f9-43e2-bf98-e1bfc90721e5 None None] MFA Rules not processed for user `872e302b06c6460dbfb35c38b2b4fa3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:30:42.537084 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9c4a28b4-69f9-43e2-bf98-e1bfc90721e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:42.585587 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:42.606190 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1196/2411] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:30:42 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:30:42.618095 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf8856-c719-43bf-9819-c1de2ea5dcfe admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:42.619773 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-bdcf8856-c719-43bf-9819-c1de2ea5dcfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:42.626254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:42.681409 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf8856-c719-43bf-9819-c1de2ea5dcfe admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:42.686071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde17ebe-8eb2-49f8-880b-bb6e46006ca0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:42.686825 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde17ebe-8eb2-49f8-880b-bb6e46006ca0 service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:42.687042 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde17ebe-8eb2-49f8-880b-bb6e46006ca0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:42.687309 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde17ebe-8eb2-49f8-880b-bb6e46006ca0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:42.700583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde17ebe-8eb2-49f8-880b-bb6e46006ca0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:42.703811 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde17ebe-8eb2-49f8-880b-bb6e46006ca0 service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:42.714031 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1216/2412] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:30:42 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:30:43.104045 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a28b4-69f9-43e2-bf98-e1bfc90721e5 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:43.113802 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a28b4-69f9-43e2-bf98-e1bfc90721e5 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:43.118131 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be51737-cdaa-4710-a2c9-cdbfe23a9486 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:43.120435 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be51737-cdaa-4710-a2c9-cdbfe23a9486 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:43.120435 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be51737-cdaa-4710-a2c9-cdbfe23a9486 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:43.120435 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be51737-cdaa-4710-a2c9-cdbfe23a9486 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:43.177988 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be51737-cdaa-4710-a2c9-cdbfe23a9486 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:43.179635 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be51737-cdaa-4710-a2c9-cdbfe23a9486 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:43.188720 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1197/2413] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:30:43 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:30:50.378666 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde17ebe-8eb2-49f8-880b-bb6e46006ca0 service cinder] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:50.447966 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde17ebe-8eb2-49f8-880b-bb6e46006ca0 service cinder] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:50.452533 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f2e13-8575-4fa3-a0c6-a28d597ca583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:50.453412 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f2e13-8575-4fa3-a0c6-a28d597ca583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:50.453705 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f2e13-8575-4fa3-a0c6-a28d597ca583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:50.454007 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f2e13-8575-4fa3-a0c6-a28d597ca583 admin admin] PATH_INFO: `/v3/users/77c8f445bcf440eea96a493ce24069e5` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:50.455149 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f2e13-8575-4fa3-a0c6-a28d597ca583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77c8f445bcf440eea96a493ce24069e5)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:50.457094 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f2e13-8575-4fa3-a0c6-a28d597ca583 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:50.681041 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-154f2e13-8575-4fa3-a0c6-a28d597ca583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77c8f445bcf440eea96a493ce24069e5'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:50.694283 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-154f2e13-8575-4fa3-a0c6-a28d597ca583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77c8f445bcf440eea96a493ce24069e5'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:50.701319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-154f2e13-8575-4fa3-a0c6-a28d597ca583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77c8f445bcf440eea96a493ce24069e5'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:50.702166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-154f2e13-8575-4fa3-a0c6-a28d597ca583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77c8f445bcf440eea96a493ce24069e5'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:50.702875 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-154f2e13-8575-4fa3-a0c6-a28d597ca583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77c8f445bcf440eea96a493ce24069e5'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:50.781238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1217/2414] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:30:50 2022] DELETE /identity/v3/users/77c8f445bcf440eea96a493ce24069e5 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:30:50.785704 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292d138-82f7-4386-abb4-5614f7701861 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:50.786224 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292d138-82f7-4386-abb4-5614f7701861 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:50.786337 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292d138-82f7-4386-abb4-5614f7701861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:50.805442 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-a292d138-82f7-4386-abb4-5614f7701861 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:30:50.806656 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a292d138-82f7-4386-abb4-5614f7701861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:50.865786 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1198/2415] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:30:50.875359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f2e13-8575-4fa3-a0c6-a28d597ca583 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:50.876797 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-154f2e13-8575-4fa3-a0c6-a28d597ca583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:50.908819 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:50.933819 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f2e13-8575-4fa3-a0c6-a28d597ca583 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:50.937451 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c958e-b849-47cc-a009-26ebc7eaebf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:50.938088 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c958e-b849-47cc-a009-26ebc7eaebf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:50.938366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c958e-b849-47cc-a009-26ebc7eaebf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:50.938636 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c958e-b849-47cc-a009-26ebc7eaebf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:50.948708 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c958e-b849-47cc-a009-26ebc7eaebf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:50.952116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c958e-b849-47cc-a009-26ebc7eaebf2 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:50.959471 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1218/2416] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:30:51.348737 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292d138-82f7-4386-abb4-5614f7701861 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:51.350865 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a292d138-82f7-4386-abb4-5614f7701861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:51.363750 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292d138-82f7-4386-abb4-5614f7701861 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:51.369210 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356b221-69d5-4e76-b086-83b0f1a378ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:51.370111 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356b221-69d5-4e76-b086-83b0f1a378ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:51.370414 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356b221-69d5-4e76-b086-83b0f1a378ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:51.370693 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356b221-69d5-4e76-b086-83b0f1a378ab admin admin] PATH_INFO: `/v3/projects/2ca770bbcace453ea9c9c62557a91c4c` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:51.372030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356b221-69d5-4e76-b086-83b0f1a378ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca770bbcace453ea9c9c62557a91c4c)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:51.373997 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356b221-69d5-4e76-b086-83b0f1a378ab admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:51.486034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7356b221-69d5-4e76-b086-83b0f1a378ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca770bbcace453ea9c9c62557a91c4c', 'request_id': 'req-7356b221-69d5-4e76-b086-83b0f1a378ab'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:51.492312 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7356b221-69d5-4e76-b086-83b0f1a378ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca770bbcace453ea9c9c62557a91c4c', 'request_id': 'req-7356b221-69d5-4e76-b086-83b0f1a378ab'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:51.614710 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7356b221-69d5-4e76-b086-83b0f1a378ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca770bbcace453ea9c9c62557a91c4c', 'request_id': 'req-7356b221-69d5-4e76-b086-83b0f1a378ab'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:51.626628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7356b221-69d5-4e76-b086-83b0f1a378ab admin admin] The token cache is being invalidate because project 2ca770bbcace453ea9c9c62557a91c4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:30:51.626912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7356b221-69d5-4e76-b086-83b0f1a378ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:51.627568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7356b221-69d5-4e76-b086-83b0f1a378ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:51.629163 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1199/2417] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:30:51 2022] DELETE /identity/v3/projects/2ca770bbcace453ea9c9c62557a91c4c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:30:51.633218 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c958e-b849-47cc-a009-26ebc7eaebf2 service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:51.642866 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c958e-b849-47cc-a009-26ebc7eaebf2 service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:51.700585 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accf04f-9e96-4c31-a458-2140f3b77e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:51.701459 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accf04f-9e96-4c31-a458-2140f3b77e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:51.701739 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accf04f-9e96-4c31-a458-2140f3b77e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:51.702011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accf04f-9e96-4c31-a458-2140f3b77e10 admin admin] PATH_INFO: `/v3/users/872e302b06c6460dbfb35c38b2b4fa3c` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:51.703279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accf04f-9e96-4c31-a458-2140f3b77e10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=872e302b06c6460dbfb35c38b2b4fa3c)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:51.705204 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accf04f-9e96-4c31-a458-2140f3b77e10 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:51.891448 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-3accf04f-9e96-4c31-a458-2140f3b77e10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872e302b06c6460dbfb35c38b2b4fa3c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:51.903111 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-3accf04f-9e96-4c31-a458-2140f3b77e10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872e302b06c6460dbfb35c38b2b4fa3c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:51.909909 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-3accf04f-9e96-4c31-a458-2140f3b77e10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872e302b06c6460dbfb35c38b2b4fa3c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:51.910589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-3accf04f-9e96-4c31-a458-2140f3b77e10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872e302b06c6460dbfb35c38b2b4fa3c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:51.911187 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-3accf04f-9e96-4c31-a458-2140f3b77e10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872e302b06c6460dbfb35c38b2b4fa3c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:51.992063 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1219/2418] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:30:51 2022] DELETE /identity/v3/users/872e302b06c6460dbfb35c38b2b4fa3c => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:30:52.468254 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356b221-69d5-4e76-b086-83b0f1a378ab admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:52.470257 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7356b221-69d5-4e76-b086-83b0f1a378ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:52.489042 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356b221-69d5-4e76-b086-83b0f1a378ab admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:52.498617 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:52.576539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403bce7-2d41-49cc-8adf-773e407d1973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:52.577513 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403bce7-2d41-49cc-8adf-773e407d1973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:52.578057 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403bce7-2d41-49cc-8adf-773e407d1973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:52.578584 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403bce7-2d41-49cc-8adf-773e407d1973 admin admin] PATH_INFO: `/v3/projects/889bf77244f548d398cda925d4ad47ff` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:52.579975 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403bce7-2d41-49cc-8adf-773e407d1973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=889bf77244f548d398cda925d4ad47ff)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:52.582133 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403bce7-2d41-49cc-8adf-773e407d1973 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:52.767679 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6403bce7-2d41-49cc-8adf-773e407d1973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '889bf77244f548d398cda925d4ad47ff', 'request_id': 'req-6403bce7-2d41-49cc-8adf-773e407d1973'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:52.775704 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6403bce7-2d41-49cc-8adf-773e407d1973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '889bf77244f548d398cda925d4ad47ff', 'request_id': 'req-6403bce7-2d41-49cc-8adf-773e407d1973'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:52.872238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6403bce7-2d41-49cc-8adf-773e407d1973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '889bf77244f548d398cda925d4ad47ff', 'request_id': 'req-6403bce7-2d41-49cc-8adf-773e407d1973'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:52.884414 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6403bce7-2d41-49cc-8adf-773e407d1973 admin admin] The token cache is being invalidate because project 889bf77244f548d398cda925d4ad47ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:30:52.885189 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6403bce7-2d41-49cc-8adf-773e407d1973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:52.886484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6403bce7-2d41-49cc-8adf-773e407d1973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:30:52.888527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1200/2419] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:30:52 2022] DELETE /identity/v3/projects/889bf77244f548d398cda925d4ad47ff => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:30:52.894521 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f05b15-d2b6-4b1c-b42f-eb620ff775b7 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:52.895054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f05b15-d2b6-4b1c-b42f-eb620ff775b7 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:52.895186 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f05b15-d2b6-4b1c-b42f-eb620ff775b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:52.915124 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-f9f05b15-d2b6-4b1c-b42f-eb620ff775b7 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:30:52.916369 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-f9f05b15-d2b6-4b1c-b42f-eb620ff775b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:52.963184 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:52.979456 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1220/2420] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:30:52.987721 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea591b7e-9d36-4c2e-9f83-6f9e4ba6bba8 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:52.988024 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea591b7e-9d36-4c2e-9f83-6f9e4ba6bba8 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:52.988319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea591b7e-9d36-4c2e-9f83-6f9e4ba6bba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:53.008050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-ea591b7e-9d36-4c2e-9f83-6f9e4ba6bba8 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:30:53.009287 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ea591b7e-9d36-4c2e-9f83-6f9e4ba6bba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:53.018227 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1201/2421] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:30:53.022699 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f05b15-d2b6-4b1c-b42f-eb620ff775b7 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:53.032967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f05b15-d2b6-4b1c-b42f-eb620ff775b7 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:53.037515 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e5a0f-76f2-44aa-b03c-3571f97b36f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:53.044732 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e5a0f-76f2-44aa-b03c-3571f97b36f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:53.044732 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e5a0f-76f2-44aa-b03c-3571f97b36f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:53.044732 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e5a0f-76f2-44aa-b03c-3571f97b36f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:53.044732 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e5a0f-76f2-44aa-b03c-3571f97b36f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:30:53.044732 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e5a0f-76f2-44aa-b03c-3571f97b36f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:53.044732 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e5a0f-76f2-44aa-b03c-3571f97b36f3 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:53.053831 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1221/2422] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:30:53.058175 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea591b7e-9d36-4c2e-9f83-6f9e4ba6bba8 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:53.067527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea591b7e-9d36-4c2e-9f83-6f9e4ba6bba8 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:53.073557 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc601b-6418-45d2-8a1a-92acff2e54a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:53.074306 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc601b-6418-45d2-8a1a-92acff2e54a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:53.074686 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc601b-6418-45d2-8a1a-92acff2e54a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:53.075016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc601b-6418-45d2-8a1a-92acff2e54a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:53.075887 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc601b-6418-45d2-8a1a-92acff2e54a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:53.078530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc601b-6418-45d2-8a1a-92acff2e54a7 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:53.208091 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1202/2423] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:30:53 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:30:53.209301 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e5a0f-76f2-44aa-b03c-3571f97b36f3 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:53.220190 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e5a0f-76f2-44aa-b03c-3571f97b36f3 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:53.278275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832074f-50c8-418d-894d-216614abaa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:53.278865 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832074f-50c8-418d-894d-216614abaa1a admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:53.279146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832074f-50c8-418d-894d-216614abaa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:53.279416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832074f-50c8-418d-894d-216614abaa1a admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:53.280152 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832074f-50c8-418d-894d-216614abaa1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:53.282168 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832074f-50c8-418d-894d-216614abaa1a admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:53.370331 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1222/2424] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:30:53 2022] POST /identity/v3/users => generated 291 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:30:53.374655 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc601b-6418-45d2-8a1a-92acff2e54a7 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:53.385775 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc601b-6418-45d2-8a1a-92acff2e54a7 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:53.390409 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b310f98-35e7-45df-be83-565f2dad95c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:53.391069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b310f98-35e7-45df-be83-565f2dad95c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:53.391352 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b310f98-35e7-45df-be83-565f2dad95c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:53.391628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b310f98-35e7-45df-be83-565f2dad95c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:53.392418 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b310f98-35e7-45df-be83-565f2dad95c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:53.394019 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b310f98-35e7-45df-be83-565f2dad95c1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:53.405473 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1203/2425] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:30:53.409661 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832074f-50c8-418d-894d-216614abaa1a admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:53.420582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832074f-50c8-418d-894d-216614abaa1a admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:53.428801 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf2aa2-6367-49d6-88c3-73d54f96d38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:53.430600 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf2aa2-6367-49d6-88c3-73d54f96d38c admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:53.431163 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf2aa2-6367-49d6-88c3-73d54f96d38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:53.431663 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf2aa2-6367-49d6-88c3-73d54f96d38c admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:53.433046 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf2aa2-6367-49d6-88c3-73d54f96d38c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:53.435555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf2aa2-6367-49d6-88c3-73d54f96d38c admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:53.448777 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1223/2426] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:30:53.453419 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b310f98-35e7-45df-be83-565f2dad95c1 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:53.463583 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b310f98-35e7-45df-be83-565f2dad95c1 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:53.468670 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a63111-8885-4937-9cfc-59ad241f17c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:53.469577 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a63111-8885-4937-9cfc-59ad241f17c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:53.469832 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a63111-8885-4937-9cfc-59ad241f17c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:53.470105 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a63111-8885-4937-9cfc-59ad241f17c6 admin admin] PATH_INFO: `/v3/projects/09d0fa6f616d4fcba8dad7b9924864a7/users/b73ac3812b9741b0b09a30c592fe7af2/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:53.491765 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a63111-8885-4937-9cfc-59ad241f17c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d0fa6f616d4fcba8dad7b9924864a7, user_id=b73ac3812b9741b0b09a30c592fe7af2, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:53.495050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a63111-8885-4937-9cfc-59ad241f17c6 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:53.592834 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1204/2427] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:30:53 2022] PUT /identity/v3/projects/09d0fa6f616d4fcba8dad7b9924864a7/users/b73ac3812b9741b0b09a30c592fe7af2/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:30:53.598092 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51996d11-1724-4a91-aa2c-ba9fc9143c7d None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:53.598382 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51996d11-1724-4a91-aa2c-ba9fc9143c7d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:53.598683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51996d11-1724-4a91-aa2c-ba9fc9143c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:53.615294 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-51996d11-1724-4a91-aa2c-ba9fc9143c7d None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:30:53.616514 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-51996d11-1724-4a91-aa2c-ba9fc9143c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:53.677074 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1224/2428] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:30:53.687366 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a63111-8885-4937-9cfc-59ad241f17c6 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:53.689174 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-44a63111-8885-4937-9cfc-59ad241f17c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:53.729649 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:53.746757 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a63111-8885-4937-9cfc-59ad241f17c6 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:53.750489 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09223b-4801-43e4-bdaa-46f7c8fef214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:53.751134 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09223b-4801-43e4-bdaa-46f7c8fef214 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:53.751424 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09223b-4801-43e4-bdaa-46f7c8fef214 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:53.751700 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09223b-4801-43e4-bdaa-46f7c8fef214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:53.761368 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09223b-4801-43e4-bdaa-46f7c8fef214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:53.762799 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09223b-4801-43e4-bdaa-46f7c8fef214 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:53.772299 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1205/2429] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:30:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:30:55.089060 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4f7cd-fa3a-4344-840f-a3ee64d09e11 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:55.089060 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4f7cd-fa3a-4344-840f-a3ee64d09e11 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:55.089060 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4f7cd-fa3a-4344-840f-a3ee64d09e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:55.117789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-31d4f7cd-fa3a-4344-840f-a3ee64d09e11 None None] MFA Rules not processed for user `b73ac3812b9741b0b09a30c592fe7af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:30:55.119348 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-31d4f7cd-fa3a-4344-840f-a3ee64d09e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:55.188437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:55.220246 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1225/2430] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:30:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:30:55.230484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09223b-4801-43e4-bdaa-46f7c8fef214 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:55.236514 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-de09223b-4801-43e4-bdaa-46f7c8fef214 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:55.329367 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09223b-4801-43e4-bdaa-46f7c8fef214 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:55.333051 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211fa70-25fb-464c-b8f6-e78668ff63e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:55.334223 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211fa70-25fb-464c-b8f6-e78668ff63e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:55.334223 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211fa70-25fb-464c-b8f6-e78668ff63e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:55.334223 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211fa70-25fb-464c-b8f6-e78668ff63e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:55.344229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211fa70-25fb-464c-b8f6-e78668ff63e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:55.345670 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211fa70-25fb-464c-b8f6-e78668ff63e8 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:55.355145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1206/2431] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:30:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:30:57.165776 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87c45e-91db-4617-946a-cd03051d46cd None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:57.166324 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87c45e-91db-4617-946a-cd03051d46cd None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:57.166324 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87c45e-91db-4617-946a-cd03051d46cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:57.185048 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-ef87c45e-91db-4617-946a-cd03051d46cd None None] MFA Rules not processed for user `b73ac3812b9741b0b09a30c592fe7af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:30:57.186272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-ef87c45e-91db-4617-946a-cd03051d46cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:57.193637 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1226/2432] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:30:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:30:58.921859 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211fa70-25fb-464c-b8f6-e78668ff63e8 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:58.923351 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c211fa70-25fb-464c-b8f6-e78668ff63e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:59.002454 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211fa70-25fb-464c-b8f6-e78668ff63e8 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:59.009225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad29fcf-65f3-4b63-8d37-5fd6eaab33bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ebc95c1b3284c1d8321900cf442a811', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:59.009225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad29fcf-65f3-4b63-8d37-5fd6eaab33bb service placement] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:59.009225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad29fcf-65f3-4b63-8d37-5fd6eaab33bb service placement] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:59.009225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad29fcf-65f3-4b63-8d37-5fd6eaab33bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:59.010524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-fad29fcf-65f3-4b63-8d37-5fd6eaab33bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:59.021793 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad29fcf-65f3-4b63-8d37-5fd6eaab33bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:59.023364 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad29fcf-65f3-4b63-8d37-5fd6eaab33bb service placement] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:59.033703 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1207/2433] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:30:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:31:07.178940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=10 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:31:09.029533 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=68 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:31:14.390039 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402b494-3f14-4ae9-a1f0-8560ab24fc5d None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:14.390546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402b494-3f14-4ae9-a1f0-8560ab24fc5d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:14.390662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402b494-3f14-4ae9-a1f0-8560ab24fc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:14.410105 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-5402b494-3f14-4ae9-a1f0-8560ab24fc5d None None] MFA Rules not processed for user `235042beafd246c5b227b3926098c8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:31:14.411428 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5402b494-3f14-4ae9-a1f0-8560ab24fc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:31:14.471239 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1227/2434] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jun 2 19:31:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:31:14.612939 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad29fcf-65f3-4b63-8d37-5fd6eaab33bb service placement] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:31:14.614382 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-fad29fcf-65f3-4b63-8d37-5fd6eaab33bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:31:14.687622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad29fcf-65f3-4b63-8d37-5fd6eaab33bb service placement] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:31:14.693956 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128eb88-bd20-4611-9571-884b68d7b5c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ba0ab9510d49c4ab4c634e82790efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:31:14.694631 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128eb88-bd20-4611-9571-884b68d7b5c0 service swift] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:14.694929 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128eb88-bd20-4611-9571-884b68d7b5c0 service swift] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:14.695208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128eb88-bd20-4611-9571-884b68d7b5c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:14.706053 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128eb88-bd20-4611-9571-884b68d7b5c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:31:14.707575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128eb88-bd20-4611-9571-884b68d7b5c0 service swift] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:31:14.719408 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1208/2435] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jun 2 19:31:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 19:31:24.464259 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=25 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:31:24.714280 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=32 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:31:37.594077 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb318eed-4bfb-4d01-96fd-4b59db30a60d None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:37.594612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb318eed-4bfb-4d01-96fd-4b59db30a60d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:37.595810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb318eed-4bfb-4d01-96fd-4b59db30a60d None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:37.596273 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1228/2436] 10.222.0.45 () {54 vars in 921 bytes} [Thu Jun 2 19:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:31:37.602433 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8202726-4336-4bd6-8e5f-58ffe42a41f3 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:37.602930 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8202726-4336-4bd6-8e5f-58ffe42a41f3 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:37.603125 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8202726-4336-4bd6-8e5f-58ffe42a41f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:37.621804 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-c8202726-4336-4bd6-8e5f-58ffe42a41f3 None None] MFA Rules not processed for user `575f61ef70314f86b5d9dad3ba1b3aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:31:37.623013 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c8202726-4336-4bd6-8e5f-58ffe42a41f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:31:37.627433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5fa8f-168d-4111-a8e4-26b0df5a5e81 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:37.627720 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5fa8f-168d-4111-a8e4-26b0df5a5e81 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:37.628017 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5fa8f-168d-4111-a8e4-26b0df5a5e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:37.647918 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-8dc5fa8f-168d-4111-a8e4-26b0df5a5e81 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:31:37.649176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-8dc5fa8f-168d-4111-a8e4-26b0df5a5e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:31:37.657421 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1229/2437] 10.222.0.48 () {58 vars in 1016 bytes} [Thu Jun 2 19:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:31:37.672254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5fa8f-168d-4111-a8e4-26b0df5a5e81 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:31:37.673922 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-8dc5fa8f-168d-4111-a8e4-26b0df5a5e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:31:37.706013 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1209/2438] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jun 2 19:31:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:31:37.718616 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8202726-4336-4bd6-8e5f-58ffe42a41f3 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:31:37.720124 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c8202726-4336-4bd6-8e5f-58ffe42a41f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:31:37.753748 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5fa8f-168d-4111-a8e4-26b0df5a5e81 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:31:37.763371 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645b71f-90ad-44c4-a498-112d8a76c80a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:31:37.764109 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645b71f-90ad-44c4-a498-112d8a76c80a service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:37.764395 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645b71f-90ad-44c4-a498-112d8a76c80a service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:37.764672 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645b71f-90ad-44c4-a498-112d8a76c80a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:37.774894 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645b71f-90ad-44c4-a498-112d8a76c80a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:31:37.776563 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645b71f-90ad-44c4-a498-112d8a76c80a service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:31:37.782562 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8202726-4336-4bd6-8e5f-58ffe42a41f3 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:31:37.786338 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f52fd-2c2d-450b-945c-1f61207381ee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '226743f4f93c44c5aef5919a7813bd3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:31:37.787001 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f52fd-2c2d-450b-945c-1f61207381ee service glance] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:37.787201 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1230/2439] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:31:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:31:37.787307 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f52fd-2c2d-450b-945c-1f61207381ee service glance] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:37.787547 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f52fd-2c2d-450b-945c-1f61207381ee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:37.803621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f52fd-2c2d-450b-945c-1f61207381ee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:31:37.805237 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f52fd-2c2d-450b-945c-1f61207381ee service glance] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:31:37.817132 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1210/2440] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:31:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:31:38.004992 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba927ab2-23cc-405b-8a2c-d74ad2f53e0a None None] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:38.005253 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba927ab2-23cc-405b-8a2c-d74ad2f53e0a None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:38.005539 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba927ab2-23cc-405b-8a2c-d74ad2f53e0a None None] PATH_INFO: `/` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:38.007139 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1231/2441] 10.222.0.45 () {54 vars in 921 bytes} [Thu Jun 2 19:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:31:38.015364 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f887f05-d996-49a5-9696-ff6e46b4666e None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:38.015640 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f887f05-d996-49a5-9696-ff6e46b4666e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:38.015979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f887f05-d996-49a5-9696-ff6e46b4666e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:38.034274 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-8f887f05-d996-49a5-9696-ff6e46b4666e None None] MFA Rules not processed for user `2efd679ca9314c8591cabbca15f8c61b`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:31:38.039619 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8f887f05-d996-49a5-9696-ff6e46b4666e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:31:38.042698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1211/2442] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jun 2 19:31:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:31:38.054562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba927ab2-23cc-405b-8a2c-d74ad2f53e0a None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:31:38.066605 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba927ab2-23cc-405b-8a2c-d74ad2f53e0a None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:31:38.070645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25aa5f5-bad4-434d-b5b0-d7343911ae5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:31:38.071321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25aa5f5-bad4-434d-b5b0-d7343911ae5b service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:38.071609 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25aa5f5-bad4-434d-b5b0-d7343911ae5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:38.071880 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25aa5f5-bad4-434d-b5b0-d7343911ae5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:38.079756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25aa5f5-bad4-434d-b5b0-d7343911ae5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:31:38.081250 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25aa5f5-bad4-434d-b5b0-d7343911ae5b service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:31:38.089960 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1232/2443] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:31:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:31:38.179399 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d70af5-a7ec-46be-9c33-08cc38fda218 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:38.179760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d70af5-a7ec-46be-9c33-08cc38fda218 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:38.180085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d70af5-a7ec-46be-9c33-08cc38fda218 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:38.181489 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1212/2444] 10.222.0.45 () {54 vars in 921 bytes} [Thu Jun 2 19:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:31:38.187795 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa8e80-430f-488a-8f77-6cb8a9da363c None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:38.188116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa8e80-430f-488a-8f77-6cb8a9da363c None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:38.188466 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa8e80-430f-488a-8f77-6cb8a9da363c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:38.207802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-38aa8e80-430f-488a-8f77-6cb8a9da363c None None] MFA Rules not processed for user `575f61ef70314f86b5d9dad3ba1b3aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:31:38.209043 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-38aa8e80-430f-488a-8f77-6cb8a9da363c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:31:38.218751 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1233/2445] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jun 2 19:31:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:31:38.230070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d70af5-a7ec-46be-9c33-08cc38fda218 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:31:38.241252 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d70af5-a7ec-46be-9c33-08cc38fda218 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:31:38.245731 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a72857-35ad-4dda-988e-3d05d21f9ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:31:38.246543 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a72857-35ad-4dda-988e-3d05d21f9ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:38.246829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a72857-35ad-4dda-988e-3d05d21f9ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:38.247234 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a72857-35ad-4dda-988e-3d05d21f9ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:38.258258 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a72857-35ad-4dda-988e-3d05d21f9ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:31:38.259701 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a72857-35ad-4dda-988e-3d05d21f9ab8 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:31:38.270881 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1213/2446] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:31:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:31:42.671290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ff2c0-1c5f-4b2a-a72a-7d0f8cc53e79 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:42.671803 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ff2c0-1c5f-4b2a-a72a-7d0f8cc53e79 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:42.671910 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ff2c0-1c5f-4b2a-a72a-7d0f8cc53e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:42.692467 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-aa6ff2c0-1c5f-4b2a-a72a-7d0f8cc53e79 None None] MFA Rules not processed for user `235042beafd246c5b227b3926098c8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:31:42.693839 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-aa6ff2c0-1c5f-4b2a-a72a-7d0f8cc53e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:31:42.701636 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1234/2447] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jun 2 19:31:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:31:42.715632 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a72857-35ad-4dda-988e-3d05d21f9ab8 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:31:42.732517 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a72857-35ad-4dda-988e-3d05d21f9ab8 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:31:42.737654 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a243303-3e51-4b13-a523-d8da76a71ffb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ba0ab9510d49c4ab4c634e82790efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:31:42.738444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a243303-3e51-4b13-a523-d8da76a71ffb service swift] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:42.738726 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a243303-3e51-4b13-a523-d8da76a71ffb service swift] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:42.739001 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a243303-3e51-4b13-a523-d8da76a71ffb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:42.748448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a243303-3e51-4b13-a523-d8da76a71ffb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:31:42.750088 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a243303-3e51-4b13-a523-d8da76a71ffb service swift] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:31:42.758815 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1214/2448] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jun 2 19:31:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 19:31:42.940233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d31d7-b75f-4550-8ec1-5ec9f0c55b06 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:42.940520 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d31d7-b75f-4550-8ec1-5ec9f0c55b06 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:42.941110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d31d7-b75f-4550-8ec1-5ec9f0c55b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:42.966679 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-3e1d31d7-b75f-4550-8ec1-5ec9f0c55b06 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:31:42.968173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-3e1d31d7-b75f-4550-8ec1-5ec9f0c55b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:31:42.976943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1235/2449] 10.222.0.48 () {58 vars in 1016 bytes} [Thu Jun 2 19:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:31:42.996204 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a243303-3e51-4b13-a523-d8da76a71ffb service swift] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:31:43.017730 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a243303-3e51-4b13-a523-d8da76a71ffb service swift] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:31:43.028949 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aebabb-a045-428b-857b-77ac44099785 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:31:43.029751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aebabb-a045-428b-857b-77ac44099785 service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:43.030233 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aebabb-a045-428b-857b-77ac44099785 service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:43.030630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aebabb-a045-428b-857b-77ac44099785 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:43.051732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aebabb-a045-428b-857b-77ac44099785 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:31:43.055594 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aebabb-a045-428b-857b-77ac44099785 service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:31:43.073359 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1215/2450] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:31:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:31:52.085948 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d31d7-b75f-4550-8ec1-5ec9f0c55b06 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:31:52.098456 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d31d7-b75f-4550-8ec1-5ec9f0c55b06 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:31:52.103497 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f85f02-f5b9-4984-afdb-04acf55a56ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:31:52.104333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f85f02-f5b9-4984-afdb-04acf55a56ad service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:52.104643 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f85f02-f5b9-4984-afdb-04acf55a56ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:52.105091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f85f02-f5b9-4984-afdb-04acf55a56ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:52.110308 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-37f85f02-f5b9-4984-afdb-04acf55a56ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:31:52.207748 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f85f02-f5b9-4984-afdb-04acf55a56ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:31:52.209476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f85f02-f5b9-4984-afdb-04acf55a56ad service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:31:52.221081 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1236/2451] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:31:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:31:53.065245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=78 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:02.214645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=80 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:03.932731 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e741a29-da88-412e-b09c-87aadf0c3f6f None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:03.933327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e741a29-da88-412e-b09c-87aadf0c3f6f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:03.933327 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e741a29-da88-412e-b09c-87aadf0c3f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:03.952441 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-9e741a29-da88-412e-b09c-87aadf0c3f6f None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:03.953624 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9e741a29-da88-412e-b09c-87aadf0c3f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:03.961337 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1216/2452] 10.222.0.48 () {58 vars in 1016 bytes} [Thu Jun 2 19:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:03.976565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f85f02-f5b9-4984-afdb-04acf55a56ad service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:03.989631 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f85f02-f5b9-4984-afdb-04acf55a56ad service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:03.995137 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c5d74-1281-4212-86c3-1d68a7885ad3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:03.995782 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c5d74-1281-4212-86c3-1d68a7885ad3 service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:03.996104 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c5d74-1281-4212-86c3-1d68a7885ad3 service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:03.996379 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c5d74-1281-4212-86c3-1d68a7885ad3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:04.004841 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c5d74-1281-4212-86c3-1d68a7885ad3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:04.006433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c5d74-1281-4212-86c3-1d68a7885ad3 service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:04.015981 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1237/2453] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:32:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:32:04.439304 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e741a29-da88-412e-b09c-87aadf0c3f6f None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:04.440851 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9e741a29-da88-412e-b09c-87aadf0c3f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:04.453981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e741a29-da88-412e-b09c-87aadf0c3f6f None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:04.457747 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8ab24-0a1c-4fb9-96b5-806a006e00cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:04.458545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8ab24-0a1c-4fb9-96b5-806a006e00cc service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:04.458545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8ab24-0a1c-4fb9-96b5-806a006e00cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:04.458545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8ab24-0a1c-4fb9-96b5-806a006e00cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:04.458545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-37b8ab24-0a1c-4fb9-96b5-806a006e00cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:04.474776 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8ab24-0a1c-4fb9-96b5-806a006e00cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:04.476284 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8ab24-0a1c-4fb9-96b5-806a006e00cc service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:04.486558 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1217/2454] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:32:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:32:06.703549 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96aac5c-a0e4-4f7f-a186-35650994d592 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:06.704438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96aac5c-a0e4-4f7f-a186-35650994d592 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:06.704774 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96aac5c-a0e4-4f7f-a186-35650994d592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:06.729279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-a96aac5c-a0e4-4f7f-a186-35650994d592 None None] MFA Rules not processed for user `235042beafd246c5b227b3926098c8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:06.730812 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-a96aac5c-a0e4-4f7f-a186-35650994d592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:06.738650 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1238/2455] 10.222.0.45 () {58 vars in 967 bytes} [Thu Jun 2 19:32:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:06.755085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8ab24-0a1c-4fb9-96b5-806a006e00cc service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:06.768003 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8ab24-0a1c-4fb9-96b5-806a006e00cc service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:06.773610 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2debc-9e74-4000-b727-2d2eba262bf2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ba0ab9510d49c4ab4c634e82790efb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:06.774336 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2debc-9e74-4000-b727-2d2eba262bf2 service swift] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:06.774687 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2debc-9e74-4000-b727-2d2eba262bf2 service swift] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:06.775030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2debc-9e74-4000-b727-2d2eba262bf2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:06.784709 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2debc-9e74-4000-b727-2d2eba262bf2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:06.786311 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2debc-9e74-4000-b727-2d2eba262bf2 service swift] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:06.797960 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1218/2456] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jun 2 19:32:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 19:32:09.942887 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3595e56-f3db-449c-8abd-361c0311fdf2 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:09.943318 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3595e56-f3db-449c-8abd-361c0311fdf2 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:09.943318 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3595e56-f3db-449c-8abd-361c0311fdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:09.968653 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-c3595e56-f3db-449c-8abd-361c0311fdf2 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:09.969931 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c3595e56-f3db-449c-8abd-361c0311fdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:09.983687 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1239/2457] 10.222.0.48 () {58 vars in 1016 bytes} [Thu Jun 2 19:32:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:32:10.005044 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2debc-9e74-4000-b727-2d2eba262bf2 service swift] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:10.017685 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2debc-9e74-4000-b727-2d2eba262bf2 service swift] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:10.024262 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a3aca-d508-47dc-8225-07911501a161 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:10.025782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a3aca-d508-47dc-8225-07911501a161 service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:10.026226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a3aca-d508-47dc-8225-07911501a161 service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:10.026672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a3aca-d508-47dc-8225-07911501a161 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:10.037411 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a3aca-d508-47dc-8225-07911501a161 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:10.039336 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a3aca-d508-47dc-8225-07911501a161 service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:10.051255 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1219/2458] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:32:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:32:13.203555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3595e56-f3db-449c-8abd-361c0311fdf2 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:13.205078 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c3595e56-f3db-449c-8abd-361c0311fdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:13.217792 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3595e56-f3db-449c-8abd-361c0311fdf2 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:13.222615 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e85e25-4d2d-4c28-b9ac-6fa46f562184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:13.223548 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e85e25-4d2d-4c28-b9ac-6fa46f562184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:13.223806 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e85e25-4d2d-4c28-b9ac-6fa46f562184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:13.224105 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e85e25-4d2d-4c28-b9ac-6fa46f562184 admin admin] PATH_INFO: `/v3/users/ccd665ac694340bfb99d8f5dbcb4f5f3` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:13.225361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e85e25-4d2d-4c28-b9ac-6fa46f562184 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccd665ac694340bfb99d8f5dbcb4f5f3)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:13.227396 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e85e25-4d2d-4c28-b9ac-6fa46f562184 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:13.411744 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-74e85e25-4d2d-4c28-b9ac-6fa46f562184 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccd665ac694340bfb99d8f5dbcb4f5f3'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:13.424999 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-74e85e25-4d2d-4c28-b9ac-6fa46f562184 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccd665ac694340bfb99d8f5dbcb4f5f3'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:13.432278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-74e85e25-4d2d-4c28-b9ac-6fa46f562184 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccd665ac694340bfb99d8f5dbcb4f5f3'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:13.433010 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-74e85e25-4d2d-4c28-b9ac-6fa46f562184 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccd665ac694340bfb99d8f5dbcb4f5f3'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:13.433675 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-74e85e25-4d2d-4c28-b9ac-6fa46f562184 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccd665ac694340bfb99d8f5dbcb4f5f3'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:13.499251 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1240/2459] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:32:13 2022] DELETE /identity/v3/users/ccd665ac694340bfb99d8f5dbcb4f5f3 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:32:13.746758 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a3aca-d508-47dc-8225-07911501a161 service nova] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:13.759040 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a3aca-d508-47dc-8225-07911501a161 service nova] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:13.823121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae515dc-81e5-47e5-9906-260f079d4a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:13.824071 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae515dc-81e5-47e5-9906-260f079d4a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:13.824872 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae515dc-81e5-47e5-9906-260f079d4a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:13.825148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae515dc-81e5-47e5-9906-260f079d4a75 admin admin] PATH_INFO: `/v3/projects/06f57bbb327f4ffea465315f546f24a8` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:13.826476 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae515dc-81e5-47e5-9906-260f079d4a75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06f57bbb327f4ffea465315f546f24a8)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:13.828440 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae515dc-81e5-47e5-9906-260f079d4a75 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:13.925732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-eae515dc-81e5-47e5-9906-260f079d4a75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06f57bbb327f4ffea465315f546f24a8', 'request_id': 'req-eae515dc-81e5-47e5-9906-260f079d4a75'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:13.932383 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-eae515dc-81e5-47e5-9906-260f079d4a75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06f57bbb327f4ffea465315f546f24a8', 'request_id': 'req-eae515dc-81e5-47e5-9906-260f079d4a75'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:13.997004 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-eae515dc-81e5-47e5-9906-260f079d4a75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06f57bbb327f4ffea465315f546f24a8', 'request_id': 'req-eae515dc-81e5-47e5-9906-260f079d4a75'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:14.007913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-eae515dc-81e5-47e5-9906-260f079d4a75 admin admin] The token cache is being invalidate because project 06f57bbb327f4ffea465315f546f24a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:32:14.008226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-eae515dc-81e5-47e5-9906-260f079d4a75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:14.008849 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-eae515dc-81e5-47e5-9906-260f079d4a75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:14.010408 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1220/2460] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:32:13 2022] DELETE /identity/v3/projects/06f57bbb327f4ffea465315f546f24a8 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:14.014404 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e85e25-4d2d-4c28-b9ac-6fa46f562184 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:14.015836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-74e85e25-4d2d-4c28-b9ac-6fa46f562184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:14.029175 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e85e25-4d2d-4c28-b9ac-6fa46f562184 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:14.100244 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a47f2-c6f3-4439-a30a-92ac79587579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:14.101336 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a47f2-c6f3-4439-a30a-92ac79587579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:14.101619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a47f2-c6f3-4439-a30a-92ac79587579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:14.101894 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a47f2-c6f3-4439-a30a-92ac79587579 admin admin] PATH_INFO: `/v3/users/f00e153b15824dada3c0ee4fb1556eab` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:14.103206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a47f2-c6f3-4439-a30a-92ac79587579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f00e153b15824dada3c0ee4fb1556eab)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:14.105904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a47f2-c6f3-4439-a30a-92ac79587579 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:14.193887 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174ecd6-eec9-454b-b181-93f98e1ebf12 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:14.194228 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174ecd6-eec9-454b-b181-93f98e1ebf12 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:14.194508 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174ecd6-eec9-454b-b181-93f98e1ebf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:14.212879 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-0174ecd6-eec9-454b-b181-93f98e1ebf12 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:14.213994 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0174ecd6-eec9-454b-b181-93f98e1ebf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:14.221919 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1221/2461] 10.222.0.48 () {58 vars in 1016 bytes} [Thu Jun 2 19:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:32:14.236702 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174ecd6-eec9-454b-b181-93f98e1ebf12 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:14.237999 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0174ecd6-eec9-454b-b181-93f98e1ebf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:14.269285 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-2e4a47f2-c6f3-4439-a30a-92ac79587579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f00e153b15824dada3c0ee4fb1556eab'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:14.270710 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:14.282712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:14.283824 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-2e4a47f2-c6f3-4439-a30a-92ac79587579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f00e153b15824dada3c0ee4fb1556eab'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:14.290821 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-2e4a47f2-c6f3-4439-a30a-92ac79587579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f00e153b15824dada3c0ee4fb1556eab'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:14.291707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-2e4a47f2-c6f3-4439-a30a-92ac79587579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f00e153b15824dada3c0ee4fb1556eab'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:14.292325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-2e4a47f2-c6f3-4439-a30a-92ac79587579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f00e153b15824dada3c0ee4fb1556eab'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:14.314407 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174ecd6-eec9-454b-b181-93f98e1ebf12 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:14.320264 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd43c2-c54c-4332-81b8-5b7abff84c3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:14.320924 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd43c2-c54c-4332-81b8-5b7abff84c3e service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:14.321203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd43c2-c54c-4332-81b8-5b7abff84c3e service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:14.321479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd43c2-c54c-4332-81b8-5b7abff84c3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:14.323317 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6cfd43c2-c54c-4332-81b8-5b7abff84c3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:14.334924 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd43c2-c54c-4332-81b8-5b7abff84c3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:14.336682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd43c2-c54c-4332-81b8-5b7abff84c3e service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:14.349948 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1222/2462] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:32:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:32:14.362226 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1241/2463] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:32:14 2022] DELETE /identity/v3/users/f00e153b15824dada3c0ee4fb1556eab => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:14.626726 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd43c2-c54c-4332-81b8-5b7abff84c3e service nova] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:14.628183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6cfd43c2-c54c-4332-81b8-5b7abff84c3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:14.640280 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd43c2-c54c-4332-81b8-5b7abff84c3e service nova] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:14.707138 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82100178-01b6-417f-81ae-17f3bbc2e492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:14.708016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82100178-01b6-417f-81ae-17f3bbc2e492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:14.708317 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82100178-01b6-417f-81ae-17f3bbc2e492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:14.708589 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82100178-01b6-417f-81ae-17f3bbc2e492 admin admin] PATH_INFO: `/v3/projects/1129d6675ec943bb89c8d64d98629146` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:14.709847 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82100178-01b6-417f-81ae-17f3bbc2e492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1129d6675ec943bb89c8d64d98629146)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:14.711832 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82100178-01b6-417f-81ae-17f3bbc2e492 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:14.804065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-82100178-01b6-417f-81ae-17f3bbc2e492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1129d6675ec943bb89c8d64d98629146', 'request_id': 'req-82100178-01b6-417f-81ae-17f3bbc2e492'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:14.810298 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-82100178-01b6-417f-81ae-17f3bbc2e492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1129d6675ec943bb89c8d64d98629146', 'request_id': 'req-82100178-01b6-417f-81ae-17f3bbc2e492'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:14.864264 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-82100178-01b6-417f-81ae-17f3bbc2e492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1129d6675ec943bb89c8d64d98629146', 'request_id': 'req-82100178-01b6-417f-81ae-17f3bbc2e492'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:14.875402 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-82100178-01b6-417f-81ae-17f3bbc2e492 admin admin] The token cache is being invalidate because project 1129d6675ec943bb89c8d64d98629146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:32:14.875682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-82100178-01b6-417f-81ae-17f3bbc2e492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:14.876310 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-82100178-01b6-417f-81ae-17f3bbc2e492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:14.877859 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1223/2464] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:32:14 2022] DELETE /identity/v3/projects/1129d6675ec943bb89c8d64d98629146 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:15.489309 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a47f2-c6f3-4439-a30a-92ac79587579 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:15.490799 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-2e4a47f2-c6f3-4439-a30a-92ac79587579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:15.550160 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a47f2-c6f3-4439-a30a-92ac79587579 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:15.597569 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f441b3e-c94f-4414-9b71-27c33a9a313a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:15.598221 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f441b3e-c94f-4414-9b71-27c33a9a313a service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:15.598506 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f441b3e-c94f-4414-9b71-27c33a9a313a service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:15.598785 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f441b3e-c94f-4414-9b71-27c33a9a313a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:15.600638 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-4f441b3e-c94f-4414-9b71-27c33a9a313a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:15.665649 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f441b3e-c94f-4414-9b71-27c33a9a313a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:15.667094 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f441b3e-c94f-4414-9b71-27c33a9a313a service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:15.677341 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1242/2465] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:32:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:32:18.442201 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aec6d7-1a41-482d-8c30-d6955ea97321 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:18.442702 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aec6d7-1a41-482d-8c30-d6955ea97321 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:18.442817 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aec6d7-1a41-482d-8c30-d6955ea97321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:18.470348 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-50aec6d7-1a41-482d-8c30-d6955ea97321 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:18.471884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-50aec6d7-1a41-482d-8c30-d6955ea97321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:18.482579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1224/2466] 10.222.0.48 () {58 vars in 1016 bytes} [Thu Jun 2 19:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:18.503592 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f441b3e-c94f-4414-9b71-27c33a9a313a service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:18.505134 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-4f441b3e-c94f-4414-9b71-27c33a9a313a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:18.539914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:18.581620 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f441b3e-c94f-4414-9b71-27c33a9a313a service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:18.587174 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fd479-7ae7-401f-8887-c7f664bee17e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:18.587831 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fd479-7ae7-401f-8887-c7f664bee17e service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:18.588149 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fd479-7ae7-401f-8887-c7f664bee17e service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:18.588427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fd479-7ae7-401f-8887-c7f664bee17e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:18.598967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fd479-7ae7-401f-8887-c7f664bee17e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:18.600733 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fd479-7ae7-401f-8887-c7f664bee17e service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:18.611307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1243/2467] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:32:19.288294 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aec6d7-1a41-482d-8c30-d6955ea97321 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:19.289751 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-50aec6d7-1a41-482d-8c30-d6955ea97321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:19.303673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aec6d7-1a41-482d-8c30-d6955ea97321 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:19.307074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e743b-10f1-477e-8591-1647f55fbefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:19.307950 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e743b-10f1-477e-8591-1647f55fbefc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:19.308254 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e743b-10f1-477e-8591-1647f55fbefc admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:19.308524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e743b-10f1-477e-8591-1647f55fbefc admin admin] PATH_INFO: `/v3/users/35658a179ed84e2d949312d9bde201a4` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:19.309740 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e743b-10f1-477e-8591-1647f55fbefc admin admin] RBAC: Authorizing `identity:delete_user(user_id=35658a179ed84e2d949312d9bde201a4)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:19.311773 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e743b-10f1-477e-8591-1647f55fbefc admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:19.433401 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:19.438195 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-004e743b-10f1-477e-8591-1647f55fbefc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35658a179ed84e2d949312d9bde201a4'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:19.445989 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-004e743b-10f1-477e-8591-1647f55fbefc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35658a179ed84e2d949312d9bde201a4'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:19.446745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-004e743b-10f1-477e-8591-1647f55fbefc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35658a179ed84e2d949312d9bde201a4'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:19.447353 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-004e743b-10f1-477e-8591-1647f55fbefc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35658a179ed84e2d949312d9bde201a4'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:19.459859 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-004e743b-10f1-477e-8591-1647f55fbefc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35658a179ed84e2d949312d9bde201a4'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:19.550243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1225/2468] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:32:19 2022] DELETE /identity/v3/users/35658a179ed84e2d949312d9bde201a4 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:19.774706 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fd479-7ae7-401f-8887-c7f664bee17e service nova] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:19.786066 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fd479-7ae7-401f-8887-c7f664bee17e service nova] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:19.851718 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ca3f6-cf6e-4454-8d73-4605eaabf95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:19.852639 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ca3f6-cf6e-4454-8d73-4605eaabf95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:19.852923 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ca3f6-cf6e-4454-8d73-4605eaabf95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:19.853201 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ca3f6-cf6e-4454-8d73-4605eaabf95f admin admin] PATH_INFO: `/v3/projects/40c7570a0cda4db98d33e30c6b2ea476` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:19.854400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ca3f6-cf6e-4454-8d73-4605eaabf95f admin admin] RBAC: Authorizing `identity:delete_project(project_id=40c7570a0cda4db98d33e30c6b2ea476)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:19.856402 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ca3f6-cf6e-4454-8d73-4605eaabf95f admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:19.968934 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-b48ca3f6-cf6e-4454-8d73-4605eaabf95f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40c7570a0cda4db98d33e30c6b2ea476', 'request_id': 'req-b48ca3f6-cf6e-4454-8d73-4605eaabf95f'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:20.024735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-b48ca3f6-cf6e-4454-8d73-4605eaabf95f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40c7570a0cda4db98d33e30c6b2ea476', 'request_id': 'req-b48ca3f6-cf6e-4454-8d73-4605eaabf95f'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:20.031083 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-b48ca3f6-cf6e-4454-8d73-4605eaabf95f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40c7570a0cda4db98d33e30c6b2ea476', 'request_id': 'req-b48ca3f6-cf6e-4454-8d73-4605eaabf95f'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:20.042363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-b48ca3f6-cf6e-4454-8d73-4605eaabf95f admin admin] The token cache is being invalidate because project 40c7570a0cda4db98d33e30c6b2ea476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:32:20.042650 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-b48ca3f6-cf6e-4454-8d73-4605eaabf95f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:20.043814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-b48ca3f6-cf6e-4454-8d73-4605eaabf95f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:20.045407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1244/2469] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:32:19 2022] DELETE /identity/v3/projects/40c7570a0cda4db98d33e30c6b2ea476 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:20.050414 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7021d-f9dc-4787-b625-a0b2c0537a8c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:20.050709 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7021d-f9dc-4787-b625-a0b2c0537a8c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:20.050993 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7021d-f9dc-4787-b625-a0b2c0537a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:20.070314 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-b2e7021d-f9dc-4787-b625-a0b2c0537a8c None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:20.071530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b2e7021d-f9dc-4787-b625-a0b2c0537a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:20.130337 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1226/2470] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:32:20.138933 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf837695-1bcc-4818-af2c-f4123b4f0512 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:20.139223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf837695-1bcc-4818-af2c-f4123b4f0512 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:20.139500 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf837695-1bcc-4818-af2c-f4123b4f0512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:20.157911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-cf837695-1bcc-4818-af2c-f4123b4f0512 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:20.159137 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-cf837695-1bcc-4818-af2c-f4123b4f0512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:20.167306 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1245/2471] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:20.172231 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7021d-f9dc-4787-b625-a0b2c0537a8c None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:20.182555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7021d-f9dc-4787-b625-a0b2c0537a8c None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:20.188190 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd9af6-8a5d-4166-a555-f1923cc8055b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:20.188767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd9af6-8a5d-4166-a555-f1923cc8055b admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:20.189047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd9af6-8a5d-4166-a555-f1923cc8055b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:20.189317 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd9af6-8a5d-4166-a555-f1923cc8055b admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:20.190051 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd9af6-8a5d-4166-a555-f1923cc8055b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:32:20.190356 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd9af6-8a5d-4166-a555-f1923cc8055b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:20.192265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd9af6-8a5d-4166-a555-f1923cc8055b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:20.204714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1227/2472] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:32:20.209149 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf837695-1bcc-4818-af2c-f4123b4f0512 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:20.223478 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf837695-1bcc-4818-af2c-f4123b4f0512 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:20.225856 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c1f00-9df9-4613-a2df-4ed099f521df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:20.226538 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c1f00-9df9-4613-a2df-4ed099f521df admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:20.226824 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c1f00-9df9-4613-a2df-4ed099f521df admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:20.227133 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c1f00-9df9-4613-a2df-4ed099f521df admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:20.227900 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c1f00-9df9-4613-a2df-4ed099f521df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:20.229960 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c1f00-9df9-4613-a2df-4ed099f521df admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:20.341563 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1246/2473] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:32:20 2022] POST /identity/v3/projects => generated 367 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:32:20.345816 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd9af6-8a5d-4166-a555-f1923cc8055b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:20.356720 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd9af6-8a5d-4166-a555-f1923cc8055b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:20.416992 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f6ca6-127b-404b-8c52-fca45773a4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:20.417679 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f6ca6-127b-404b-8c52-fca45773a4a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:20.417964 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f6ca6-127b-404b-8c52-fca45773a4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:20.418823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f6ca6-127b-404b-8c52-fca45773a4a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:20.419536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f6ca6-127b-404b-8c52-fca45773a4a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:20.421489 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f6ca6-127b-404b-8c52-fca45773a4a2 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:20.508009 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1228/2474] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:32:20 2022] POST /identity/v3/users => generated 284 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:32:20.509383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c1f00-9df9-4613-a2df-4ed099f521df admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:20.519877 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c1f00-9df9-4613-a2df-4ed099f521df admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:20.524609 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114102a-80d2-46d7-aa45-5fb615703752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:20.525259 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114102a-80d2-46d7-aa45-5fb615703752 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:20.525540 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114102a-80d2-46d7-aa45-5fb615703752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:20.525815 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114102a-80d2-46d7-aa45-5fb615703752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:20.526597 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114102a-80d2-46d7-aa45-5fb615703752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:20.528766 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114102a-80d2-46d7-aa45-5fb615703752 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:20.540510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1247/2475] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:32:20.545344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f6ca6-127b-404b-8c52-fca45773a4a2 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:20.555383 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f6ca6-127b-404b-8c52-fca45773a4a2 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:20.560253 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da015236-c05d-48fe-8dcf-db5a059d26c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:20.560895 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da015236-c05d-48fe-8dcf-db5a059d26c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:20.561174 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da015236-c05d-48fe-8dcf-db5a059d26c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:20.561440 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da015236-c05d-48fe-8dcf-db5a059d26c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:20.562151 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da015236-c05d-48fe-8dcf-db5a059d26c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:20.563742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da015236-c05d-48fe-8dcf-db5a059d26c1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:20.573746 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1229/2476] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:32:20.577782 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114102a-80d2-46d7-aa45-5fb615703752 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:20.587431 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114102a-80d2-46d7-aa45-5fb615703752 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:20.592517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d0aa2-9f5d-4ac3-9fc0-56c56d45b8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:20.593377 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d0aa2-9f5d-4ac3-9fc0-56c56d45b8f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:20.593654 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d0aa2-9f5d-4ac3-9fc0-56c56d45b8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:20.593924 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d0aa2-9f5d-4ac3-9fc0-56c56d45b8f9 admin admin] PATH_INFO: `/v3/projects/3b860fe781104459926f46028b92a9f7/users/2fe8ce15c7b54968888357327d1a9f63/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:20.596132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:20.609271 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d0aa2-9f5d-4ac3-9fc0-56c56d45b8f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b860fe781104459926f46028b92a9f7, user_id=2fe8ce15c7b54968888357327d1a9f63, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:20.611933 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d0aa2-9f5d-4ac3-9fc0-56c56d45b8f9 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:20.911019 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1248/2477] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:32:20 2022] PUT /identity/v3/projects/3b860fe781104459926f46028b92a9f7/users/2fe8ce15c7b54968888357327d1a9f63/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:20.921980 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7067f-acaa-4b6a-bf62-496d0aaead34 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:20.922324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7067f-acaa-4b6a-bf62-496d0aaead34 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:20.922603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7067f-acaa-4b6a-bf62-496d0aaead34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:20.951318 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-7df7067f-acaa-4b6a-bf62-496d0aaead34 None None] MFA Rules not processed for user `2fe8ce15c7b54968888357327d1a9f63`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:20.952984 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7df7067f-acaa-4b6a-bf62-496d0aaead34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:20.966807 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:21.022718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1230/2478] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:21.028755 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d0aa2-9f5d-4ac3-9fc0-56c56d45b8f9 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:21.094013 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d0aa2-9f5d-4ac3-9fc0-56c56d45b8f9 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:21.098676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b3373-17dc-4c68-a29c-bb32855168ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:21.099342 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b3373-17dc-4c68-a29c-bb32855168ce admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:21.099620 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b3373-17dc-4c68-a29c-bb32855168ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:21.099896 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b3373-17dc-4c68-a29c-bb32855168ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:21.100682 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b3373-17dc-4c68-a29c-bb32855168ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:21.102827 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b3373-17dc-4c68-a29c-bb32855168ce admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:21.192524 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1249/2479] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:32:21 2022] POST /identity/v3/projects => generated 367 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:32:21.196737 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7067f-acaa-4b6a-bf62-496d0aaead34 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:21.208756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7067f-acaa-4b6a-bf62-496d0aaead34 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:21.270266 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0c216-43b2-4c97-848f-1dbf631d149d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:21.270960 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0c216-43b2-4c97-848f-1dbf631d149d admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:21.271240 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0c216-43b2-4c97-848f-1dbf631d149d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:21.271518 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0c216-43b2-4c97-848f-1dbf631d149d admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:21.272247 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f0c216-43b2-4c97-848f-1dbf631d149d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:21.274230 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f0c216-43b2-4c97-848f-1dbf631d149d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:21.379963 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1231/2480] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:32:21 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:32:21.383876 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b3373-17dc-4c68-a29c-bb32855168ce admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:21.394903 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b3373-17dc-4c68-a29c-bb32855168ce admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:21.399411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e0ed7-b4f5-4c1b-9cdb-c3c9c52471f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:21.400146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e0ed7-b4f5-4c1b-9cdb-c3c9c52471f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:21.400429 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e0ed7-b4f5-4c1b-9cdb-c3c9c52471f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:21.400702 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e0ed7-b4f5-4c1b-9cdb-c3c9c52471f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:21.401416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e0ed7-b4f5-4c1b-9cdb-c3c9c52471f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:21.403574 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e0ed7-b4f5-4c1b-9cdb-c3c9c52471f0 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:21.414043 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1250/2481] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:32:21.418310 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0c216-43b2-4c97-848f-1dbf631d149d admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:21.428169 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0c216-43b2-4c97-848f-1dbf631d149d admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:21.432714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f7c88-9f1d-4efc-81a3-681bab8272dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:21.433583 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f7c88-9f1d-4efc-81a3-681bab8272dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:21.433905 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f7c88-9f1d-4efc-81a3-681bab8272dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:21.434176 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f7c88-9f1d-4efc-81a3-681bab8272dc admin admin] PATH_INFO: `/v3/projects/34f74b85b92c423a8adc243ffbf53d62/users/d73feaa3e67445cea017e73b760eda79/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:21.449805 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f7c88-9f1d-4efc-81a3-681bab8272dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=34f74b85b92c423a8adc243ffbf53d62, user_id=d73feaa3e67445cea017e73b760eda79, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:21.452695 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f7c88-9f1d-4efc-81a3-681bab8272dc admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:21.551255 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1232/2482] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:32:21 2022] PUT /identity/v3/projects/34f74b85b92c423a8adc243ffbf53d62/users/d73feaa3e67445cea017e73b760eda79/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:21.555275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e0ed7-b4f5-4c1b-9cdb-c3c9c52471f0 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:21.565281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e0ed7-b4f5-4c1b-9cdb-c3c9c52471f0 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:21.621761 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba5d31-451b-4b4c-802d-80168be97f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:21.622434 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba5d31-451b-4b4c-802d-80168be97f68 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:21.622736 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba5d31-451b-4b4c-802d-80168be97f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:21.623018 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba5d31-451b-4b4c-802d-80168be97f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:21.623746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba5d31-451b-4b4c-802d-80168be97f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:21.625402 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba5d31-451b-4b4c-802d-80168be97f68 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:21.635543 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1251/2483] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:32:21.640271 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f7c88-9f1d-4efc-81a3-681bab8272dc admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:21.650561 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f7c88-9f1d-4efc-81a3-681bab8272dc admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:21.656083 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b48b3e-fd2d-48fb-bad1-33e546206e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:21.657031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b48b3e-fd2d-48fb-bad1-33e546206e35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:21.657315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b48b3e-fd2d-48fb-bad1-33e546206e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:21.657590 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b48b3e-fd2d-48fb-bad1-33e546206e35 admin admin] PATH_INFO: `/v3/projects/34f74b85b92c423a8adc243ffbf53d62/users/d73feaa3e67445cea017e73b760eda79/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:21.659605 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b48b3e-fd2d-48fb-bad1-33e546206e35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34f74b85b92c423a8adc243ffbf53d62, user_id=d73feaa3e67445cea017e73b760eda79, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:21.662286 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b48b3e-fd2d-48fb-bad1-33e546206e35 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:21.672563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1233/2484] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:32:21 2022] PUT /identity/v3/projects/34f74b85b92c423a8adc243ffbf53d62/users/d73feaa3e67445cea017e73b760eda79/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:21.683080 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85394d-83a8-485b-9d1c-2547b2cd48d9 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:21.683382 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85394d-83a8-485b-9d1c-2547b2cd48d9 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:21.683706 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85394d-83a8-485b-9d1c-2547b2cd48d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:21.710955 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-7d85394d-83a8-485b-9d1c-2547b2cd48d9 None None] MFA Rules not processed for user `d73feaa3e67445cea017e73b760eda79`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:21.712296 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-7d85394d-83a8-485b-9d1c-2547b2cd48d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:21.755478 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:21.783202 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1252/2485] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:21 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:21.794125 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b48b3e-fd2d-48fb-bad1-33e546206e35 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:21.795876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-11b48b3e-fd2d-48fb-bad1-33e546206e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:21.856263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b48b3e-fd2d-48fb-bad1-33e546206e35 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:21.860006 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0dd50-a874-4305-8585-00d76e03b238 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:21.860666 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0dd50-a874-4305-8585-00d76e03b238 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:21.860949 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0dd50-a874-4305-8585-00d76e03b238 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:21.861228 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0dd50-a874-4305-8585-00d76e03b238 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:21.871047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0dd50-a874-4305-8585-00d76e03b238 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:21.876084 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0dd50-a874-4305-8585-00d76e03b238 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:21.882673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1234/2486] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:32:21 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:32:24.480717 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85394d-83a8-485b-9d1c-2547b2cd48d9 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:24.547942 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85394d-83a8-485b-9d1c-2547b2cd48d9 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:24.553021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc24024-12e2-4c01-8d75-1f686c9cfd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:24.553899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc24024-12e2-4c01-8d75-1f686c9cfd02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:24.554175 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc24024-12e2-4c01-8d75-1f686c9cfd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:24.554447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc24024-12e2-4c01-8d75-1f686c9cfd02 admin admin] PATH_INFO: `/v3/users/2fe8ce15c7b54968888357327d1a9f63` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:24.555675 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc24024-12e2-4c01-8d75-1f686c9cfd02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fe8ce15c7b54968888357327d1a9f63)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:24.557741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc24024-12e2-4c01-8d75-1f686c9cfd02 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:24.758582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cfc24024-12e2-4c01-8d75-1f686c9cfd02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fe8ce15c7b54968888357327d1a9f63'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:24.770355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cfc24024-12e2-4c01-8d75-1f686c9cfd02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fe8ce15c7b54968888357327d1a9f63'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:24.778428 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cfc24024-12e2-4c01-8d75-1f686c9cfd02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fe8ce15c7b54968888357327d1a9f63'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:24.779329 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cfc24024-12e2-4c01-8d75-1f686c9cfd02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fe8ce15c7b54968888357327d1a9f63'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:24.779837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cfc24024-12e2-4c01-8d75-1f686c9cfd02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fe8ce15c7b54968888357327d1a9f63'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:24.870076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1253/2487] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:32:24 2022] DELETE /identity/v3/users/2fe8ce15c7b54968888357327d1a9f63 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:24.874812 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208678b0-b33e-4673-8e9b-57039eb212d2 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:24.875302 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208678b0-b33e-4673-8e9b-57039eb212d2 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:24.875426 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208678b0-b33e-4673-8e9b-57039eb212d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:24.892978 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-208678b0-b33e-4673-8e9b-57039eb212d2 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:24.894175 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-208678b0-b33e-4673-8e9b-57039eb212d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:24.898078 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:24.953122 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1235/2488] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:24.962610 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc24024-12e2-4c01-8d75-1f686c9cfd02 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:24.964032 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-cfc24024-12e2-4c01-8d75-1f686c9cfd02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:25.024196 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc24024-12e2-4c01-8d75-1f686c9cfd02 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:25.027835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eba548-1eb2-4eba-9a63-7eb99c496a38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:25.029032 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eba548-1eb2-4eba-9a63-7eb99c496a38 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:25.029310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eba548-1eb2-4eba-9a63-7eb99c496a38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:25.029582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eba548-1eb2-4eba-9a63-7eb99c496a38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:25.038823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eba548-1eb2-4eba-9a63-7eb99c496a38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:25.040285 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eba548-1eb2-4eba-9a63-7eb99c496a38 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:25.045760 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:25.050470 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1254/2489] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:32:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:32:25.461392 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208678b0-b33e-4673-8e9b-57039eb212d2 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:25.463126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-208678b0-b33e-4673-8e9b-57039eb212d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:25.485696 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208678b0-b33e-4673-8e9b-57039eb212d2 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:25.490536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b81a2-a8fc-4ba9-b98c-1f0ace6faac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:25.491382 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b81a2-a8fc-4ba9-b98c-1f0ace6faac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:25.491657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b81a2-a8fc-4ba9-b98c-1f0ace6faac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:25.491928 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b81a2-a8fc-4ba9-b98c-1f0ace6faac2 admin admin] PATH_INFO: `/v3/projects/3b860fe781104459926f46028b92a9f7` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:25.493243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b81a2-a8fc-4ba9-b98c-1f0ace6faac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b860fe781104459926f46028b92a9f7)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:25.495173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b81a2-a8fc-4ba9-b98c-1f0ace6faac2 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:25.610776 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e93b81a2-a8fc-4ba9-b98c-1f0ace6faac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b860fe781104459926f46028b92a9f7', 'request_id': 'req-e93b81a2-a8fc-4ba9-b98c-1f0ace6faac2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:25.617215 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e93b81a2-a8fc-4ba9-b98c-1f0ace6faac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b860fe781104459926f46028b92a9f7', 'request_id': 'req-e93b81a2-a8fc-4ba9-b98c-1f0ace6faac2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:25.681671 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e93b81a2-a8fc-4ba9-b98c-1f0ace6faac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b860fe781104459926f46028b92a9f7', 'request_id': 'req-e93b81a2-a8fc-4ba9-b98c-1f0ace6faac2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:25.693598 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e93b81a2-a8fc-4ba9-b98c-1f0ace6faac2 admin admin] The token cache is being invalidate because project 3b860fe781104459926f46028b92a9f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:32:25.693885 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e93b81a2-a8fc-4ba9-b98c-1f0ace6faac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:25.694510 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e93b81a2-a8fc-4ba9-b98c-1f0ace6faac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:25.696155 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1236/2490] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:32:25 2022] DELETE /identity/v3/projects/3b860fe781104459926f46028b92a9f7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:25.701124 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eba548-1eb2-4eba-9a63-7eb99c496a38 service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:25.711096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eba548-1eb2-4eba-9a63-7eb99c496a38 service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:25.768896 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653e299-43ed-492a-b359-0a255ec27629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:25.769764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653e299-43ed-492a-b359-0a255ec27629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:25.770040 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653e299-43ed-492a-b359-0a255ec27629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:25.770307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653e299-43ed-492a-b359-0a255ec27629 admin admin] PATH_INFO: `/v3/users/d73feaa3e67445cea017e73b760eda79` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:25.771483 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653e299-43ed-492a-b359-0a255ec27629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d73feaa3e67445cea017e73b760eda79)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:25.773437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653e299-43ed-492a-b359-0a255ec27629 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:25.918086 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-8653e299-43ed-492a-b359-0a255ec27629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd73feaa3e67445cea017e73b760eda79'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:25.930537 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-8653e299-43ed-492a-b359-0a255ec27629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd73feaa3e67445cea017e73b760eda79'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:25.938486 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-8653e299-43ed-492a-b359-0a255ec27629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd73feaa3e67445cea017e73b760eda79'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:25.939200 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-8653e299-43ed-492a-b359-0a255ec27629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd73feaa3e67445cea017e73b760eda79'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:25.939807 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-8653e299-43ed-492a-b359-0a255ec27629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd73feaa3e67445cea017e73b760eda79'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:25.995794 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1255/2491] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:32:25 2022] DELETE /identity/v3/users/d73feaa3e67445cea017e73b760eda79 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:26.392370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b81a2-a8fc-4ba9-b98c-1f0ace6faac2 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:26.393572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e93b81a2-a8fc-4ba9-b98c-1f0ace6faac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:26.408576 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b81a2-a8fc-4ba9-b98c-1f0ace6faac2 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:26.466188 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59441c4b-712d-481e-827e-859aeb1e13c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:26.467009 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59441c4b-712d-481e-827e-859aeb1e13c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:26.467338 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59441c4b-712d-481e-827e-859aeb1e13c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:26.467613 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59441c4b-712d-481e-827e-859aeb1e13c3 admin admin] PATH_INFO: `/v3/projects/34f74b85b92c423a8adc243ffbf53d62` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:26.468940 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59441c4b-712d-481e-827e-859aeb1e13c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34f74b85b92c423a8adc243ffbf53d62)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:26.470845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59441c4b-712d-481e-827e-859aeb1e13c3 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:26.593420 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:26.602955 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-59441c4b-712d-481e-827e-859aeb1e13c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34f74b85b92c423a8adc243ffbf53d62', 'request_id': 'req-59441c4b-712d-481e-827e-859aeb1e13c3'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:26.610078 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-59441c4b-712d-481e-827e-859aeb1e13c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34f74b85b92c423a8adc243ffbf53d62', 'request_id': 'req-59441c4b-712d-481e-827e-859aeb1e13c3'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:26.699267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-59441c4b-712d-481e-827e-859aeb1e13c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34f74b85b92c423a8adc243ffbf53d62', 'request_id': 'req-59441c4b-712d-481e-827e-859aeb1e13c3'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:26.710690 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-59441c4b-712d-481e-827e-859aeb1e13c3 admin admin] The token cache is being invalidate because project 34f74b85b92c423a8adc243ffbf53d62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:32:26.711435 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-59441c4b-712d-481e-827e-859aeb1e13c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:26.711767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-59441c4b-712d-481e-827e-859aeb1e13c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:26.713720 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1237/2492] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:32:26 2022] DELETE /identity/v3/projects/34f74b85b92c423a8adc243ffbf53d62 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:26.721441 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb1439-b8fb-4d25-af19-e547d8928865 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:26.721441 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb1439-b8fb-4d25-af19-e547d8928865 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:26.721441 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb1439-b8fb-4d25-af19-e547d8928865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:26.740805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-79cb1439-b8fb-4d25-af19-e547d8928865 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:26.742106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-79cb1439-b8fb-4d25-af19-e547d8928865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:26.806241 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1256/2493] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:26.814064 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcaf12-d9c5-476a-a232-d9bb1d687d7e None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:26.814436 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcaf12-d9c5-476a-a232-d9bb1d687d7e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:26.814722 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcaf12-d9c5-476a-a232-d9bb1d687d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:26.833855 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-b8dcaf12-d9c5-476a-a232-d9bb1d687d7e None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:26.835052 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b8dcaf12-d9c5-476a-a232-d9bb1d687d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:26.843531 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1238/2494] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:26.847653 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb1439-b8fb-4d25-af19-e547d8928865 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:26.857279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb1439-b8fb-4d25-af19-e547d8928865 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:26.861935 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a6aaa-6fbf-4f50-a8df-e88dbef799b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:26.862580 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a6aaa-6fbf-4f50-a8df-e88dbef799b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:26.862859 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a6aaa-6fbf-4f50-a8df-e88dbef799b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:26.863132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a6aaa-6fbf-4f50-a8df-e88dbef799b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:26.863845 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a6aaa-6fbf-4f50-a8df-e88dbef799b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:32:26.864170 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a6aaa-6fbf-4f50-a8df-e88dbef799b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:26.865758 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a6aaa-6fbf-4f50-a8df-e88dbef799b0 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:26.877068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1257/2495] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:32:26.881427 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dcaf12-d9c5-476a-a232-d9bb1d687d7e None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:26.891570 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dcaf12-d9c5-476a-a232-d9bb1d687d7e None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:26.896294 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afcdd64-c8b6-4899-9ba9-8e896535e582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:26.896953 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcdd64-c8b6-4899-9ba9-8e896535e582 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:26.897236 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcdd64-c8b6-4899-9ba9-8e896535e582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:26.897511 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcdd64-c8b6-4899-9ba9-8e896535e582 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:26.898213 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afcdd64-c8b6-4899-9ba9-8e896535e582 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:26.900147 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afcdd64-c8b6-4899-9ba9-8e896535e582 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:26.963122 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1239/2496] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:32:26 2022] POST /identity/v3/projects => generated 385 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:32:26.967919 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a6aaa-6fbf-4f50-a8df-e88dbef799b0 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:26.978913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a6aaa-6fbf-4f50-a8df-e88dbef799b0 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:26.982799 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:27.038304 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfa547-4074-4116-848b-b97642c00d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:27.038972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfa547-4074-4116-848b-b97642c00d3b admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:27.039251 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfa547-4074-4116-848b-b97642c00d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:27.039524 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfa547-4074-4116-848b-b97642c00d3b admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:27.040257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfa547-4074-4116-848b-b97642c00d3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:27.042300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfa547-4074-4116-848b-b97642c00d3b admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:27.128634 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1258/2497] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:32:26 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:32:27.133044 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afcdd64-c8b6-4899-9ba9-8e896535e582 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:27.144012 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afcdd64-c8b6-4899-9ba9-8e896535e582 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:27.148660 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823cd0a-1e78-4514-8a76-82e7dffbde60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:27.149323 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823cd0a-1e78-4514-8a76-82e7dffbde60 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:27.149612 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823cd0a-1e78-4514-8a76-82e7dffbde60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:27.149886 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823cd0a-1e78-4514-8a76-82e7dffbde60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:27.150612 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823cd0a-1e78-4514-8a76-82e7dffbde60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:27.152273 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823cd0a-1e78-4514-8a76-82e7dffbde60 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:27.162712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1240/2498] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:32:27.166871 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfa547-4074-4116-848b-b97642c00d3b admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:27.177348 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfa547-4074-4116-848b-b97642c00d3b admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:27.182151 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fa8cf-9848-41b5-894c-3a35f7455232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:27.182856 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fa8cf-9848-41b5-894c-3a35f7455232 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:27.183143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fa8cf-9848-41b5-894c-3a35f7455232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:27.183424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fa8cf-9848-41b5-894c-3a35f7455232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:27.184192 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996fa8cf-9848-41b5-894c-3a35f7455232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:27.186363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996fa8cf-9848-41b5-894c-3a35f7455232 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:27.197197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1259/2499] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:32:27.202058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823cd0a-1e78-4514-8a76-82e7dffbde60 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:27.212746 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823cd0a-1e78-4514-8a76-82e7dffbde60 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:27.217399 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d4f64-7d51-4f46-a983-9a4ff2a99e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:27.218280 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d4f64-7d51-4f46-a983-9a4ff2a99e0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:27.218557 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d4f64-7d51-4f46-a983-9a4ff2a99e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:27.218831 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d4f64-7d51-4f46-a983-9a4ff2a99e0c admin admin] PATH_INFO: `/v3/projects/949aed50973244398c82cdd615e483a1/users/1ff983038a5a4478a85490be7728c2d4/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:27.234197 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d4f64-7d51-4f46-a983-9a4ff2a99e0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=949aed50973244398c82cdd615e483a1, user_id=1ff983038a5a4478a85490be7728c2d4, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:27.236815 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d4f64-7d51-4f46-a983-9a4ff2a99e0c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:27.304524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1241/2500] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:32:27 2022] PUT /identity/v3/projects/949aed50973244398c82cdd615e483a1/users/1ff983038a5a4478a85490be7728c2d4/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:27.319863 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a89f12-7430-4049-afb5-3eb3092da2a8 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:27.320251 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a89f12-7430-4049-afb5-3eb3092da2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:27.320532 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a89f12-7430-4049-afb5-3eb3092da2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:27.347567 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-00a89f12-7430-4049-afb5-3eb3092da2a8 None None] MFA Rules not processed for user `1ff983038a5a4478a85490be7728c2d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:27.348873 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-00a89f12-7430-4049-afb5-3eb3092da2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:27.420947 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1260/2501] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:27.425467 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d4f64-7d51-4f46-a983-9a4ff2a99e0c admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:27.491315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d4f64-7d51-4f46-a983-9a4ff2a99e0c admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:27.495878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789456b7-2084-40b3-bf43-6f554030b11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:27.496569 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789456b7-2084-40b3-bf43-6f554030b11b admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:27.496847 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789456b7-2084-40b3-bf43-6f554030b11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:27.497712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789456b7-2084-40b3-bf43-6f554030b11b admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:27.498411 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789456b7-2084-40b3-bf43-6f554030b11b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:27.500380 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789456b7-2084-40b3-bf43-6f554030b11b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:27.580450 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1242/2502] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:32:27 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:32:27.592557 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a89f12-7430-4049-afb5-3eb3092da2a8 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:27.603612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a89f12-7430-4049-afb5-3eb3092da2a8 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:27.662488 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f1ccd-606e-4933-9d18-25ee9f1b58f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:27.663164 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f1ccd-606e-4933-9d18-25ee9f1b58f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:27.663444 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f1ccd-606e-4933-9d18-25ee9f1b58f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:27.663721 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f1ccd-606e-4933-9d18-25ee9f1b58f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:27.664448 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f1ccd-606e-4933-9d18-25ee9f1b58f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:27.666396 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f1ccd-606e-4933-9d18-25ee9f1b58f8 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:27.757831 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1261/2503] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:32:27 2022] POST /identity/v3/users => generated 299 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:32:27.760965 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789456b7-2084-40b3-bf43-6f554030b11b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:27.771205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789456b7-2084-40b3-bf43-6f554030b11b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:27.775857 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df95ecf-944b-4e2d-aede-a1be33b8a715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:27.783546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df95ecf-944b-4e2d-aede-a1be33b8a715 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:27.783546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df95ecf-944b-4e2d-aede-a1be33b8a715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:27.783546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df95ecf-944b-4e2d-aede-a1be33b8a715 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:27.783546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df95ecf-944b-4e2d-aede-a1be33b8a715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:27.783546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df95ecf-944b-4e2d-aede-a1be33b8a715 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:27.791069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1243/2504] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:32:27.795444 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f1ccd-606e-4933-9d18-25ee9f1b58f8 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:27.802324 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:27.806314 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f1ccd-606e-4933-9d18-25ee9f1b58f8 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:27.811276 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7cccc-e28d-444b-9ff8-4b62de8d1062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:27.812395 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7cccc-e28d-444b-9ff8-4b62de8d1062 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:27.812730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7cccc-e28d-444b-9ff8-4b62de8d1062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:27.813014 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7cccc-e28d-444b-9ff8-4b62de8d1062 admin admin] PATH_INFO: `/v3/projects/d11e77b5cf7548d5b507f5bc3aa54a1f/users/11a966f7d2da4119abbfc59292dc43d8/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:27.828851 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa7cccc-e28d-444b-9ff8-4b62de8d1062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11e77b5cf7548d5b507f5bc3aa54a1f, user_id=11a966f7d2da4119abbfc59292dc43d8, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:27.831673 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa7cccc-e28d-444b-9ff8-4b62de8d1062 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:27.893998 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1262/2505] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:32:27 2022] PUT /identity/v3/projects/d11e77b5cf7548d5b507f5bc3aa54a1f/users/11a966f7d2da4119abbfc59292dc43d8/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:27.897942 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df95ecf-944b-4e2d-aede-a1be33b8a715 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:27.909130 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df95ecf-944b-4e2d-aede-a1be33b8a715 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:27.942682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:27.979274 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adaa2a-60c9-4eff-8d50-f8ebe14fe144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:27.980356 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adaa2a-60c9-4eff-8d50-f8ebe14fe144 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:27.980762 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adaa2a-60c9-4eff-8d50-f8ebe14fe144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:27.984408 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adaa2a-60c9-4eff-8d50-f8ebe14fe144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:27.984408 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adaa2a-60c9-4eff-8d50-f8ebe14fe144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:27.984408 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adaa2a-60c9-4eff-8d50-f8ebe14fe144 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:27.994082 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1244/2506] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:32:27.998475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7cccc-e28d-444b-9ff8-4b62de8d1062 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:28.014161 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7cccc-e28d-444b-9ff8-4b62de8d1062 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:28.020041 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8397a-ac79-4c80-81c2-14d4dc46bae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:28.020942 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8397a-ac79-4c80-81c2-14d4dc46bae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:28.021201 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8397a-ac79-4c80-81c2-14d4dc46bae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:28.021469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8397a-ac79-4c80-81c2-14d4dc46bae8 admin admin] PATH_INFO: `/v3/projects/d11e77b5cf7548d5b507f5bc3aa54a1f/users/11a966f7d2da4119abbfc59292dc43d8/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:28.023471 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8397a-ac79-4c80-81c2-14d4dc46bae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11e77b5cf7548d5b507f5bc3aa54a1f, user_id=11a966f7d2da4119abbfc59292dc43d8, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:28.026175 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8397a-ac79-4c80-81c2-14d4dc46bae8 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:28.037848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1263/2507] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:32:27 2022] PUT /identity/v3/projects/d11e77b5cf7548d5b507f5bc3aa54a1f/users/11a966f7d2da4119abbfc59292dc43d8/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:28.049963 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d221d-50c8-4bb5-861e-bb3b06051fc3 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:28.050248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d221d-50c8-4bb5-861e-bb3b06051fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:28.050615 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d221d-50c8-4bb5-861e-bb3b06051fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:28.077790 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-8d9d221d-50c8-4bb5-861e-bb3b06051fc3 None None] MFA Rules not processed for user `11a966f7d2da4119abbfc59292dc43d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:28.078988 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8d9d221d-50c8-4bb5-861e-bb3b06051fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:28.147055 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1245/2508] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:32:28.158916 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8397a-ac79-4c80-81c2-14d4dc46bae8 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:28.160638 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-48d8397a-ac79-4c80-81c2-14d4dc46bae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:28.219350 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8397a-ac79-4c80-81c2-14d4dc46bae8 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:28.223105 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98df1f9-ca38-403e-9adf-c7c92510e40f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:28.223759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98df1f9-ca38-403e-9adf-c7c92510e40f service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:28.224071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98df1f9-ca38-403e-9adf-c7c92510e40f service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:28.224354 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98df1f9-ca38-403e-9adf-c7c92510e40f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:28.233915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98df1f9-ca38-403e-9adf-c7c92510e40f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:28.235366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98df1f9-ca38-403e-9adf-c7c92510e40f service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:28.245121 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1264/2509] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:32:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:32:28.272883 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d221d-50c8-4bb5-861e-bb3b06051fc3 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:28.334249 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d221d-50c8-4bb5-861e-bb3b06051fc3 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:28.338774 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a536005-0ec3-4045-b0fe-3e0c96308842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:28.339642 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a536005-0ec3-4045-b0fe-3e0c96308842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:28.339918 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a536005-0ec3-4045-b0fe-3e0c96308842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:28.340213 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a536005-0ec3-4045-b0fe-3e0c96308842 admin admin] PATH_INFO: `/v3/users/1ff983038a5a4478a85490be7728c2d4` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:28.341978 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a536005-0ec3-4045-b0fe-3e0c96308842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ff983038a5a4478a85490be7728c2d4)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:28.343888 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a536005-0ec3-4045-b0fe-3e0c96308842 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:28.495345 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7a536005-0ec3-4045-b0fe-3e0c96308842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ff983038a5a4478a85490be7728c2d4'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:28.503068 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7a536005-0ec3-4045-b0fe-3e0c96308842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ff983038a5a4478a85490be7728c2d4'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:28.503769 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7a536005-0ec3-4045-b0fe-3e0c96308842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ff983038a5a4478a85490be7728c2d4'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:28.504433 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7a536005-0ec3-4045-b0fe-3e0c96308842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ff983038a5a4478a85490be7728c2d4'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:28.505555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:28.517436 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7a536005-0ec3-4045-b0fe-3e0c96308842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ff983038a5a4478a85490be7728c2d4'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:28.573085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1246/2510] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:32:28 2022] DELETE /identity/v3/users/1ff983038a5a4478a85490be7728c2d4 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:28.578220 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4c640-b2ea-4ccb-98f4-c230afe986fc None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:28.578511 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4c640-b2ea-4ccb-98f4-c230afe986fc None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:28.578789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4c640-b2ea-4ccb-98f4-c230afe986fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:28.596225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-2cc4c640-b2ea-4ccb-98f4-c230afe986fc None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:28.597469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-2cc4c640-b2ea-4ccb-98f4-c230afe986fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:28.659970 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1265/2511] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:28.670959 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a536005-0ec3-4045-b0fe-3e0c96308842 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:28.672437 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7a536005-0ec3-4045-b0fe-3e0c96308842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:28.742838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a536005-0ec3-4045-b0fe-3e0c96308842 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:28.746691 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586c64d-e72b-41c8-8ed1-7815965b76a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:28.747876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586c64d-e72b-41c8-8ed1-7815965b76a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:28.748186 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586c64d-e72b-41c8-8ed1-7815965b76a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:28.748455 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586c64d-e72b-41c8-8ed1-7815965b76a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:28.758460 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586c64d-e72b-41c8-8ed1-7815965b76a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:28.759913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586c64d-e72b-41c8-8ed1-7815965b76a1 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:28.770835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1247/2512] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:32:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:32:29.226706 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4c640-b2ea-4ccb-98f4-c230afe986fc None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:29.228237 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-2cc4c640-b2ea-4ccb-98f4-c230afe986fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:29.243409 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4c640-b2ea-4ccb-98f4-c230afe986fc None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:29.249010 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a98b1a-5eae-4054-bca7-ba47f5751c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:29.250615 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a98b1a-5eae-4054-bca7-ba47f5751c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:29.250903 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a98b1a-5eae-4054-bca7-ba47f5751c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:29.251179 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a98b1a-5eae-4054-bca7-ba47f5751c44 admin admin] PATH_INFO: `/v3/projects/949aed50973244398c82cdd615e483a1` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:29.252661 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a98b1a-5eae-4054-bca7-ba47f5751c44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=949aed50973244398c82cdd615e483a1)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:29.255262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a98b1a-5eae-4054-bca7-ba47f5751c44 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:29.342129 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-a6a98b1a-5eae-4054-bca7-ba47f5751c44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '949aed50973244398c82cdd615e483a1', 'request_id': 'req-a6a98b1a-5eae-4054-bca7-ba47f5751c44'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:29.430455 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-a6a98b1a-5eae-4054-bca7-ba47f5751c44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '949aed50973244398c82cdd615e483a1', 'request_id': 'req-a6a98b1a-5eae-4054-bca7-ba47f5751c44'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:29.436763 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-a6a98b1a-5eae-4054-bca7-ba47f5751c44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '949aed50973244398c82cdd615e483a1', 'request_id': 'req-a6a98b1a-5eae-4054-bca7-ba47f5751c44'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:29.438011 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:29.448866 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-a6a98b1a-5eae-4054-bca7-ba47f5751c44 admin admin] The token cache is being invalidate because project 949aed50973244398c82cdd615e483a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:32:29.449151 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-a6a98b1a-5eae-4054-bca7-ba47f5751c44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:29.449779 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-a6a98b1a-5eae-4054-bca7-ba47f5751c44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:29.451441 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1266/2513] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:32:29 2022] DELETE /identity/v3/projects/949aed50973244398c82cdd615e483a1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:32:29.455513 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586c64d-e72b-41c8-8ed1-7815965b76a1 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:29.466955 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586c64d-e72b-41c8-8ed1-7815965b76a1 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:29.522977 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f06908-cd47-447e-a26f-f3c69ce43973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:29.523854 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f06908-cd47-447e-a26f-f3c69ce43973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:29.524173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f06908-cd47-447e-a26f-f3c69ce43973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:29.524448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f06908-cd47-447e-a26f-f3c69ce43973 admin admin] PATH_INFO: `/v3/users/11a966f7d2da4119abbfc59292dc43d8` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:29.525677 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f06908-cd47-447e-a26f-f3c69ce43973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11a966f7d2da4119abbfc59292dc43d8)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:29.527678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f06908-cd47-447e-a26f-f3c69ce43973 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:29.668441 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-40f06908-cd47-447e-a26f-f3c69ce43973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11a966f7d2da4119abbfc59292dc43d8'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:29.676517 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-40f06908-cd47-447e-a26f-f3c69ce43973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11a966f7d2da4119abbfc59292dc43d8'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:29.677259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-40f06908-cd47-447e-a26f-f3c69ce43973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11a966f7d2da4119abbfc59292dc43d8'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:29.678461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-40f06908-cd47-447e-a26f-f3c69ce43973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11a966f7d2da4119abbfc59292dc43d8'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:29.692998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-40f06908-cd47-447e-a26f-f3c69ce43973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11a966f7d2da4119abbfc59292dc43d8'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:29.696686 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:29.785014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1248/2514] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:32:29 2022] DELETE /identity/v3/users/11a966f7d2da4119abbfc59292dc43d8 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:30.343346 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a98b1a-5eae-4054-bca7-ba47f5751c44 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:30.343798 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-a6a98b1a-5eae-4054-bca7-ba47f5751c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:30.356795 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a98b1a-5eae-4054-bca7-ba47f5751c44 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:30.427363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b052cb-c214-43aa-96c6-9b7e4001498d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:30.428171 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b052cb-c214-43aa-96c6-9b7e4001498d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:30.428451 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b052cb-c214-43aa-96c6-9b7e4001498d admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:30.428726 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b052cb-c214-43aa-96c6-9b7e4001498d admin admin] PATH_INFO: `/v3/projects/d11e77b5cf7548d5b507f5bc3aa54a1f` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:30.429906 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b052cb-c214-43aa-96c6-9b7e4001498d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d11e77b5cf7548d5b507f5bc3aa54a1f)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:30.431964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b052cb-c214-43aa-96c6-9b7e4001498d admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:30.574113 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-a8b052cb-c214-43aa-96c6-9b7e4001498d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd11e77b5cf7548d5b507f5bc3aa54a1f', 'request_id': 'req-a8b052cb-c214-43aa-96c6-9b7e4001498d'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:30.664531 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-a8b052cb-c214-43aa-96c6-9b7e4001498d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd11e77b5cf7548d5b507f5bc3aa54a1f', 'request_id': 'req-a8b052cb-c214-43aa-96c6-9b7e4001498d'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:30.672209 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-a8b052cb-c214-43aa-96c6-9b7e4001498d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd11e77b5cf7548d5b507f5bc3aa54a1f', 'request_id': 'req-a8b052cb-c214-43aa-96c6-9b7e4001498d'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:30.683417 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-a8b052cb-c214-43aa-96c6-9b7e4001498d admin admin] The token cache is being invalidate because project d11e77b5cf7548d5b507f5bc3aa54a1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:32:30.683641 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-a8b052cb-c214-43aa-96c6-9b7e4001498d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:30.684436 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-a8b052cb-c214-43aa-96c6-9b7e4001498d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:30.686597 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1267/2515] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:32:30 2022] DELETE /identity/v3/projects/d11e77b5cf7548d5b507f5bc3aa54a1f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:30.691837 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28677f0-0ac6-4153-93a3-0749a67809d5 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:30.692339 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28677f0-0ac6-4153-93a3-0749a67809d5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:30.693599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28677f0-0ac6-4153-93a3-0749a67809d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:30.713660 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-b28677f0-0ac6-4153-93a3-0749a67809d5 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:30.715085 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b28677f0-0ac6-4153-93a3-0749a67809d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:30.789642 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1249/2516] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:30.798663 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff4d56-7d3f-4b4a-bbf4-02a320bcc176 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:30.799317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff4d56-7d3f-4b4a-bbf4-02a320bcc176 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:30.799608 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff4d56-7d3f-4b4a-bbf4-02a320bcc176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:30.821441 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-2cff4d56-7d3f-4b4a-bbf4-02a320bcc176 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:30.823142 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-2cff4d56-7d3f-4b4a-bbf4-02a320bcc176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:30.833642 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1268/2517] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:30.836447 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28677f0-0ac6-4153-93a3-0749a67809d5 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:30.850162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28677f0-0ac6-4153-93a3-0749a67809d5 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:30.855250 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf84b49-8234-4dfc-87e1-33b6000734e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:30.861108 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf84b49-8234-4dfc-87e1-33b6000734e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:30.861108 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf84b49-8234-4dfc-87e1-33b6000734e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:30.861108 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf84b49-8234-4dfc-87e1-33b6000734e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:30.861108 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf84b49-8234-4dfc-87e1-33b6000734e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:32:30.861108 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf84b49-8234-4dfc-87e1-33b6000734e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:30.861108 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf84b49-8234-4dfc-87e1-33b6000734e0 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:30.875768 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1250/2518] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:32:30.880133 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff4d56-7d3f-4b4a-bbf4-02a320bcc176 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:30.892007 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff4d56-7d3f-4b4a-bbf4-02a320bcc176 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:30.896907 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9c819-d0d1-4e44-a2f5-8656a46934f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:30.897577 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9c819-d0d1-4e44-a2f5-8656a46934f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:30.897858 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9c819-d0d1-4e44-a2f5-8656a46934f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:30.898130 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9c819-d0d1-4e44-a2f5-8656a46934f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:30.898840 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9c819-d0d1-4e44-a2f5-8656a46934f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:30.900819 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9c819-d0d1-4e44-a2f5-8656a46934f6 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:31.017958 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1269/2519] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:32:30 2022] POST /identity/v3/projects => generated 389 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:32:31.019400 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf84b49-8234-4dfc-87e1-33b6000734e0 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:31.030578 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf84b49-8234-4dfc-87e1-33b6000734e0 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:31.089743 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6cd9f-f2cc-4aa5-989d-ab99a9cd497b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:31.090417 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6cd9f-f2cc-4aa5-989d-ab99a9cd497b admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:31.091205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6cd9f-f2cc-4aa5-989d-ab99a9cd497b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:31.091479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6cd9f-f2cc-4aa5-989d-ab99a9cd497b admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:31.092207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6cd9f-f2cc-4aa5-989d-ab99a9cd497b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:31.094142 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6cd9f-f2cc-4aa5-989d-ab99a9cd497b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:31.163526 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1251/2520] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:32:31 2022] POST /identity/v3/users => generated 295 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:32:31.167665 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9c819-d0d1-4e44-a2f5-8656a46934f6 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:31.178137 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9c819-d0d1-4e44-a2f5-8656a46934f6 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:31.182935 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8d8bf-5255-4479-ad8d-fd736ba0543d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:31.183578 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8d8bf-5255-4479-ad8d-fd736ba0543d admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:31.183860 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8d8bf-5255-4479-ad8d-fd736ba0543d admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:31.184177 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8d8bf-5255-4479-ad8d-fd736ba0543d admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:31.184899 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8d8bf-5255-4479-ad8d-fd736ba0543d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:31.186498 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8d8bf-5255-4479-ad8d-fd736ba0543d admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:31.197205 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1270/2521] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:32:31.201965 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6cd9f-f2cc-4aa5-989d-ab99a9cd497b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:31.212086 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6cd9f-f2cc-4aa5-989d-ab99a9cd497b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:31.217413 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b82360-fe43-48a6-8a27-a9aa0c9e7db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:31.218060 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b82360-fe43-48a6-8a27-a9aa0c9e7db0 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:31.218340 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b82360-fe43-48a6-8a27-a9aa0c9e7db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:31.218613 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b82360-fe43-48a6-8a27-a9aa0c9e7db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:31.219324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b82360-fe43-48a6-8a27-a9aa0c9e7db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:31.221020 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b82360-fe43-48a6-8a27-a9aa0c9e7db0 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:31.231211 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1252/2522] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:32:31.235618 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8d8bf-5255-4479-ad8d-fd736ba0543d admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:31.245744 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8d8bf-5255-4479-ad8d-fd736ba0543d admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:31.250343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d7dae-c5c8-4dbd-8cea-a7ada7438249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:31.251308 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d7dae-c5c8-4dbd-8cea-a7ada7438249 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:31.251501 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d7dae-c5c8-4dbd-8cea-a7ada7438249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:31.251779 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d7dae-c5c8-4dbd-8cea-a7ada7438249 admin admin] PATH_INFO: `/v3/projects/1d983f38aa6746b0977e90b19c7d8c7c/users/b61af13095904e868f51d9a5283852c0/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:31.267154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d7dae-c5c8-4dbd-8cea-a7ada7438249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d983f38aa6746b0977e90b19c7d8c7c, user_id=b61af13095904e868f51d9a5283852c0, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:31.269866 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d7dae-c5c8-4dbd-8cea-a7ada7438249 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:31.322303 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1271/2523] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:32:31 2022] PUT /identity/v3/projects/1d983f38aa6746b0977e90b19c7d8c7c/users/b61af13095904e868f51d9a5283852c0/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:31.334771 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed586eb-297b-42e4-9c7d-5e8ddcca1e35 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:31.334771 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed586eb-297b-42e4-9c7d-5e8ddcca1e35 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:31.334771 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed586eb-297b-42e4-9c7d-5e8ddcca1e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:31.371437 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-2ed586eb-297b-42e4-9c7d-5e8ddcca1e35 None None] MFA Rules not processed for user `b61af13095904e868f51d9a5283852c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:31.372826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2ed586eb-297b-42e4-9c7d-5e8ddcca1e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:31.425091 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:31.442401 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1253/2524] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:32:31.446811 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d7dae-c5c8-4dbd-8cea-a7ada7438249 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:31.469846 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:31.510610 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d7dae-c5c8-4dbd-8cea-a7ada7438249 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:31.515917 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ab2e0-40db-4c8d-be30-5aa67d68b552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:31.516606 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ab2e0-40db-4c8d-be30-5aa67d68b552 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:31.516889 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ab2e0-40db-4c8d-be30-5aa67d68b552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:31.517167 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ab2e0-40db-4c8d-be30-5aa67d68b552 admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:31.517860 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ab2e0-40db-4c8d-be30-5aa67d68b552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:31.519768 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ab2e0-40db-4c8d-be30-5aa67d68b552 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:31.597586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1272/2525] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:32:31 2022] POST /identity/v3/projects => generated 393 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:32:31.601678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed586eb-297b-42e4-9c7d-5e8ddcca1e35 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:31.613306 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed586eb-297b-42e4-9c7d-5e8ddcca1e35 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:31.672707 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35296ac7-7dd2-47e2-8873-5996d78016f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:31.673378 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35296ac7-7dd2-47e2-8873-5996d78016f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:31.673659 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35296ac7-7dd2-47e2-8873-5996d78016f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:31.673934 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35296ac7-7dd2-47e2-8873-5996d78016f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:31.674710 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35296ac7-7dd2-47e2-8873-5996d78016f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:31.676642 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35296ac7-7dd2-47e2-8873-5996d78016f3 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:31.822994 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1254/2526] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:32:31 2022] POST /identity/v3/users => generated 303 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:32:31.824254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ab2e0-40db-4c8d-be30-5aa67d68b552 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:31.835433 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ab2e0-40db-4c8d-be30-5aa67d68b552 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:31.841135 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467a319-e2cb-415c-8c2d-2bd794ade0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:31.841914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467a319-e2cb-415c-8c2d-2bd794ade0ee admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:31.842225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467a319-e2cb-415c-8c2d-2bd794ade0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:31.842503 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467a319-e2cb-415c-8c2d-2bd794ade0ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:31.843225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467a319-e2cb-415c-8c2d-2bd794ade0ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:31.844939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467a319-e2cb-415c-8c2d-2bd794ade0ee admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:31.858203 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1273/2527] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:32:31.862173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35296ac7-7dd2-47e2-8873-5996d78016f3 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:31.874387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35296ac7-7dd2-47e2-8873-5996d78016f3 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:31.880013 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844f1b5-4f2c-4758-801d-f4b26366963b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:31.880936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844f1b5-4f2c-4758-801d-f4b26366963b admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:31.881217 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844f1b5-4f2c-4758-801d-f4b26366963b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:31.881491 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844f1b5-4f2c-4758-801d-f4b26366963b admin admin] PATH_INFO: `/v3/projects/8656d03aa712429ab4bc2cfbf7395ff3/users/b7304a8e081543cdb53a25154aed2df2/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:31.898766 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844f1b5-4f2c-4758-801d-f4b26366963b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8656d03aa712429ab4bc2cfbf7395ff3, user_id=b7304a8e081543cdb53a25154aed2df2, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:31.901712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844f1b5-4f2c-4758-801d-f4b26366963b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:32.002933 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1255/2528] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:32:31 2022] PUT /identity/v3/projects/8656d03aa712429ab4bc2cfbf7395ff3/users/b7304a8e081543cdb53a25154aed2df2/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:32:32.006850 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467a319-e2cb-415c-8c2d-2bd794ade0ee admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:32.017710 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467a319-e2cb-415c-8c2d-2bd794ade0ee admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:32.078662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9d8fb-cec4-4eb2-8526-f59aa798330e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:32.079335 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9d8fb-cec4-4eb2-8526-f59aa798330e admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:32.079619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9d8fb-cec4-4eb2-8526-f59aa798330e admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:32.079892 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9d8fb-cec4-4eb2-8526-f59aa798330e admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:32.080645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9d8fb-cec4-4eb2-8526-f59aa798330e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:32.082467 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9d8fb-cec4-4eb2-8526-f59aa798330e admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:32.093677 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1274/2529] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:32:32.103657 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844f1b5-4f2c-4758-801d-f4b26366963b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:32.114356 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844f1b5-4f2c-4758-801d-f4b26366963b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:32.118949 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c2867-b11e-458a-b858-ff52c90e122d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:32.119826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c2867-b11e-458a-b858-ff52c90e122d admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:32.120162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c2867-b11e-458a-b858-ff52c90e122d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:32.120440 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c2867-b11e-458a-b858-ff52c90e122d admin admin] PATH_INFO: `/v3/projects/8656d03aa712429ab4bc2cfbf7395ff3/users/b7304a8e081543cdb53a25154aed2df2/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:32.122437 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c2867-b11e-458a-b858-ff52c90e122d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8656d03aa712429ab4bc2cfbf7395ff3, user_id=b7304a8e081543cdb53a25154aed2df2, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:32.125125 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c2867-b11e-458a-b858-ff52c90e122d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:32.135982 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1256/2530] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:32:32 2022] PUT /identity/v3/projects/8656d03aa712429ab4bc2cfbf7395ff3/users/b7304a8e081543cdb53a25154aed2df2/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:32:32.148034 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b91c3-6877-45ff-8290-766a63da55ce None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:32.148328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b91c3-6877-45ff-8290-766a63da55ce None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:32.148725 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b91c3-6877-45ff-8290-766a63da55ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:32.177174 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-5a7b91c3-6877-45ff-8290-766a63da55ce None None] MFA Rules not processed for user `b7304a8e081543cdb53a25154aed2df2`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:32.178466 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5a7b91c3-6877-45ff-8290-766a63da55ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:32.251507 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1275/2531] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:32.262220 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c2867-b11e-458a-b858-ff52c90e122d admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:32.264587 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2a6c2867-b11e-458a-b858-ff52c90e122d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:32.323624 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c2867-b11e-458a-b858-ff52c90e122d admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:32.327970 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f53360-9c1e-4a2c-8c02-63289910d479 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:32.328651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f53360-9c1e-4a2c-8c02-63289910d479 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:32.328930 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f53360-9c1e-4a2c-8c02-63289910d479 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:32.329205 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f53360-9c1e-4a2c-8c02-63289910d479 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:32.338994 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f53360-9c1e-4a2c-8c02-63289910d479 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:32.340474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f53360-9c1e-4a2c-8c02-63289910d479 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:32.350231 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1257/2532] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:32:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:32:32.402923 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b91c3-6877-45ff-8290-766a63da55ce None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:32.412960 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b91c3-6877-45ff-8290-766a63da55ce None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:32.416598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2da21-e591-4548-8067-c9fc6947d444 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:32.417288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2da21-e591-4548-8067-c9fc6947d444 service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:32.417567 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2da21-e591-4548-8067-c9fc6947d444 service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:32.417842 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2da21-e591-4548-8067-c9fc6947d444 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:32.431588 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:32.487576 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2da21-e591-4548-8067-c9fc6947d444 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:32.489130 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2da21-e591-4548-8067-c9fc6947d444 service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:32.498813 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1276/2533] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:32:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:32:35.842387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce126d8-c80f-4dd9-8515-f25cc8241453 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:35.842916 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce126d8-c80f-4dd9-8515-f25cc8241453 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:35.842916 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce126d8-c80f-4dd9-8515-f25cc8241453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:35.861039 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-3ce126d8-c80f-4dd9-8515-f25cc8241453 None None] MFA Rules not processed for user `b73ac3812b9741b0b09a30c592fe7af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:35.862235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3ce126d8-c80f-4dd9-8515-f25cc8241453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:35.902587 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:35.915522 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1258/2534] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:37.363827 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2da21-e591-4548-8067-c9fc6947d444 service cinder] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:37.425893 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2da21-e591-4548-8067-c9fc6947d444 service cinder] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:37.430368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89635f94-05e5-41f1-957c-03837ab05ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:37.431228 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89635f94-05e5-41f1-957c-03837ab05ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:37.431504 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89635f94-05e5-41f1-957c-03837ab05ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:37.431775 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89635f94-05e5-41f1-957c-03837ab05ce9 admin admin] PATH_INFO: `/v3/users/b61af13095904e868f51d9a5283852c0` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:37.432983 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89635f94-05e5-41f1-957c-03837ab05ce9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b61af13095904e868f51d9a5283852c0)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:37.434932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89635f94-05e5-41f1-957c-03837ab05ce9 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:37.627088 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-89635f94-05e5-41f1-957c-03837ab05ce9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b61af13095904e868f51d9a5283852c0'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:37.642012 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-89635f94-05e5-41f1-957c-03837ab05ce9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b61af13095904e868f51d9a5283852c0'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:37.649144 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-89635f94-05e5-41f1-957c-03837ab05ce9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b61af13095904e868f51d9a5283852c0'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:37.649931 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-89635f94-05e5-41f1-957c-03837ab05ce9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b61af13095904e868f51d9a5283852c0'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:37.650532 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-89635f94-05e5-41f1-957c-03837ab05ce9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b61af13095904e868f51d9a5283852c0'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:37.728105 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1277/2535] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:32:37 2022] DELETE /identity/v3/users/b61af13095904e868f51d9a5283852c0 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:37.733343 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34b0f5-24a6-43de-8e67-55dcb972db0e None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:37.733925 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34b0f5-24a6-43de-8e67-55dcb972db0e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:37.733925 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34b0f5-24a6-43de-8e67-55dcb972db0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:37.757618 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-8c34b0f5-24a6-43de-8e67-55dcb972db0e None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:37.758858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8c34b0f5-24a6-43de-8e67-55dcb972db0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:37.833007 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1259/2536] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:37.844418 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89635f94-05e5-41f1-957c-03837ab05ce9 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:37.846071 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-89635f94-05e5-41f1-957c-03837ab05ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:37.885151 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:37.907660 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89635f94-05e5-41f1-957c-03837ab05ce9 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:37.911681 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64291e-5c99-4fb9-99eb-30fe4f38925c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:37.912381 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64291e-5c99-4fb9-99eb-30fe4f38925c service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:37.915100 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64291e-5c99-4fb9-99eb-30fe4f38925c service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:37.915100 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64291e-5c99-4fb9-99eb-30fe4f38925c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:37.925409 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64291e-5c99-4fb9-99eb-30fe4f38925c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:37.927110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64291e-5c99-4fb9-99eb-30fe4f38925c service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:37.939842 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1278/2537] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:32:38.374397 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34b0f5-24a6-43de-8e67-55dcb972db0e None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:38.375817 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8c34b0f5-24a6-43de-8e67-55dcb972db0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:38.387933 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34b0f5-24a6-43de-8e67-55dcb972db0e None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:38.392695 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ac6e9-34a1-4757-b837-a6e044cb97a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:38.393569 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ac6e9-34a1-4757-b837-a6e044cb97a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:38.393851 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ac6e9-34a1-4757-b837-a6e044cb97a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:38.394130 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ac6e9-34a1-4757-b837-a6e044cb97a6 admin admin] PATH_INFO: `/v3/projects/1d983f38aa6746b0977e90b19c7d8c7c` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:38.395329 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ac6e9-34a1-4757-b837-a6e044cb97a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d983f38aa6746b0977e90b19c7d8c7c)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:38.397295 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ac6e9-34a1-4757-b837-a6e044cb97a6 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:38.487682 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3c9ac6e9-34a1-4757-b837-a6e044cb97a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d983f38aa6746b0977e90b19c7d8c7c', 'request_id': 'req-3c9ac6e9-34a1-4757-b837-a6e044cb97a6'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:38.493951 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3c9ac6e9-34a1-4757-b837-a6e044cb97a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d983f38aa6746b0977e90b19c7d8c7c', 'request_id': 'req-3c9ac6e9-34a1-4757-b837-a6e044cb97a6'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:38.555761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3c9ac6e9-34a1-4757-b837-a6e044cb97a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d983f38aa6746b0977e90b19c7d8c7c', 'request_id': 'req-3c9ac6e9-34a1-4757-b837-a6e044cb97a6'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:38.566894 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3c9ac6e9-34a1-4757-b837-a6e044cb97a6 admin admin] The token cache is being invalidate because project 1d983f38aa6746b0977e90b19c7d8c7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:32:38.567238 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3c9ac6e9-34a1-4757-b837-a6e044cb97a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:38.567863 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3c9ac6e9-34a1-4757-b837-a6e044cb97a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:38.569466 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1260/2538] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:32:38 2022] DELETE /identity/v3/projects/1d983f38aa6746b0977e90b19c7d8c7c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:38.573483 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64291e-5c99-4fb9-99eb-30fe4f38925c service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:38.583098 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64291e-5c99-4fb9-99eb-30fe4f38925c service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:38.640423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f79cf-a52e-489b-94e9-3ab071842e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:38.641296 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f79cf-a52e-489b-94e9-3ab071842e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:38.641579 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f79cf-a52e-489b-94e9-3ab071842e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:38.641855 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f79cf-a52e-489b-94e9-3ab071842e91 admin admin] PATH_INFO: `/v3/users/b7304a8e081543cdb53a25154aed2df2` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:38.643039 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f79cf-a52e-489b-94e9-3ab071842e91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7304a8e081543cdb53a25154aed2df2)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:38.645030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f79cf-a52e-489b-94e9-3ab071842e91 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:38.809551 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-706f79cf-a52e-489b-94e9-3ab071842e91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7304a8e081543cdb53a25154aed2df2'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:38.822864 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-706f79cf-a52e-489b-94e9-3ab071842e91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7304a8e081543cdb53a25154aed2df2'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:38.830224 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-706f79cf-a52e-489b-94e9-3ab071842e91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7304a8e081543cdb53a25154aed2df2'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:38.830916 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-706f79cf-a52e-489b-94e9-3ab071842e91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7304a8e081543cdb53a25154aed2df2'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:38.831525 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-706f79cf-a52e-489b-94e9-3ab071842e91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7304a8e081543cdb53a25154aed2df2'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:38.910551 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1279/2539] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:32:38 2022] DELETE /identity/v3/users/b7304a8e081543cdb53a25154aed2df2 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:39.329616 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ac6e9-34a1-4757-b837-a6e044cb97a6 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:39.331824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3c9ac6e9-34a1-4757-b837-a6e044cb97a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:39.346428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ac6e9-34a1-4757-b837-a6e044cb97a6 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:39.411191 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf017f-4983-4a22-a58a-ca429f4e8ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:39.412074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf017f-4983-4a22-a58a-ca429f4e8ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:39.412356 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf017f-4983-4a22-a58a-ca429f4e8ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:39.412628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf017f-4983-4a22-a58a-ca429f4e8ebe admin admin] PATH_INFO: `/v3/projects/8656d03aa712429ab4bc2cfbf7395ff3` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:39.413811 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf017f-4983-4a22-a58a-ca429f4e8ebe admin admin] RBAC: Authorizing `identity:delete_project(project_id=8656d03aa712429ab4bc2cfbf7395ff3)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:39.415708 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf017f-4983-4a22-a58a-ca429f4e8ebe admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:39.432384 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:39.533837 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2bbf017f-4983-4a22-a58a-ca429f4e8ebe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8656d03aa712429ab4bc2cfbf7395ff3', 'request_id': 'req-2bbf017f-4983-4a22-a58a-ca429f4e8ebe'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:39.539932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2bbf017f-4983-4a22-a58a-ca429f4e8ebe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8656d03aa712429ab4bc2cfbf7395ff3', 'request_id': 'req-2bbf017f-4983-4a22-a58a-ca429f4e8ebe'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:39.612684 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2bbf017f-4983-4a22-a58a-ca429f4e8ebe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8656d03aa712429ab4bc2cfbf7395ff3', 'request_id': 'req-2bbf017f-4983-4a22-a58a-ca429f4e8ebe'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:39.625427 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2bbf017f-4983-4a22-a58a-ca429f4e8ebe admin admin] The token cache is being invalidate because project 8656d03aa712429ab4bc2cfbf7395ff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:32:39.625863 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2bbf017f-4983-4a22-a58a-ca429f4e8ebe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:39.626625 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2bbf017f-4983-4a22-a58a-ca429f4e8ebe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:39.628292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1261/2540] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:32:39 2022] DELETE /identity/v3/projects/8656d03aa712429ab4bc2cfbf7395ff3 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:39.640817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47a867-6221-497e-85c9-9f66ed6c3c40 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:39.641437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47a867-6221-497e-85c9-9f66ed6c3c40 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:39.641437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47a867-6221-497e-85c9-9f66ed6c3c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:39.658678 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-5f47a867-6221-497e-85c9-9f66ed6c3c40 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:39.659861 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5f47a867-6221-497e-85c9-9f66ed6c3c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:39.711101 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:39.729110 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1280/2541] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:39.737870 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd4680-4685-4063-8249-933887fb5639 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:39.738386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd4680-4685-4063-8249-933887fb5639 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:39.738815 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd4680-4685-4063-8249-933887fb5639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:39.759945 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-44bd4680-4685-4063-8249-933887fb5639 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:39.761490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-44bd4680-4685-4063-8249-933887fb5639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:39.769982 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1262/2542] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:39.774069 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47a867-6221-497e-85c9-9f66ed6c3c40 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:39.785165 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47a867-6221-497e-85c9-9f66ed6c3c40 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:39.790413 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bbda6-fb91-48a4-9f4e-14e6ae3988ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:39.791080 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bbda6-fb91-48a4-9f4e-14e6ae3988ba admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:39.791361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bbda6-fb91-48a4-9f4e-14e6ae3988ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:39.791633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bbda6-fb91-48a4-9f4e-14e6ae3988ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:39.792405 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069bbda6-fb91-48a4-9f4e-14e6ae3988ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:32:39.792710 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069bbda6-fb91-48a4-9f4e-14e6ae3988ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:39.794450 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069bbda6-fb91-48a4-9f4e-14e6ae3988ba admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:39.812689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1281/2543] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:32:39.819335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd4680-4685-4063-8249-933887fb5639 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:39.856856 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd4680-4685-4063-8249-933887fb5639 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:39.873394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b73fe7-77f3-45be-94fc-172f4135e96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:39.874177 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b73fe7-77f3-45be-94fc-172f4135e96f admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:39.874526 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b73fe7-77f3-45be-94fc-172f4135e96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:39.874920 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b73fe7-77f3-45be-94fc-172f4135e96f admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:39.875641 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b73fe7-77f3-45be-94fc-172f4135e96f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:39.879218 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b73fe7-77f3-45be-94fc-172f4135e96f admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:39.962222 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1263/2544] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:32:39 2022] POST /identity/v3/projects => generated 367 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:32:39.966315 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bbda6-fb91-48a4-9f4e-14e6ae3988ba admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:39.983309 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bbda6-fb91-48a4-9f4e-14e6ae3988ba admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:40.081440 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392becd-02e2-41a2-a8a3-5544243235d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:40.082116 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392becd-02e2-41a2-a8a3-5544243235d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:40.082395 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392becd-02e2-41a2-a8a3-5544243235d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:40.082663 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392becd-02e2-41a2-a8a3-5544243235d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:40.083363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392becd-02e2-41a2-a8a3-5544243235d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:40.094942 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392becd-02e2-41a2-a8a3-5544243235d8 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:40.200334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1282/2545] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:32:39 2022] POST /identity/v3/users => generated 284 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:32:40.205141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b73fe7-77f3-45be-94fc-172f4135e96f admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:40.217774 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b73fe7-77f3-45be-94fc-172f4135e96f admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:40.223484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14801385-628e-460a-9492-516fa18daf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:40.224357 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14801385-628e-460a-9492-516fa18daf17 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:40.224745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14801385-628e-460a-9492-516fa18daf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:40.225123 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14801385-628e-460a-9492-516fa18daf17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:40.225976 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14801385-628e-460a-9492-516fa18daf17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:40.227900 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14801385-628e-460a-9492-516fa18daf17 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:40.242984 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1264/2546] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:32:40.247152 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392becd-02e2-41a2-a8a3-5544243235d8 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:40.262225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392becd-02e2-41a2-a8a3-5544243235d8 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:40.274533 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd829c5-990a-43a5-9dc5-137a2023552d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:40.275476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd829c5-990a-43a5-9dc5-137a2023552d admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:40.275911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd829c5-990a-43a5-9dc5-137a2023552d admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:40.276403 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd829c5-990a-43a5-9dc5-137a2023552d admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:40.277158 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd829c5-990a-43a5-9dc5-137a2023552d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:40.278795 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd829c5-990a-43a5-9dc5-137a2023552d admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:40.307835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1283/2547] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:32:40.312668 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14801385-628e-460a-9492-516fa18daf17 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:40.328998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14801385-628e-460a-9492-516fa18daf17 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:40.334020 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549f430-4374-4177-b772-ad05a467489e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:40.335194 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549f430-4374-4177-b772-ad05a467489e admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:40.335481 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549f430-4374-4177-b772-ad05a467489e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:40.335759 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549f430-4374-4177-b772-ad05a467489e admin admin] PATH_INFO: `/v3/projects/6a288adcd8f946d2ab97c9bd48d68bad/users/eade64ea4196472ba74304630cc1dcc5/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:40.353510 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549f430-4374-4177-b772-ad05a467489e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a288adcd8f946d2ab97c9bd48d68bad, user_id=eade64ea4196472ba74304630cc1dcc5, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:40.356495 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549f430-4374-4177-b772-ad05a467489e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:40.504756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1265/2548] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:32:40 2022] PUT /identity/v3/projects/6a288adcd8f946d2ab97c9bd48d68bad/users/eade64ea4196472ba74304630cc1dcc5/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:40.510170 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135f646-5be8-48e5-9e15-1404ccdc0326 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:40.510467 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135f646-5be8-48e5-9e15-1404ccdc0326 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:40.510749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135f646-5be8-48e5-9e15-1404ccdc0326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:40.547685 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-d135f646-5be8-48e5-9e15-1404ccdc0326 None None] MFA Rules not processed for user `eade64ea4196472ba74304630cc1dcc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:40.549453 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-d135f646-5be8-48e5-9e15-1404ccdc0326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:40.646761 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1284/2549] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:40.651863 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549f430-4374-4177-b772-ad05a467489e admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:40.717025 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549f430-4374-4177-b772-ad05a467489e admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:40.725771 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50f324-a9f0-4f70-8377-dd7ea81dffb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:40.726548 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50f324-a9f0-4f70-8377-dd7ea81dffb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:40.726951 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50f324-a9f0-4f70-8377-dd7ea81dffb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:40.727331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50f324-a9f0-4f70-8377-dd7ea81dffb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:40.728194 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e50f324-a9f0-4f70-8377-dd7ea81dffb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:40.730278 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e50f324-a9f0-4f70-8377-dd7ea81dffb2 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:40.837537 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1266/2550] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:32:40 2022] POST /identity/v3/projects => generated 367 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:32:40.842168 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135f646-5be8-48e5-9e15-1404ccdc0326 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:40.858305 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135f646-5be8-48e5-9e15-1404ccdc0326 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:40.974226 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:41.008584 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92aa32-67ac-497d-9fda-1e9e9b4ce252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:41.009300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92aa32-67ac-497d-9fda-1e9e9b4ce252 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:41.009592 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92aa32-67ac-497d-9fda-1e9e9b4ce252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:41.009927 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92aa32-67ac-497d-9fda-1e9e9b4ce252 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:41.017127 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92aa32-67ac-497d-9fda-1e9e9b4ce252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:41.019436 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92aa32-67ac-497d-9fda-1e9e9b4ce252 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:41.180562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1285/2551] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:32:40 2022] POST /identity/v3/users => generated 290 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:32:41.183916 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50f324-a9f0-4f70-8377-dd7ea81dffb2 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:41.200116 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50f324-a9f0-4f70-8377-dd7ea81dffb2 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:41.208143 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571bdca2-7ff2-41d1-bf92-c1c869729a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:41.218691 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bdca2-7ff2-41d1-bf92-c1c869729a2b admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:41.218691 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bdca2-7ff2-41d1-bf92-c1c869729a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:41.218691 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bdca2-7ff2-41d1-bf92-c1c869729a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:41.218691 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571bdca2-7ff2-41d1-bf92-c1c869729a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:41.218691 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571bdca2-7ff2-41d1-bf92-c1c869729a2b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:41.231780 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1267/2552] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:32:41.235927 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92aa32-67ac-497d-9fda-1e9e9b4ce252 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:41.246687 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92aa32-67ac-497d-9fda-1e9e9b4ce252 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:41.252935 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abda394-3d29-4ccc-a0f2-c6c0f616d96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:41.254434 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abda394-3d29-4ccc-a0f2-c6c0f616d96c admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:41.254434 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abda394-3d29-4ccc-a0f2-c6c0f616d96c admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:41.254849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abda394-3d29-4ccc-a0f2-c6c0f616d96c admin admin] PATH_INFO: `/v3/projects/b48b70d8e6c0464d8c9e0980427f69af/users/27854dc16e2440b986d476c1e42fe1d5/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:41.272831 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abda394-3d29-4ccc-a0f2-c6c0f616d96c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b48b70d8e6c0464d8c9e0980427f69af, user_id=27854dc16e2440b986d476c1e42fe1d5, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:41.275807 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abda394-3d29-4ccc-a0f2-c6c0f616d96c admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:41.346248 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1286/2553] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:32:41 2022] PUT /identity/v3/projects/b48b70d8e6c0464d8c9e0980427f69af/users/27854dc16e2440b986d476c1e42fe1d5/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:41.350545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571bdca2-7ff2-41d1-bf92-c1c869729a2b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:41.362449 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571bdca2-7ff2-41d1-bf92-c1c869729a2b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:41.383355 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:41.445430 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8c864-0bf9-4c1d-a0e4-f26f95112b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:41.446094 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8c864-0bf9-4c1d-a0e4-f26f95112b0e admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:41.446434 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8c864-0bf9-4c1d-a0e4-f26f95112b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:41.446717 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8c864-0bf9-4c1d-a0e4-f26f95112b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:41.447492 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8c864-0bf9-4c1d-a0e4-f26f95112b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:41.449496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8c864-0bf9-4c1d-a0e4-f26f95112b0e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:41.465977 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1268/2554] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:32:41.470656 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abda394-3d29-4ccc-a0f2-c6c0f616d96c admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:41.485162 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abda394-3d29-4ccc-a0f2-c6c0f616d96c admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:41.492770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e05078-2273-4864-b6ab-10c5c88e7b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:41.494165 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e05078-2273-4864-b6ab-10c5c88e7b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:41.494607 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e05078-2273-4864-b6ab-10c5c88e7b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:41.495036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e05078-2273-4864-b6ab-10c5c88e7b75 admin admin] PATH_INFO: `/v3/projects/b48b70d8e6c0464d8c9e0980427f69af/users/27854dc16e2440b986d476c1e42fe1d5/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:41.498633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e05078-2273-4864-b6ab-10c5c88e7b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b48b70d8e6c0464d8c9e0980427f69af, user_id=27854dc16e2440b986d476c1e42fe1d5, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:41.502134 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e05078-2273-4864-b6ab-10c5c88e7b75 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:41.528427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1287/2555] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:32:41 2022] PUT /identity/v3/projects/b48b70d8e6c0464d8c9e0980427f69af/users/27854dc16e2440b986d476c1e42fe1d5/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:41.529536 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bedf5-98be-410c-b57e-8de801b33337 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:41.529945 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bedf5-98be-410c-b57e-8de801b33337 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:41.530143 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bedf5-98be-410c-b57e-8de801b33337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:41.566937 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-814bedf5-98be-410c-b57e-8de801b33337 None None] MFA Rules not processed for user `27854dc16e2440b986d476c1e42fe1d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:41.568811 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-814bedf5-98be-410c-b57e-8de801b33337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:41.657482 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1269/2556] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:41 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:41.671152 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e05078-2273-4864-b6ab-10c5c88e7b75 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:41.673087 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-f2e05078-2273-4864-b6ab-10c5c88e7b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:41.749044 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e05078-2273-4864-b6ab-10c5c88e7b75 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:41.753485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a10afa-c7b1-4496-8c74-d601280d983f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:41.754328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a10afa-c7b1-4496-8c74-d601280d983f service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:41.755055 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a10afa-c7b1-4496-8c74-d601280d983f service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:41.755055 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a10afa-c7b1-4496-8c74-d601280d983f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:41.767595 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a10afa-c7b1-4496-8c74-d601280d983f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:41.769341 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a10afa-c7b1-4496-8c74-d601280d983f service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:41.796015 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1288/2557] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:32:41 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:32:42.067067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bedf5-98be-410c-b57e-8de801b33337 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:42.082003 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bedf5-98be-410c-b57e-8de801b33337 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:42.086759 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123b5f8-54f3-4812-b188-3fc6026dca3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:42.088643 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123b5f8-54f3-4812-b188-3fc6026dca3c service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:42.089302 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123b5f8-54f3-4812-b188-3fc6026dca3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:42.089680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123b5f8-54f3-4812-b188-3fc6026dca3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:42.157335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123b5f8-54f3-4812-b188-3fc6026dca3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:42.158816 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123b5f8-54f3-4812-b188-3fc6026dca3c service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:42.168057 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1270/2558] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:32:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:32:47.659454 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a10afa-c7b1-4496-8c74-d601280d983f service cinder] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:47.660898 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-15a10afa-c7b1-4496-8c74-d601280d983f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:47.723367 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a10afa-c7b1-4496-8c74-d601280d983f service cinder] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:47.727245 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea0cae-a3b5-47d4-95af-9351da62b8b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:47.727931 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea0cae-a3b5-47d4-95af-9351da62b8b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:47.728384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea0cae-a3b5-47d4-95af-9351da62b8b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:47.728681 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea0cae-a3b5-47d4-95af-9351da62b8b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:47.730615 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c7ea0cae-a3b5-47d4-95af-9351da62b8b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:47.796081 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:47.798541 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea0cae-a3b5-47d4-95af-9351da62b8b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:47.800098 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea0cae-a3b5-47d4-95af-9351da62b8b4 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:47.810483 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1289/2559] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:32:48.658572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123b5f8-54f3-4812-b188-3fc6026dca3c service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:48.670272 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123b5f8-54f3-4812-b188-3fc6026dca3c service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:48.675283 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d825f5f-87b0-4072-902b-c965a42af345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:48.677286 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d825f5f-87b0-4072-902b-c965a42af345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:48.677286 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d825f5f-87b0-4072-902b-c965a42af345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:48.677286 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d825f5f-87b0-4072-902b-c965a42af345 admin admin] PATH_INFO: `/v3/users/eade64ea4196472ba74304630cc1dcc5` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:48.678227 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d825f5f-87b0-4072-902b-c965a42af345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eade64ea4196472ba74304630cc1dcc5)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:48.680233 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d825f5f-87b0-4072-902b-c965a42af345 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:48.832431 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:48.851115 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-9d825f5f-87b0-4072-902b-c965a42af345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eade64ea4196472ba74304630cc1dcc5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:48.858923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-9d825f5f-87b0-4072-902b-c965a42af345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eade64ea4196472ba74304630cc1dcc5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:48.859758 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-9d825f5f-87b0-4072-902b-c965a42af345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eade64ea4196472ba74304630cc1dcc5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:48.860435 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-9d825f5f-87b0-4072-902b-c965a42af345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eade64ea4196472ba74304630cc1dcc5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:48.874944 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-9d825f5f-87b0-4072-902b-c965a42af345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eade64ea4196472ba74304630cc1dcc5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:48.963223 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1271/2560] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:32:48 2022] DELETE /identity/v3/users/eade64ea4196472ba74304630cc1dcc5 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:48.968044 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a180f6b-710f-460b-9372-639ecb311227 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:48.968871 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a180f6b-710f-460b-9372-639ecb311227 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:48.969152 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a180f6b-710f-460b-9372-639ecb311227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:48.986427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-1a180f6b-710f-460b-9372-639ecb311227 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:48.987901 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-1a180f6b-710f-460b-9372-639ecb311227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:49.055159 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1290/2561] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:49.066357 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d825f5f-87b0-4072-902b-c965a42af345 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:49.067849 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9d825f5f-87b0-4072-902b-c965a42af345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:49.150363 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d825f5f-87b0-4072-902b-c965a42af345 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:49.156733 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbea3d-49d8-4c02-ae93-8f8533291656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:49.157620 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbea3d-49d8-4c02-ae93-8f8533291656 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:49.157974 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbea3d-49d8-4c02-ae93-8f8533291656 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:49.159101 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbea3d-49d8-4c02-ae93-8f8533291656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:49.169702 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dbea3d-49d8-4c02-ae93-8f8533291656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:49.171796 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dbea3d-49d8-4c02-ae93-8f8533291656 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:49.183676 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1272/2562] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:32:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:32:49.906242 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a180f6b-710f-460b-9372-639ecb311227 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:49.909149 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-1a180f6b-710f-460b-9372-639ecb311227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:49.921571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a180f6b-710f-460b-9372-639ecb311227 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:49.927096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a1527-634c-4c89-baad-301fd6b8963d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:49.928260 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a1527-634c-4c89-baad-301fd6b8963d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:49.928606 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a1527-634c-4c89-baad-301fd6b8963d admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:49.929069 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a1527-634c-4c89-baad-301fd6b8963d admin admin] PATH_INFO: `/v3/projects/6a288adcd8f946d2ab97c9bd48d68bad` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:49.930805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a1527-634c-4c89-baad-301fd6b8963d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a288adcd8f946d2ab97c9bd48d68bad)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:49.932806 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a1527-634c-4c89-baad-301fd6b8963d admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:50.067152 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-2e5a1527-634c-4c89-baad-301fd6b8963d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a288adcd8f946d2ab97c9bd48d68bad', 'request_id': 'req-2e5a1527-634c-4c89-baad-301fd6b8963d'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:50.149747 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-2e5a1527-634c-4c89-baad-301fd6b8963d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a288adcd8f946d2ab97c9bd48d68bad', 'request_id': 'req-2e5a1527-634c-4c89-baad-301fd6b8963d'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:50.156953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-2e5a1527-634c-4c89-baad-301fd6b8963d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a288adcd8f946d2ab97c9bd48d68bad', 'request_id': 'req-2e5a1527-634c-4c89-baad-301fd6b8963d'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:50.169589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-2e5a1527-634c-4c89-baad-301fd6b8963d admin admin] The token cache is being invalidate because project 6a288adcd8f946d2ab97c9bd48d68bad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:32:50.169886 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-2e5a1527-634c-4c89-baad-301fd6b8963d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:50.170795 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-2e5a1527-634c-4c89-baad-301fd6b8963d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:50.173664 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1291/2563] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:32:49 2022] DELETE /identity/v3/projects/6a288adcd8f946d2ab97c9bd48d68bad => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:50.178929 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbea3d-49d8-4c02-ae93-8f8533291656 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:50.192333 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbea3d-49d8-4c02-ae93-8f8533291656 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:50.268283 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda33a94-4b7b-4e79-ac94-e1d09f822d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:50.269559 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda33a94-4b7b-4e79-ac94-e1d09f822d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:50.270033 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda33a94-4b7b-4e79-ac94-e1d09f822d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:50.270466 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda33a94-4b7b-4e79-ac94-e1d09f822d93 admin admin] PATH_INFO: `/v3/users/27854dc16e2440b986d476c1e42fe1d5` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:50.272184 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda33a94-4b7b-4e79-ac94-e1d09f822d93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27854dc16e2440b986d476c1e42fe1d5)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:50.274339 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda33a94-4b7b-4e79-ac94-e1d09f822d93 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:50.448126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-cda33a94-4b7b-4e79-ac94-e1d09f822d93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27854dc16e2440b986d476c1e42fe1d5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:50.455165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:50.458345 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-cda33a94-4b7b-4e79-ac94-e1d09f822d93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27854dc16e2440b986d476c1e42fe1d5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:50.459165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-cda33a94-4b7b-4e79-ac94-e1d09f822d93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27854dc16e2440b986d476c1e42fe1d5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:50.459831 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-cda33a94-4b7b-4e79-ac94-e1d09f822d93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27854dc16e2440b986d476c1e42fe1d5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:50.473742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-cda33a94-4b7b-4e79-ac94-e1d09f822d93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27854dc16e2440b986d476c1e42fe1d5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:50.561926 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1273/2564] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:32:50 2022] DELETE /identity/v3/users/27854dc16e2440b986d476c1e42fe1d5 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:51.107242 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a1527-634c-4c89-baad-301fd6b8963d admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:51.109393 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-2e5a1527-634c-4c89-baad-301fd6b8963d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:51.134674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a1527-634c-4c89-baad-301fd6b8963d admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:51.193396 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c88cf-636b-406e-b3ba-d1c26f15f37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:51.194252 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c88cf-636b-406e-b3ba-d1c26f15f37c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:51.194532 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c88cf-636b-406e-b3ba-d1c26f15f37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:51.194805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c88cf-636b-406e-b3ba-d1c26f15f37c admin admin] PATH_INFO: `/v3/projects/b48b70d8e6c0464d8c9e0980427f69af` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:51.196016 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c88cf-636b-406e-b3ba-d1c26f15f37c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b48b70d8e6c0464d8c9e0980427f69af)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:51.197966 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c88cf-636b-406e-b3ba-d1c26f15f37c admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:51.220856 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:51.302712 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-477c88cf-636b-406e-b3ba-d1c26f15f37c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b48b70d8e6c0464d8c9e0980427f69af', 'request_id': 'req-477c88cf-636b-406e-b3ba-d1c26f15f37c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:51.355861 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-477c88cf-636b-406e-b3ba-d1c26f15f37c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b48b70d8e6c0464d8c9e0980427f69af', 'request_id': 'req-477c88cf-636b-406e-b3ba-d1c26f15f37c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:51.363426 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-477c88cf-636b-406e-b3ba-d1c26f15f37c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b48b70d8e6c0464d8c9e0980427f69af', 'request_id': 'req-477c88cf-636b-406e-b3ba-d1c26f15f37c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:51.376746 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-477c88cf-636b-406e-b3ba-d1c26f15f37c admin admin] The token cache is being invalidate because project b48b70d8e6c0464d8c9e0980427f69af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:32:51.377033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-477c88cf-636b-406e-b3ba-d1c26f15f37c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:51.377890 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-477c88cf-636b-406e-b3ba-d1c26f15f37c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:51.379778 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1292/2565] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:32:51 2022] DELETE /identity/v3/projects/b48b70d8e6c0464d8c9e0980427f69af => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:51.384679 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f4044-7fd5-4ef1-b303-19db15333608 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:51.385575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f4044-7fd5-4ef1-b303-19db15333608 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:51.386075 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f4044-7fd5-4ef1-b303-19db15333608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:51.411661 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-105f4044-7fd5-4ef1-b303-19db15333608 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:51.412857 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-105f4044-7fd5-4ef1-b303-19db15333608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:51.494804 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1274/2566] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:51.503280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515541a9-992d-4907-b6d1-33220320f190 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:51.503573 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515541a9-992d-4907-b6d1-33220320f190 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:51.503852 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515541a9-992d-4907-b6d1-33220320f190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:51.529911 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-515541a9-992d-4907-b6d1-33220320f190 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:51.531384 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-515541a9-992d-4907-b6d1-33220320f190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:51.546065 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1293/2567] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:51.547644 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f4044-7fd5-4ef1-b303-19db15333608 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:51.559620 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f4044-7fd5-4ef1-b303-19db15333608 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:51.565599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e8484-c686-4008-a734-c6e10dc033c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:51.566622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e8484-c686-4008-a734-c6e10dc033c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:51.567002 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e8484-c686-4008-a734-c6e10dc033c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:51.567379 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e8484-c686-4008-a734-c6e10dc033c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:51.568307 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e8484-c686-4008-a734-c6e10dc033c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:32:51.568722 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e8484-c686-4008-a734-c6e10dc033c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:51.570469 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e8484-c686-4008-a734-c6e10dc033c7 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:51.586437 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1275/2568] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:32:51.591066 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515541a9-992d-4907-b6d1-33220320f190 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:51.608795 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515541a9-992d-4907-b6d1-33220320f190 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:51.617220 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76cca6-0352-4cda-9669-200c6a1ec00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:51.618576 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76cca6-0352-4cda-9669-200c6a1ec00e admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:51.621215 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76cca6-0352-4cda-9669-200c6a1ec00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:51.621215 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76cca6-0352-4cda-9669-200c6a1ec00e admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:51.621215 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76cca6-0352-4cda-9669-200c6a1ec00e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:51.623284 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76cca6-0352-4cda-9669-200c6a1ec00e admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:51.923049 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1294/2569] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:32:51 2022] POST /identity/v3/projects => generated 377 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:32:51.923905 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e8484-c686-4008-a734-c6e10dc033c7 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:51.939686 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e8484-c686-4008-a734-c6e10dc033c7 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:52.024072 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4649f6b-9970-40a9-9a4e-d970080d199b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:52.024072 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4649f6b-9970-40a9-9a4e-d970080d199b admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:52.024072 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4649f6b-9970-40a9-9a4e-d970080d199b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:52.024072 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4649f6b-9970-40a9-9a4e-d970080d199b admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:52.024632 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4649f6b-9970-40a9-9a4e-d970080d199b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:52.024632 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4649f6b-9970-40a9-9a4e-d970080d199b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:52.136056 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1276/2570] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:32:51 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:32:52.140499 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76cca6-0352-4cda-9669-200c6a1ec00e admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:52.151446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76cca6-0352-4cda-9669-200c6a1ec00e admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:52.162987 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6468c-c364-4672-8408-fc4cba0a5d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:52.163685 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6468c-c364-4672-8408-fc4cba0a5d12 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:52.163966 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6468c-c364-4672-8408-fc4cba0a5d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:52.169294 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6468c-c364-4672-8408-fc4cba0a5d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:52.169294 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6468c-c364-4672-8408-fc4cba0a5d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:52.169294 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6468c-c364-4672-8408-fc4cba0a5d12 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:52.180044 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1295/2571] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:32:52.181994 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4649f6b-9970-40a9-9a4e-d970080d199b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:52.192687 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4649f6b-9970-40a9-9a4e-d970080d199b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:52.197858 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09b4ca-e8d4-4da5-b71b-67c2cba27de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:52.198533 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09b4ca-e8d4-4da5-b71b-67c2cba27de1 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:52.198861 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09b4ca-e8d4-4da5-b71b-67c2cba27de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:52.199121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09b4ca-e8d4-4da5-b71b-67c2cba27de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:52.199850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09b4ca-e8d4-4da5-b71b-67c2cba27de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:52.202068 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09b4ca-e8d4-4da5-b71b-67c2cba27de1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:52.212788 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1277/2572] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:32:52.216929 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6468c-c364-4672-8408-fc4cba0a5d12 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:52.235152 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6468c-c364-4672-8408-fc4cba0a5d12 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:52.240703 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb203d5-e1a7-4dac-b844-4d22793bbeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:52.241714 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb203d5-e1a7-4dac-b844-4d22793bbeec admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:52.242117 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb203d5-e1a7-4dac-b844-4d22793bbeec admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:52.242470 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb203d5-e1a7-4dac-b844-4d22793bbeec admin admin] PATH_INFO: `/v3/projects/5cbb67b3188e44f590064d940f8aa652/users/143e72cb0b1740ebadcc6fb7b99fbbc1/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:52.244853 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09b4ca-e8d4-4da5-b71b-67c2cba27de1 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:52.249679 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3c09b4ca-e8d4-4da5-b71b-67c2cba27de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:52.266975 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09b4ca-e8d4-4da5-b71b-67c2cba27de1 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:52.272718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d70d89-4a92-4c16-b42c-7ade5f2c95a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:52.273886 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d70d89-4a92-4c16-b42c-7ade5f2c95a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:52.274322 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d70d89-4a92-4c16-b42c-7ade5f2c95a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:52.274679 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d70d89-4a92-4c16-b42c-7ade5f2c95a5 admin admin] PATH_INFO: `/v3/users/27c5deeab63347048484a02f6bdbab29` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:52.277580 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb203d5-e1a7-4dac-b844-4d22793bbeec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cbb67b3188e44f590064d940f8aa652, user_id=143e72cb0b1740ebadcc6fb7b99fbbc1, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:52.281299 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb203d5-e1a7-4dac-b844-4d22793bbeec admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:52.294081 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d70d89-4a92-4c16-b42c-7ade5f2c95a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27c5deeab63347048484a02f6bdbab29)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:52.294266 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d70d89-4a92-4c16-b42c-7ade5f2c95a5 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:52.318999 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:52.356927 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1296/2573] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:32:52 2022] PUT /identity/v3/projects/5cbb67b3188e44f590064d940f8aa652/users/143e72cb0b1740ebadcc6fb7b99fbbc1/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:52.369377 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acde64a-90eb-41de-89b3-22984711eedf None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:52.369680 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acde64a-90eb-41de-89b3-22984711eedf None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:52.369963 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acde64a-90eb-41de-89b3-22984711eedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:52.397223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-5acde64a-90eb-41de-89b3-22984711eedf None None] MFA Rules not processed for user `143e72cb0b1740ebadcc6fb7b99fbbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:52.398452 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5acde64a-90eb-41de-89b3-22984711eedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:52.468197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1297/2574] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:32:52.481572 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acde64a-90eb-41de-89b3-22984711eedf None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:52.483639 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5acde64a-90eb-41de-89b3-22984711eedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:52.524309 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:52.529397 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e7d70d89-4a92-4c16-b42c-7ade5f2c95a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27c5deeab63347048484a02f6bdbab29'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:52.537194 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e7d70d89-4a92-4c16-b42c-7ade5f2c95a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27c5deeab63347048484a02f6bdbab29'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:52.537854 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e7d70d89-4a92-4c16-b42c-7ade5f2c95a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27c5deeab63347048484a02f6bdbab29'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:52.538454 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e7d70d89-4a92-4c16-b42c-7ade5f2c95a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27c5deeab63347048484a02f6bdbab29'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:52.542616 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acde64a-90eb-41de-89b3-22984711eedf None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:52.546991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedb010-dbb0-4d14-922d-f8d1567bfec1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '226743f4f93c44c5aef5919a7813bd3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:52.547575 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedb010-dbb0-4d14-922d-f8d1567bfec1 service glance] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:52.547857 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedb010-dbb0-4d14-922d-f8d1567bfec1 service glance] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:52.548165 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedb010-dbb0-4d14-922d-f8d1567bfec1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:52.553934 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-8bedb010-dbb0-4d14-922d-f8d1567bfec1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:52.554143 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e7d70d89-4a92-4c16-b42c-7ade5f2c95a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27c5deeab63347048484a02f6bdbab29'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:52.561977 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedb010-dbb0-4d14-922d-f8d1567bfec1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:52.563452 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedb010-dbb0-4d14-922d-f8d1567bfec1 service glance] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:52.573351 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1298/2575] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:32:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:32:52.688572 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1278/2576] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:32:52 2022] DELETE /identity/v3/users/27c5deeab63347048484a02f6bdbab29 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:52.951349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedb010-dbb0-4d14-922d-f8d1567bfec1 service glance] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:52.953339 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-8bedb010-dbb0-4d14-922d-f8d1567bfec1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:53.024614 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedb010-dbb0-4d14-922d-f8d1567bfec1 service glance] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:53.090441 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec668ec-0684-40e7-8882-94dc44eb04c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:53.093417 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec668ec-0684-40e7-8882-94dc44eb04c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:53.093417 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec668ec-0684-40e7-8882-94dc44eb04c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:53.093417 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec668ec-0684-40e7-8882-94dc44eb04c3 admin admin] PATH_INFO: `/v3/projects/c9ce3a5f432f49269b40f397a7191f5a` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:53.104552 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec668ec-0684-40e7-8882-94dc44eb04c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9ce3a5f432f49269b40f397a7191f5a)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:53.106580 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec668ec-0684-40e7-8882-94dc44eb04c3 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:53.208595 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cec668ec-0684-40e7-8882-94dc44eb04c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9ce3a5f432f49269b40f397a7191f5a', 'request_id': 'req-cec668ec-0684-40e7-8882-94dc44eb04c3'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:53.263681 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cec668ec-0684-40e7-8882-94dc44eb04c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9ce3a5f432f49269b40f397a7191f5a', 'request_id': 'req-cec668ec-0684-40e7-8882-94dc44eb04c3'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:53.270507 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cec668ec-0684-40e7-8882-94dc44eb04c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9ce3a5f432f49269b40f397a7191f5a', 'request_id': 'req-cec668ec-0684-40e7-8882-94dc44eb04c3'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:53.282579 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cec668ec-0684-40e7-8882-94dc44eb04c3 admin admin] The token cache is being invalidate because project c9ce3a5f432f49269b40f397a7191f5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:32:53.282869 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cec668ec-0684-40e7-8882-94dc44eb04c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:53.283517 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cec668ec-0684-40e7-8882-94dc44eb04c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:53.285242 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1299/2577] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:32:52 2022] DELETE /identity/v3/projects/c9ce3a5f432f49269b40f397a7191f5a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:53.290462 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d76d1-9064-4087-950a-08befb669e5c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:53.290590 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d76d1-9064-4087-950a-08befb669e5c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:53.291063 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d76d1-9064-4087-950a-08befb669e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:53.309934 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-a77d76d1-9064-4087-950a-08befb669e5c None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:53.312017 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a77d76d1-9064-4087-950a-08befb669e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:53.379002 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1279/2578] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:53.387548 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd526c9-7df0-40ed-81f1-0d7747797a8f None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:53.387951 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd526c9-7df0-40ed-81f1-0d7747797a8f None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:53.388558 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd526c9-7df0-40ed-81f1-0d7747797a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:53.401965 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:53.408463 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-3bd526c9-7df0-40ed-81f1-0d7747797a8f None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:53.409870 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-3bd526c9-7df0-40ed-81f1-0d7747797a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:53.423096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1300/2579] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:53.424396 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d76d1-9064-4087-950a-08befb669e5c None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:53.434553 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d76d1-9064-4087-950a-08befb669e5c None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:53.439235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c2e41-7956-452e-9c9b-3bb2724c982c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:53.439898 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c2e41-7956-452e-9c9b-3bb2724c982c admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:53.440211 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c2e41-7956-452e-9c9b-3bb2724c982c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:53.440490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c2e41-7956-452e-9c9b-3bb2724c982c admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:53.441487 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c2e41-7956-452e-9c9b-3bb2724c982c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:32:53.441795 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c2e41-7956-452e-9c9b-3bb2724c982c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:53.443393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c2e41-7956-452e-9c9b-3bb2724c982c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:53.458043 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1280/2580] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:32:53.462651 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd526c9-7df0-40ed-81f1-0d7747797a8f None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:53.473248 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd526c9-7df0-40ed-81f1-0d7747797a8f None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:53.478400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1530df-117c-4961-97c0-c19f8cb20442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:53.478743 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1530df-117c-4961-97c0-c19f8cb20442 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:53.479022 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1530df-117c-4961-97c0-c19f8cb20442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:53.479293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1530df-117c-4961-97c0-c19f8cb20442 admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:53.479979 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1530df-117c-4961-97c0-c19f8cb20442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:53.481915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1530df-117c-4961-97c0-c19f8cb20442 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:53.637294 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1301/2581] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:32:53 2022] POST /identity/v3/projects => generated 363 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:32:53.642070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c2e41-7956-452e-9c9b-3bb2724c982c admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:53.652745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c2e41-7956-452e-9c9b-3bb2724c982c admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:53.714823 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6371e-d001-484a-a39b-a4e16887b74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:53.715503 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6371e-d001-484a-a39b-a4e16887b74e admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:53.715791 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6371e-d001-484a-a39b-a4e16887b74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:53.716102 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6371e-d001-484a-a39b-a4e16887b74e admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:53.716809 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6371e-d001-484a-a39b-a4e16887b74e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:53.719400 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6371e-d001-484a-a39b-a4e16887b74e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:53.820065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1281/2582] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:32:53 2022] POST /identity/v3/users => generated 282 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:32:53.824455 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1530df-117c-4961-97c0-c19f8cb20442 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:53.835189 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1530df-117c-4961-97c0-c19f8cb20442 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:53.840267 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bede291-bb10-41df-8227-25fbd1f60ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:53.841203 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bede291-bb10-41df-8227-25fbd1f60ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:53.841492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bede291-bb10-41df-8227-25fbd1f60ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:53.841767 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bede291-bb10-41df-8227-25fbd1f60ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:53.842494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bede291-bb10-41df-8227-25fbd1f60ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:53.844125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bede291-bb10-41df-8227-25fbd1f60ab6 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:53.855156 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1302/2583] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:32:53.860072 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6371e-d001-484a-a39b-a4e16887b74e admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:53.870476 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6371e-d001-484a-a39b-a4e16887b74e admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:53.876683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22fc01-8fc4-49b3-ac99-0146fa8ae375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:53.877344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22fc01-8fc4-49b3-ac99-0146fa8ae375 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:53.877625 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22fc01-8fc4-49b3-ac99-0146fa8ae375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:53.877897 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22fc01-8fc4-49b3-ac99-0146fa8ae375 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:53.878621 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22fc01-8fc4-49b3-ac99-0146fa8ae375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:53.880284 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22fc01-8fc4-49b3-ac99-0146fa8ae375 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:53.891392 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1282/2584] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:32:53.895702 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bede291-bb10-41df-8227-25fbd1f60ab6 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:53.907269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bede291-bb10-41df-8227-25fbd1f60ab6 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:53.912247 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6de5e-568d-4612-9dd5-a376d55a399d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:53.913187 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6de5e-568d-4612-9dd5-a376d55a399d admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:53.913510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6de5e-568d-4612-9dd5-a376d55a399d admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:53.913760 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6de5e-568d-4612-9dd5-a376d55a399d admin admin] PATH_INFO: `/v3/projects/2cce07961e8d4c4db841f81c43c092cb/users/8536069ff450431dab221f512baca880/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:53.930474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6de5e-568d-4612-9dd5-a376d55a399d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cce07961e8d4c4db841f81c43c092cb, user_id=8536069ff450431dab221f512baca880, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:53.933484 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6de5e-568d-4612-9dd5-a376d55a399d admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:54.019199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1303/2585] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:32:53 2022] PUT /identity/v3/projects/2cce07961e8d4c4db841f81c43c092cb/users/8536069ff450431dab221f512baca880/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:54.031326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccf541-cf94-4b18-ba66-9baecf28b8a3 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:54.031620 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccf541-cf94-4b18-ba66-9baecf28b8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:54.032465 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccf541-cf94-4b18-ba66-9baecf28b8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:54.039504 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:54.065506 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-0fccf541-cf94-4b18-ba66-9baecf28b8a3 None None] MFA Rules not processed for user `8536069ff450431dab221f512baca880`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:54.068614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0fccf541-cf94-4b18-ba66-9baecf28b8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:54.145092 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1283/2586] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:54 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:32:54.148547 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6de5e-568d-4612-9dd5-a376d55a399d admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:54.216649 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6de5e-568d-4612-9dd5-a376d55a399d admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:54.223547 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d72927-753c-4229-96f0-47f3492bde72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:54.224586 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d72927-753c-4229-96f0-47f3492bde72 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:54.224871 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d72927-753c-4229-96f0-47f3492bde72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:54.225203 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d72927-753c-4229-96f0-47f3492bde72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:54.226183 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d72927-753c-4229-96f0-47f3492bde72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:54.228186 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d72927-753c-4229-96f0-47f3492bde72 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:54.305898 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1304/2587] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:32:54 2022] POST /identity/v3/projects => generated 365 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:32:54.309838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccf541-cf94-4b18-ba66-9baecf28b8a3 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:54.323117 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccf541-cf94-4b18-ba66-9baecf28b8a3 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:54.387638 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b0186-a1a7-4baf-8ce2-8744469a632c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:54.388416 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b0186-a1a7-4baf-8ce2-8744469a632c admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:54.388721 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b0186-a1a7-4baf-8ce2-8744469a632c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:54.389749 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b0186-a1a7-4baf-8ce2-8744469a632c admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:54.390460 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b0186-a1a7-4baf-8ce2-8744469a632c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:54.392440 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b0186-a1a7-4baf-8ce2-8744469a632c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:54.453530 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1284/2588] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:32:54 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:32:54.457468 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d72927-753c-4229-96f0-47f3492bde72 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:54.471137 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d72927-753c-4229-96f0-47f3492bde72 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:54.475956 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509eb982-d17d-46e2-8a8c-ce066ec4d2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:54.482086 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509eb982-d17d-46e2-8a8c-ce066ec4d2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:54.482086 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509eb982-d17d-46e2-8a8c-ce066ec4d2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:54.482086 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509eb982-d17d-46e2-8a8c-ce066ec4d2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:54.482086 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509eb982-d17d-46e2-8a8c-ce066ec4d2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:54.482086 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509eb982-d17d-46e2-8a8c-ce066ec4d2c6 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:54.491791 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1305/2589] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:32:54.496210 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b0186-a1a7-4baf-8ce2-8744469a632c admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:54.507173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b0186-a1a7-4baf-8ce2-8744469a632c admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:54.512363 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de333d-e3e7-4c76-a5dc-de58066799d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:54.513259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de333d-e3e7-4c76-a5dc-de58066799d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:54.513574 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de333d-e3e7-4c76-a5dc-de58066799d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:54.513848 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de333d-e3e7-4c76-a5dc-de58066799d3 admin admin] PATH_INFO: `/v3/projects/fc6ba89886834153a83839becaf6e4bc/users/5f35837e128f433fb14ca5335d6ff639/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:54.532298 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de333d-e3e7-4c76-a5dc-de58066799d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc6ba89886834153a83839becaf6e4bc, user_id=5f35837e128f433fb14ca5335d6ff639, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:54.535025 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de333d-e3e7-4c76-a5dc-de58066799d3 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:54.648632 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1285/2590] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:32:54 2022] PUT /identity/v3/projects/fc6ba89886834153a83839becaf6e4bc/users/5f35837e128f433fb14ca5335d6ff639/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:54.652910 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509eb982-d17d-46e2-8a8c-ce066ec4d2c6 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:54.663145 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509eb982-d17d-46e2-8a8c-ce066ec4d2c6 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:54.731946 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f6980-8f1f-495b-b826-2dc1a5398a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:54.733694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f6980-8f1f-495b-b826-2dc1a5398a1b admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:54.733895 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f6980-8f1f-495b-b826-2dc1a5398a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:54.734156 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f6980-8f1f-495b-b826-2dc1a5398a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:54.735089 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f6980-8f1f-495b-b826-2dc1a5398a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:54.736926 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f6980-8f1f-495b-b826-2dc1a5398a1b admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:54.748070 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1306/2591] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:32:54.752350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de333d-e3e7-4c76-a5dc-de58066799d3 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:54.763467 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de333d-e3e7-4c76-a5dc-de58066799d3 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:54.769247 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e9cd4-2a55-4e65-8799-0f53851932e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:54.770171 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e9cd4-2a55-4e65-8799-0f53851932e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:54.770451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e9cd4-2a55-4e65-8799-0f53851932e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:54.770752 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e9cd4-2a55-4e65-8799-0f53851932e0 admin admin] PATH_INFO: `/v3/projects/fc6ba89886834153a83839becaf6e4bc/users/5f35837e128f433fb14ca5335d6ff639/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:54.772819 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e9cd4-2a55-4e65-8799-0f53851932e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc6ba89886834153a83839becaf6e4bc, user_id=5f35837e128f433fb14ca5335d6ff639, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:54.775490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e9cd4-2a55-4e65-8799-0f53851932e0 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:54.786991 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1286/2592] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:32:54 2022] PUT /identity/v3/projects/fc6ba89886834153a83839becaf6e4bc/users/5f35837e128f433fb14ca5335d6ff639/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:54.799123 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf420373-046f-47ad-a952-c59ecc63f7df None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:54.799683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf420373-046f-47ad-a952-c59ecc63f7df None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:54.799967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf420373-046f-47ad-a952-c59ecc63f7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:54.829546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:54.832692 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-bf420373-046f-47ad-a952-c59ecc63f7df None None] MFA Rules not processed for user `5f35837e128f433fb14ca5335d6ff639`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:54.833910 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-bf420373-046f-47ad-a952-c59ecc63f7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:54.904067 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1307/2593] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:54 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:54.915497 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e9cd4-2a55-4e65-8799-0f53851932e0 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:54.921151 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-838e9cd4-2a55-4e65-8799-0f53851932e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:54.969548 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:54.981384 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e9cd4-2a55-4e65-8799-0f53851932e0 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:54.985410 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731338b3-03cd-4f47-8b4a-5ec9ee5be22f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:54.986069 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731338b3-03cd-4f47-8b4a-5ec9ee5be22f service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:54.986347 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731338b3-03cd-4f47-8b4a-5ec9ee5be22f service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:54.986617 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731338b3-03cd-4f47-8b4a-5ec9ee5be22f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:54.996463 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731338b3-03cd-4f47-8b4a-5ec9ee5be22f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:54.997906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731338b3-03cd-4f47-8b4a-5ec9ee5be22f service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:55.009787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1287/2594] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:32:54 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:32:55.984221 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf420373-046f-47ad-a952-c59ecc63f7df None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:56.052046 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf420373-046f-47ad-a952-c59ecc63f7df None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:56.057463 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92861325-281f-4eac-87a4-cdb1e77e6e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:56.058359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92861325-281f-4eac-87a4-cdb1e77e6e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:56.058657 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92861325-281f-4eac-87a4-cdb1e77e6e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:56.058915 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92861325-281f-4eac-87a4-cdb1e77e6e6b admin admin] PATH_INFO: `/v3/users/8536069ff450431dab221f512baca880` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:56.060197 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92861325-281f-4eac-87a4-cdb1e77e6e6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8536069ff450431dab221f512baca880)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:56.062695 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92861325-281f-4eac-87a4-cdb1e77e6e6b admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:56.167007 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce231c-e0be-43dc-adc3-b0307e7b4f00 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:56.167584 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce231c-e0be-43dc-adc3-b0307e7b4f00 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:56.167584 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce231c-e0be-43dc-adc3-b0307e7b4f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:56.187978 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-34ce231c-e0be-43dc-adc3-b0307e7b4f00 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:56.189254 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-34ce231c-e0be-43dc-adc3-b0307e7b4f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:56.197982 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1288/2595] 10.222.0.48 () {58 vars in 1016 bytes} [Thu Jun 2 19:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:32:56.213985 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce231c-e0be-43dc-adc3-b0307e7b4f00 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:56.215831 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-34ce231c-e0be-43dc-adc3-b0307e7b4f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:56.282569 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-92861325-281f-4eac-87a4-cdb1e77e6e6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8536069ff450431dab221f512baca880'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:56.294481 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce231c-e0be-43dc-adc3-b0307e7b4f00 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:56.295192 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-92861325-281f-4eac-87a4-cdb1e77e6e6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8536069ff450431dab221f512baca880'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:56.300388 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f8b55-b570-49cc-9066-bcdcc2fa362d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:56.301079 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f8b55-b570-49cc-9066-bcdcc2fa362d service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:56.301363 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f8b55-b570-49cc-9066-bcdcc2fa362d service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:56.301639 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f8b55-b570-49cc-9066-bcdcc2fa362d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:56.302247 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-92861325-281f-4eac-87a4-cdb1e77e6e6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8536069ff450431dab221f512baca880'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:56.302940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-92861325-281f-4eac-87a4-cdb1e77e6e6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8536069ff450431dab221f512baca880'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:56.303558 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-92861325-281f-4eac-87a4-cdb1e77e6e6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8536069ff450431dab221f512baca880'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:56.310564 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f8b55-b570-49cc-9066-bcdcc2fa362d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:56.312200 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f8b55-b570-49cc-9066-bcdcc2fa362d service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:56.323374 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1289/2596] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:32:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:32:56.386596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1308/2597] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:32:55 2022] DELETE /identity/v3/users/8536069ff450431dab221f512baca880 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:56.396986 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ce971-bb81-4ec9-bf95-d33d03e18d9d None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:56.397279 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ce971-bb81-4ec9-bf95-d33d03e18d9d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:56.397559 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ce971-bb81-4ec9-bf95-d33d03e18d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:56.417659 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-fd0ce971-bb81-4ec9-bf95-d33d03e18d9d None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:56.418873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-fd0ce971-bb81-4ec9-bf95-d33d03e18d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:56.489443 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1290/2598] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:56.507069 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92861325-281f-4eac-87a4-cdb1e77e6e6b admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:56.507069 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-92861325-281f-4eac-87a4-cdb1e77e6e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:56.530838 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:56.579041 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92861325-281f-4eac-87a4-cdb1e77e6e6b admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:56.584064 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b02b69-6b9d-4642-9bad-70740ae99401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:56.586795 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b02b69-6b9d-4642-9bad-70740ae99401 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:56.586795 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b02b69-6b9d-4642-9bad-70740ae99401 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:56.586795 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b02b69-6b9d-4642-9bad-70740ae99401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:56.597010 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b02b69-6b9d-4642-9bad-70740ae99401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:56.598305 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b02b69-6b9d-4642-9bad-70740ae99401 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:56.609143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1309/2599] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:32:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:32:57.014256 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ce971-bb81-4ec9-bf95-d33d03e18d9d None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:57.016227 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-fd0ce971-bb81-4ec9-bf95-d33d03e18d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:57.028329 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ce971-bb81-4ec9-bf95-d33d03e18d9d None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:57.034504 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3adce1-2546-4ae5-978a-94fb55d93c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:57.035412 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3adce1-2546-4ae5-978a-94fb55d93c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:57.035693 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3adce1-2546-4ae5-978a-94fb55d93c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:57.035967 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3adce1-2546-4ae5-978a-94fb55d93c58 admin admin] PATH_INFO: `/v3/projects/2cce07961e8d4c4db841f81c43c092cb` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:57.037227 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3adce1-2546-4ae5-978a-94fb55d93c58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cce07961e8d4c4db841f81c43c092cb)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:57.039180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3adce1-2546-4ae5-978a-94fb55d93c58 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:57.139793 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fe3adce1-2546-4ae5-978a-94fb55d93c58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cce07961e8d4c4db841f81c43c092cb', 'request_id': 'req-fe3adce1-2546-4ae5-978a-94fb55d93c58'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:57.147673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fe3adce1-2546-4ae5-978a-94fb55d93c58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cce07961e8d4c4db841f81c43c092cb', 'request_id': 'req-fe3adce1-2546-4ae5-978a-94fb55d93c58'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:57.233634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fe3adce1-2546-4ae5-978a-94fb55d93c58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cce07961e8d4c4db841f81c43c092cb', 'request_id': 'req-fe3adce1-2546-4ae5-978a-94fb55d93c58'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:57.235696 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:57.245862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fe3adce1-2546-4ae5-978a-94fb55d93c58 admin admin] The token cache is being invalidate because project 2cce07961e8d4c4db841f81c43c092cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:32:57.246144 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fe3adce1-2546-4ae5-978a-94fb55d93c58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:57.246799 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fe3adce1-2546-4ae5-978a-94fb55d93c58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:57.248399 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1291/2600] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:32:57 2022] DELETE /identity/v3/projects/2cce07961e8d4c4db841f81c43c092cb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:57.255033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b02b69-6b9d-4642-9bad-70740ae99401 service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:57.264568 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b02b69-6b9d-4642-9bad-70740ae99401 service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:57.330650 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5c7a5-7604-4314-bef2-38072fa191dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:57.331526 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5c7a5-7604-4314-bef2-38072fa191dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:57.331813 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5c7a5-7604-4314-bef2-38072fa191dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:57.332344 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5c7a5-7604-4314-bef2-38072fa191dd admin admin] PATH_INFO: `/v3/users/5f35837e128f433fb14ca5335d6ff639` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:57.333679 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5c7a5-7604-4314-bef2-38072fa191dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f35837e128f433fb14ca5335d6ff639)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:57.335799 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5c7a5-7604-4314-bef2-38072fa191dd admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:57.559767 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-93f5c7a5-7604-4314-bef2-38072fa191dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f35837e128f433fb14ca5335d6ff639'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:57.581429 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-93f5c7a5-7604-4314-bef2-38072fa191dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f35837e128f433fb14ca5335d6ff639'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:57.588928 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-93f5c7a5-7604-4314-bef2-38072fa191dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f35837e128f433fb14ca5335d6ff639'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:57.589661 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-93f5c7a5-7604-4314-bef2-38072fa191dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f35837e128f433fb14ca5335d6ff639'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:57.590259 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-93f5c7a5-7604-4314-bef2-38072fa191dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f35837e128f433fb14ca5335d6ff639'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:57.658030 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1310/2601] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:32:57 2022] DELETE /identity/v3/users/5f35837e128f433fb14ca5335d6ff639 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:58.077263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3adce1-2546-4ae5-978a-94fb55d93c58 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:58.077263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-fe3adce1-2546-4ae5-978a-94fb55d93c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:58.088084 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3adce1-2546-4ae5-978a-94fb55d93c58 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:58.152004 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4ca8d-1200-4f2d-b06d-a8dc852ee8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:58.152910 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4ca8d-1200-4f2d-b06d-a8dc852ee8be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:58.153180 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4ca8d-1200-4f2d-b06d-a8dc852ee8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:58.153458 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4ca8d-1200-4f2d-b06d-a8dc852ee8be admin admin] PATH_INFO: `/v3/projects/fc6ba89886834153a83839becaf6e4bc` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:58.154737 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4ca8d-1200-4f2d-b06d-a8dc852ee8be admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc6ba89886834153a83839becaf6e4bc)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:58.157303 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4ca8d-1200-4f2d-b06d-a8dc852ee8be admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:58.262691 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a6a4ca8d-1200-4f2d-b06d-a8dc852ee8be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc6ba89886834153a83839becaf6e4bc', 'request_id': 'req-a6a4ca8d-1200-4f2d-b06d-a8dc852ee8be'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:58.270002 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a6a4ca8d-1200-4f2d-b06d-a8dc852ee8be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc6ba89886834153a83839becaf6e4bc', 'request_id': 'req-a6a4ca8d-1200-4f2d-b06d-a8dc852ee8be'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:58.361463 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a6a4ca8d-1200-4f2d-b06d-a8dc852ee8be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc6ba89886834153a83839becaf6e4bc', 'request_id': 'req-a6a4ca8d-1200-4f2d-b06d-a8dc852ee8be'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:58.374037 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a6a4ca8d-1200-4f2d-b06d-a8dc852ee8be admin admin] The token cache is being invalidate because project fc6ba89886834153a83839becaf6e4bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:32:58.374307 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a6a4ca8d-1200-4f2d-b06d-a8dc852ee8be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:58.375465 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a6a4ca8d-1200-4f2d-b06d-a8dc852ee8be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:58.377064 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1292/2602] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:32:58 2022] DELETE /identity/v3/projects/fc6ba89886834153a83839becaf6e4bc => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:58.382764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b5f30-2342-4b57-851b-ebe45a62a733 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:58.383256 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b5f30-2342-4b57-851b-ebe45a62a733 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:58.383411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b5f30-2342-4b57-851b-ebe45a62a733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:58.402106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-b86b5f30-2342-4b57-851b-ebe45a62a733 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:58.403301 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-b86b5f30-2342-4b57-851b-ebe45a62a733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:58.438229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:58.464106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1311/2603] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:58.472910 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d3a27-f2ef-4f9f-a6fc-ec4212a51984 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:58.473455 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d3a27-f2ef-4f9f-a6fc-ec4212a51984 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:58.473737 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d3a27-f2ef-4f9f-a6fc-ec4212a51984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:58.493076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-996d3a27-f2ef-4f9f-a6fc-ec4212a51984 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:58.494267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-996d3a27-f2ef-4f9f-a6fc-ec4212a51984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:58.504344 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1293/2604] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:32:58.508888 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b5f30-2342-4b57-851b-ebe45a62a733 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:58.518938 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b5f30-2342-4b57-851b-ebe45a62a733 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:58.524093 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6309fb8-eb66-4494-a450-881143d46a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:58.525595 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6309fb8-eb66-4494-a450-881143d46a96 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:58.526109 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6309fb8-eb66-4494-a450-881143d46a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:58.526394 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6309fb8-eb66-4494-a450-881143d46a96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:58.527172 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6309fb8-eb66-4494-a450-881143d46a96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:32:58.527491 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6309fb8-eb66-4494-a450-881143d46a96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:58.530002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6309fb8-eb66-4494-a450-881143d46a96 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:58.548248 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1312/2605] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:32:58.549526 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d3a27-f2ef-4f9f-a6fc-ec4212a51984 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:58.558745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d3a27-f2ef-4f9f-a6fc-ec4212a51984 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:58.564146 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e521a-6d28-4fbc-8bd0-4db875d07647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:58.564748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e521a-6d28-4fbc-8bd0-4db875d07647 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:58.565044 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e521a-6d28-4fbc-8bd0-4db875d07647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:58.565299 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e521a-6d28-4fbc-8bd0-4db875d07647 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:58.566234 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e521a-6d28-4fbc-8bd0-4db875d07647 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:58.568156 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e521a-6d28-4fbc-8bd0-4db875d07647 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:58.660278 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1294/2606] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:32:58 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:32:58.662937 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6309fb8-eb66-4494-a450-881143d46a96 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:58.673521 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6309fb8-eb66-4494-a450-881143d46a96 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:58.735668 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d0416-63dd-444e-93d1-d5d9d72bebfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:58.736444 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d0416-63dd-444e-93d1-d5d9d72bebfb admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:58.736665 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d0416-63dd-444e-93d1-d5d9d72bebfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:58.736931 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d0416-63dd-444e-93d1-d5d9d72bebfb admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:58.737636 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d0416-63dd-444e-93d1-d5d9d72bebfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:58.739568 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d0416-63dd-444e-93d1-d5d9d72bebfb admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:58.814060 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1313/2607] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:32:58 2022] POST /identity/v3/users => generated 283 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:32:58.818531 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e521a-6d28-4fbc-8bd0-4db875d07647 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:58.828970 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e521a-6d28-4fbc-8bd0-4db875d07647 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:58.833807 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b0c26-25dc-41d8-824b-69206c1ac691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:58.834472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b0c26-25dc-41d8-824b-69206c1ac691 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:58.834754 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b0c26-25dc-41d8-824b-69206c1ac691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:58.835026 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b0c26-25dc-41d8-824b-69206c1ac691 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:58.835748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b0c26-25dc-41d8-824b-69206c1ac691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:58.837387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b0c26-25dc-41d8-824b-69206c1ac691 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:58.849380 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1295/2608] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:32:58.853520 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d0416-63dd-444e-93d1-d5d9d72bebfb admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:58.864291 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d0416-63dd-444e-93d1-d5d9d72bebfb admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:58.869386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45716045-fc0f-4d0e-9f9b-894e50293ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:58.869998 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45716045-fc0f-4d0e-9f9b-894e50293ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:58.870280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45716045-fc0f-4d0e-9f9b-894e50293ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:58.870558 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45716045-fc0f-4d0e-9f9b-894e50293ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:58.871293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45716045-fc0f-4d0e-9f9b-894e50293ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:58.872955 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45716045-fc0f-4d0e-9f9b-894e50293ca9 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:58.884061 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1314/2609] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:32:58.887529 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b0c26-25dc-41d8-824b-69206c1ac691 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:58.897961 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b0c26-25dc-41d8-824b-69206c1ac691 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:58.902673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81e8c8-b5a5-4c45-bab8-ac4a40fc2402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:58.903558 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81e8c8-b5a5-4c45-bab8-ac4a40fc2402 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:58.903835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81e8c8-b5a5-4c45-bab8-ac4a40fc2402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:58.904148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81e8c8-b5a5-4c45-bab8-ac4a40fc2402 admin admin] PATH_INFO: `/v3/projects/42bf117d481442789e6718f0bc900df0/users/e375da74dc17449786eff5ced13dc045/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:58.918972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81e8c8-b5a5-4c45-bab8-ac4a40fc2402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42bf117d481442789e6718f0bc900df0, user_id=e375da74dc17449786eff5ced13dc045, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:58.922275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81e8c8-b5a5-4c45-bab8-ac4a40fc2402 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:58.997600 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1296/2610] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:32:58 2022] PUT /identity/v3/projects/42bf117d481442789e6718f0bc900df0/users/e375da74dc17449786eff5ced13dc045/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:59.009469 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05115b9b-53cd-44fe-8028-4412a6a00fec None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:59.009766 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05115b9b-53cd-44fe-8028-4412a6a00fec None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:59.010054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05115b9b-53cd-44fe-8028-4412a6a00fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:59.039932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-05115b9b-53cd-44fe-8028-4412a6a00fec None None] MFA Rules not processed for user `e375da74dc17449786eff5ced13dc045`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:59.041803 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-05115b9b-53cd-44fe-8028-4412a6a00fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:59.113611 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1315/2611] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:59.118060 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81e8c8-b5a5-4c45-bab8-ac4a40fc2402 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:59.137668 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:59.186540 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81e8c8-b5a5-4c45-bab8-ac4a40fc2402 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:59.192592 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b53551-3828-4b93-8a5d-7ad7a207209a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:59.193277 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b53551-3828-4b93-8a5d-7ad7a207209a admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:59.193560 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b53551-3828-4b93-8a5d-7ad7a207209a admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:59.193981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b53551-3828-4b93-8a5d-7ad7a207209a admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:59.194594 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b53551-3828-4b93-8a5d-7ad7a207209a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:59.196568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b53551-3828-4b93-8a5d-7ad7a207209a admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:59.318396 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1297/2612] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:32:59 2022] POST /identity/v3/projects => generated 365 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:32:59.322928 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05115b9b-53cd-44fe-8028-4412a6a00fec None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:59.336349 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05115b9b-53cd-44fe-8028-4412a6a00fec None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:59.371862 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:59.400510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018c5e0-bb80-447f-b61e-80cb3c3d53be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:59.401202 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018c5e0-bb80-447f-b61e-80cb3c3d53be admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:59.401435 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018c5e0-bb80-447f-b61e-80cb3c3d53be admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:59.401694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018c5e0-bb80-447f-b61e-80cb3c3d53be admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:59.403093 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018c5e0-bb80-447f-b61e-80cb3c3d53be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:59.404437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018c5e0-bb80-447f-b61e-80cb3c3d53be admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:59.510729 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1316/2613] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:32:59 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:32:59.515115 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b53551-3828-4b93-8a5d-7ad7a207209a admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:59.528064 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b53551-3828-4b93-8a5d-7ad7a207209a admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:59.533512 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23dfb01-f8b8-49f3-b33e-6b5e57610011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:59.534171 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dfb01-f8b8-49f3-b33e-6b5e57610011 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:59.534452 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dfb01-f8b8-49f3-b33e-6b5e57610011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:59.534725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dfb01-f8b8-49f3-b33e-6b5e57610011 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:59.535499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23dfb01-f8b8-49f3-b33e-6b5e57610011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:59.537332 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23dfb01-f8b8-49f3-b33e-6b5e57610011 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:59.552583 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1298/2614] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:32:59.554721 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018c5e0-bb80-447f-b61e-80cb3c3d53be admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:59.565489 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018c5e0-bb80-447f-b61e-80cb3c3d53be admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:59.570347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15815d-4812-4f38-bd3a-b16b828914b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:59.571227 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15815d-4812-4f38-bd3a-b16b828914b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:59.571510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15815d-4812-4f38-bd3a-b16b828914b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:59.571785 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15815d-4812-4f38-bd3a-b16b828914b6 admin admin] PATH_INFO: `/v3/projects/6a7c9407d2ca492583748fb6285b29d2/users/33f2f7b70fa4490588e2c214bbb9d6ce/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:59.588114 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15815d-4812-4f38-bd3a-b16b828914b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a7c9407d2ca492583748fb6285b29d2, user_id=33f2f7b70fa4490588e2c214bbb9d6ce, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:59.590814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15815d-4812-4f38-bd3a-b16b828914b6 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:59.664772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1317/2615] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:32:59 2022] PUT /identity/v3/projects/6a7c9407d2ca492583748fb6285b29d2/users/33f2f7b70fa4490588e2c214bbb9d6ce/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:59.672750 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23dfb01-f8b8-49f3-b33e-6b5e57610011 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:59.683614 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23dfb01-f8b8-49f3-b33e-6b5e57610011 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:59.752289 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6ebb9-32db-4bcc-af56-74412d9d6da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:59.753070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6ebb9-32db-4bcc-af56-74412d9d6da5 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:59.753351 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6ebb9-32db-4bcc-af56-74412d9d6da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:59.753628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6ebb9-32db-4bcc-af56-74412d9d6da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:59.754371 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6ebb9-32db-4bcc-af56-74412d9d6da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:59.755977 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6ebb9-32db-4bcc-af56-74412d9d6da5 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:59.766212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1299/2616] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:32:59.771068 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15815d-4812-4f38-bd3a-b16b828914b6 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:59.781650 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15815d-4812-4f38-bd3a-b16b828914b6 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:59.786391 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdf86f-0ce3-4c23-84d5-316c4bbd18d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:59.787278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdf86f-0ce3-4c23-84d5-316c4bbd18d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:59.787559 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdf86f-0ce3-4c23-84d5-316c4bbd18d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:59.787834 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdf86f-0ce3-4c23-84d5-316c4bbd18d0 admin admin] PATH_INFO: `/v3/projects/6a7c9407d2ca492583748fb6285b29d2/users/33f2f7b70fa4490588e2c214bbb9d6ce/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:59.790223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdf86f-0ce3-4c23-84d5-316c4bbd18d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a7c9407d2ca492583748fb6285b29d2, user_id=33f2f7b70fa4490588e2c214bbb9d6ce, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:59.797850 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdf86f-0ce3-4c23-84d5-316c4bbd18d0 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:59.808596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1318/2617] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:32:59 2022] PUT /identity/v3/projects/6a7c9407d2ca492583748fb6285b29d2/users/33f2f7b70fa4490588e2c214bbb9d6ce/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:59.819774 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb71c16-5798-42c1-bfcd-cdd754ca1e20 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:59.820338 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb71c16-5798-42c1-bfcd-cdd754ca1e20 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:59.820674 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb71c16-5798-42c1-bfcd-cdd754ca1e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:59.851711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-9eb71c16-5798-42c1-bfcd-cdd754ca1e20 None None] MFA Rules not processed for user `33f2f7b70fa4490588e2c214bbb9d6ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:59.853115 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9eb71c16-5798-42c1-bfcd-cdd754ca1e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:59.927174 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1300/2618] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:32:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:59.938466 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdf86f-0ce3-4c23-84d5-316c4bbd18d0 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:59.946997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-98bdf86f-0ce3-4c23-84d5-316c4bbd18d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:00.004641 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdf86f-0ce3-4c23-84d5-316c4bbd18d0 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:00.012117 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a936d6e-1304-44f3-9d68-8e167742562b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:00.012789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a936d6e-1304-44f3-9d68-8e167742562b service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:00.013078 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a936d6e-1304-44f3-9d68-8e167742562b service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:00.013359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a936d6e-1304-44f3-9d68-8e167742562b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:00.024215 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a936d6e-1304-44f3-9d68-8e167742562b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:00.027939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a936d6e-1304-44f3-9d68-8e167742562b service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:00.037963 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1319/2619] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:32:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:00.215395 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb71c16-5798-42c1-bfcd-cdd754ca1e20 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:00.216863 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9eb71c16-5798-42c1-bfcd-cdd754ca1e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:00.229499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb71c16-5798-42c1-bfcd-cdd754ca1e20 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:00.233182 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba86ba-e696-48e5-a54b-c84b78f41b5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:00.233850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba86ba-e696-48e5-a54b-c84b78f41b5d service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:00.234132 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba86ba-e696-48e5-a54b-c84b78f41b5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:00.234405 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba86ba-e696-48e5-a54b-c84b78f41b5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:00.243703 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:00.299305 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba86ba-e696-48e5-a54b-c84b78f41b5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:00.300828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba86ba-e696-48e5-a54b-c84b78f41b5d service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:00.311074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1301/2620] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:00 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:00.534383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4d2ac-6e09-46d8-9b1f-1a338ae2e2f9 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:00.534961 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4d2ac-6e09-46d8-9b1f-1a338ae2e2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:00.534961 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4d2ac-6e09-46d8-9b1f-1a338ae2e2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:00.555327 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-b8a4d2ac-6e09-46d8-9b1f-1a338ae2e2f9 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:00.556749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-b8a4d2ac-6e09-46d8-9b1f-1a338ae2e2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:00.617962 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1320/2621] 10.222.0.48 () {58 vars in 1016 bytes} [Thu Jun 2 19:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:33:00.635910 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba86ba-e696-48e5-a54b-c84b78f41b5d service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:00.637369 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-33ba86ba-e696-48e5-a54b-c84b78f41b5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:00.723739 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba86ba-e696-48e5-a54b-c84b78f41b5d service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:00.736696 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ab149-1db1-4168-93b8-48fcbc77c6da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:00.737361 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ab149-1db1-4168-93b8-48fcbc77c6da service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:00.737645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ab149-1db1-4168-93b8-48fcbc77c6da service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:00.737919 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ab149-1db1-4168-93b8-48fcbc77c6da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:00.747558 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ab149-1db1-4168-93b8-48fcbc77c6da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:00.749255 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ab149-1db1-4168-93b8-48fcbc77c6da service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:00.766914 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1302/2622] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:04.494362 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209036c-c81d-41bc-8a55-20610900fe8b None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:04.494888 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209036c-c81d-41bc-8a55-20610900fe8b None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:04.494997 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209036c-c81d-41bc-8a55-20610900fe8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:04.515298 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-8209036c-c81d-41bc-8a55-20610900fe8b None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:04.516568 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-8209036c-c81d-41bc-8a55-20610900fe8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:04.527702 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1321/2623] 10.222.0.48 () {58 vars in 1016 bytes} [Thu Jun 2 19:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:04.553891 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ab149-1db1-4168-93b8-48fcbc77c6da service nova] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:04.555393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ce0ab149-1db1-4168-93b8-48fcbc77c6da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:04.575025 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ab149-1db1-4168-93b8-48fcbc77c6da service nova] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:04.581252 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca395113-e5aa-4359-ba31-9bb06d2ab61d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:04.582382 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca395113-e5aa-4359-ba31-9bb06d2ab61d service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:04.582382 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca395113-e5aa-4359-ba31-9bb06d2ab61d service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:04.582583 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca395113-e5aa-4359-ba31-9bb06d2ab61d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:04.597479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca395113-e5aa-4359-ba31-9bb06d2ab61d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:04.599206 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca395113-e5aa-4359-ba31-9bb06d2ab61d service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:04.609812 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1303/2624] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:08.794831 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5a0ff-c0ac-4bcc-badf-55297b1fd076 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:08.795358 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5a0ff-c0ac-4bcc-badf-55297b1fd076 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:08.795596 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5a0ff-c0ac-4bcc-badf-55297b1fd076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:08.815250 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-19b5a0ff-c0ac-4bcc-badf-55297b1fd076 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:08.816843 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-19b5a0ff-c0ac-4bcc-badf-55297b1fd076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:08.824831 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1322/2625] 10.222.0.48 () {58 vars in 1016 bytes} [Thu Jun 2 19:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:08.859771 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca395113-e5aa-4359-ba31-9bb06d2ab61d service nova] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:08.871635 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca395113-e5aa-4359-ba31-9bb06d2ab61d service nova] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:08.877944 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9f9d9-8090-4ab8-8e81-fb584dd135bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:08.878607 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9f9d9-8090-4ab8-8e81-fb584dd135bf service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:08.878875 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9f9d9-8090-4ab8-8e81-fb584dd135bf service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:08.879213 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9f9d9-8090-4ab8-8e81-fb584dd135bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:08.887886 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9f9d9-8090-4ab8-8e81-fb584dd135bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:08.889578 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9f9d9-8090-4ab8-8e81-fb584dd135bf service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:08.899821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1304/2626] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:09.689241 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5a0ff-c0ac-4bcc-badf-55297b1fd076 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:09.699261 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5a0ff-c0ac-4bcc-badf-55297b1fd076 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:09.703781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34af99-0ccb-4e6c-bd7a-8277216c3548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:09.704671 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34af99-0ccb-4e6c-bd7a-8277216c3548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:09.704951 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34af99-0ccb-4e6c-bd7a-8277216c3548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:09.705227 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34af99-0ccb-4e6c-bd7a-8277216c3548 admin admin] PATH_INFO: `/v3/users/e375da74dc17449786eff5ced13dc045` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:09.706929 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34af99-0ccb-4e6c-bd7a-8277216c3548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e375da74dc17449786eff5ced13dc045)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:09.708882 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34af99-0ccb-4e6c-bd7a-8277216c3548 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:09.721977 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:09.924805 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-9c34af99-0ccb-4e6c-bd7a-8277216c3548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e375da74dc17449786eff5ced13dc045'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:09.937687 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-9c34af99-0ccb-4e6c-bd7a-8277216c3548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e375da74dc17449786eff5ced13dc045'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:09.945297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-9c34af99-0ccb-4e6c-bd7a-8277216c3548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e375da74dc17449786eff5ced13dc045'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:09.946087 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-9c34af99-0ccb-4e6c-bd7a-8277216c3548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e375da74dc17449786eff5ced13dc045'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:09.946790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-9c34af99-0ccb-4e6c-bd7a-8277216c3548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e375da74dc17449786eff5ced13dc045'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:10.011969 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1323/2627] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:33:09 2022] DELETE /identity/v3/users/e375da74dc17449786eff5ced13dc045 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:10.016354 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37d160-595c-400d-a04e-13d3e80c9e28 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:10.016829 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37d160-595c-400d-a04e-13d3e80c9e28 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:10.016950 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37d160-595c-400d-a04e-13d3e80c9e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:10.035019 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-8b37d160-595c-400d-a04e-13d3e80c9e28 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:10.036231 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8b37d160-595c-400d-a04e-13d3e80c9e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:10.096886 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1305/2628] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:10.106620 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34af99-0ccb-4e6c-bd7a-8277216c3548 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:10.108028 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-9c34af99-0ccb-4e6c-bd7a-8277216c3548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:10.166423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34af99-0ccb-4e6c-bd7a-8277216c3548 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:10.170121 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b33b1-7161-4e18-b9b2-a108fed5cf84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:10.170781 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b33b1-7161-4e18-b9b2-a108fed5cf84 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:10.171063 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b33b1-7161-4e18-b9b2-a108fed5cf84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:10.171342 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b33b1-7161-4e18-b9b2-a108fed5cf84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:10.182425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b33b1-7161-4e18-b9b2-a108fed5cf84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:10.183914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b33b1-7161-4e18-b9b2-a108fed5cf84 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:10.194831 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1324/2629] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:10.584894 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37d160-595c-400d-a04e-13d3e80c9e28 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:10.586368 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8b37d160-595c-400d-a04e-13d3e80c9e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:10.599424 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37d160-595c-400d-a04e-13d3e80c9e28 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:10.604181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385da62-7fdb-4d65-a316-3452feaac0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:10.605086 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385da62-7fdb-4d65-a316-3452feaac0db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:10.605334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385da62-7fdb-4d65-a316-3452feaac0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:10.605609 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385da62-7fdb-4d65-a316-3452feaac0db admin admin] PATH_INFO: `/v3/projects/42bf117d481442789e6718f0bc900df0` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:10.607765 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385da62-7fdb-4d65-a316-3452feaac0db admin admin] RBAC: Authorizing `identity:delete_project(project_id=42bf117d481442789e6718f0bc900df0)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:10.609736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385da62-7fdb-4d65-a316-3452feaac0db admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:10.613506 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:10.726975 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2385da62-7fdb-4d65-a316-3452feaac0db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42bf117d481442789e6718f0bc900df0', 'request_id': 'req-2385da62-7fdb-4d65-a316-3452feaac0db'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:10.733229 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2385da62-7fdb-4d65-a316-3452feaac0db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42bf117d481442789e6718f0bc900df0', 'request_id': 'req-2385da62-7fdb-4d65-a316-3452feaac0db'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:10.777937 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2385da62-7fdb-4d65-a316-3452feaac0db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42bf117d481442789e6718f0bc900df0', 'request_id': 'req-2385da62-7fdb-4d65-a316-3452feaac0db'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:10.789649 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2385da62-7fdb-4d65-a316-3452feaac0db admin admin] The token cache is being invalidate because project 42bf117d481442789e6718f0bc900df0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:33:10.801148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2385da62-7fdb-4d65-a316-3452feaac0db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:10.801148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2385da62-7fdb-4d65-a316-3452feaac0db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:10.801148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1306/2630] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:33:10 2022] DELETE /identity/v3/projects/42bf117d481442789e6718f0bc900df0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:10.802076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b33b1-7161-4e18-b9b2-a108fed5cf84 service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:10.807678 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b33b1-7161-4e18-b9b2-a108fed5cf84 service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:10.871735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9937ea-3dfc-4802-8d03-1fc9578871cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:10.872636 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9937ea-3dfc-4802-8d03-1fc9578871cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:10.872951 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9937ea-3dfc-4802-8d03-1fc9578871cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:10.873223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9937ea-3dfc-4802-8d03-1fc9578871cf admin admin] PATH_INFO: `/v3/users/33f2f7b70fa4490588e2c214bbb9d6ce` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:10.874411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9937ea-3dfc-4802-8d03-1fc9578871cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=33f2f7b70fa4490588e2c214bbb9d6ce)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:10.876409 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9937ea-3dfc-4802-8d03-1fc9578871cf admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:11.040303 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:11.050166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-bd9937ea-3dfc-4802-8d03-1fc9578871cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33f2f7b70fa4490588e2c214bbb9d6ce'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:11.065508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-bd9937ea-3dfc-4802-8d03-1fc9578871cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33f2f7b70fa4490588e2c214bbb9d6ce'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:11.072992 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-bd9937ea-3dfc-4802-8d03-1fc9578871cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33f2f7b70fa4490588e2c214bbb9d6ce'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:11.073794 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-bd9937ea-3dfc-4802-8d03-1fc9578871cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33f2f7b70fa4490588e2c214bbb9d6ce'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:11.074400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-bd9937ea-3dfc-4802-8d03-1fc9578871cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33f2f7b70fa4490588e2c214bbb9d6ce'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:11.156040 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1325/2631] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:33:10 2022] DELETE /identity/v3/users/33f2f7b70fa4490588e2c214bbb9d6ce => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:11.587146 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385da62-7fdb-4d65-a316-3452feaac0db admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:11.589594 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2385da62-7fdb-4d65-a316-3452feaac0db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:11.607558 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385da62-7fdb-4d65-a316-3452feaac0db admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:11.680986 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b50a0-b725-4bfa-bd26-f44e2009e87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:11.681767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b50a0-b725-4bfa-bd26-f44e2009e87d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:11.682050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b50a0-b725-4bfa-bd26-f44e2009e87d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:11.682322 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b50a0-b725-4bfa-bd26-f44e2009e87d admin admin] PATH_INFO: `/v3/projects/6a7c9407d2ca492583748fb6285b29d2` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:11.683566 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b50a0-b725-4bfa-bd26-f44e2009e87d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a7c9407d2ca492583748fb6285b29d2)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:11.685524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b50a0-b725-4bfa-bd26-f44e2009e87d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:11.807057 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-8c3b50a0-b725-4bfa-bd26-f44e2009e87d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a7c9407d2ca492583748fb6285b29d2', 'request_id': 'req-8c3b50a0-b725-4bfa-bd26-f44e2009e87d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:11.816640 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-8c3b50a0-b725-4bfa-bd26-f44e2009e87d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a7c9407d2ca492583748fb6285b29d2', 'request_id': 'req-8c3b50a0-b725-4bfa-bd26-f44e2009e87d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:11.870742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-8c3b50a0-b725-4bfa-bd26-f44e2009e87d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a7c9407d2ca492583748fb6285b29d2', 'request_id': 'req-8c3b50a0-b725-4bfa-bd26-f44e2009e87d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:11.883262 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-8c3b50a0-b725-4bfa-bd26-f44e2009e87d admin admin] The token cache is being invalidate because project 6a7c9407d2ca492583748fb6285b29d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:33:11.883556 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-8c3b50a0-b725-4bfa-bd26-f44e2009e87d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:11.884250 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-8c3b50a0-b725-4bfa-bd26-f44e2009e87d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:11.885975 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1307/2632] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:33:11 2022] DELETE /identity/v3/projects/6a7c9407d2ca492583748fb6285b29d2 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:11.890957 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61527101-edd4-4129-80de-15557fe4186f None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:11.891292 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61527101-edd4-4129-80de-15557fe4186f None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:11.891614 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61527101-edd4-4129-80de-15557fe4186f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:11.909675 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-61527101-edd4-4129-80de-15557fe4186f None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:11.911186 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-61527101-edd4-4129-80de-15557fe4186f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:11.972843 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1326/2633] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:33:11.981267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb04e99-4faa-47be-9bda-ec50be5a0fa7 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:11.981562 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb04e99-4faa-47be-9bda-ec50be5a0fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:11.981846 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb04e99-4faa-47be-9bda-ec50be5a0fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:12.001813 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-7bb04e99-4faa-47be-9bda-ec50be5a0fa7 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:12.003629 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7bb04e99-4faa-47be-9bda-ec50be5a0fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:12.013787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1308/2634] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:12.016887 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61527101-edd4-4129-80de-15557fe4186f None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:12.030129 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61527101-edd4-4129-80de-15557fe4186f None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:12.031709 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd91ef-23d1-47ee-836c-d86294b84007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:12.032407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd91ef-23d1-47ee-836c-d86294b84007 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:12.032694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd91ef-23d1-47ee-836c-d86294b84007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:12.032974 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd91ef-23d1-47ee-836c-d86294b84007 admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:12.033825 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd91ef-23d1-47ee-836c-d86294b84007 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:33:12.034138 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd91ef-23d1-47ee-836c-d86294b84007 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:12.035815 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd91ef-23d1-47ee-836c-d86294b84007 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:12.048220 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1327/2635] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:33:12.054245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb04e99-4faa-47be-9bda-ec50be5a0fa7 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:12.069051 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb04e99-4faa-47be-9bda-ec50be5a0fa7 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:12.073873 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094fe4d-d62f-4c08-add7-e5338be86435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:12.074540 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094fe4d-d62f-4c08-add7-e5338be86435 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:12.074824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094fe4d-d62f-4c08-add7-e5338be86435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:12.075101 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094fe4d-d62f-4c08-add7-e5338be86435 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:12.075815 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094fe4d-d62f-4c08-add7-e5338be86435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:12.077861 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094fe4d-d62f-4c08-add7-e5338be86435 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:12.091718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:12.153038 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1309/2636] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:33:12 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:33:12.160428 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd91ef-23d1-47ee-836c-d86294b84007 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:12.170862 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd91ef-23d1-47ee-836c-d86294b84007 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:12.227802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c80be-1812-41b9-9f42-b4b3c7593e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:12.228417 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c80be-1812-41b9-9f42-b4b3c7593e28 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:12.228699 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c80be-1812-41b9-9f42-b4b3c7593e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:12.228973 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c80be-1812-41b9-9f42-b4b3c7593e28 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:12.229652 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c80be-1812-41b9-9f42-b4b3c7593e28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:12.231679 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c80be-1812-41b9-9f42-b4b3c7593e28 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:12.324849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1328/2637] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:33:12 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:33:12.326052 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094fe4d-d62f-4c08-add7-e5338be86435 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:12.337391 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094fe4d-d62f-4c08-add7-e5338be86435 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:12.342437 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63239769-3d96-4d1f-b663-37880aa612ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:12.343101 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63239769-3d96-4d1f-b663-37880aa612ad admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:12.343390 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63239769-3d96-4d1f-b663-37880aa612ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:12.343660 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63239769-3d96-4d1f-b663-37880aa612ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:12.344423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63239769-3d96-4d1f-b663-37880aa612ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:12.346163 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63239769-3d96-4d1f-b663-37880aa612ad admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:12.358140 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1310/2638] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:12.362527 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c80be-1812-41b9-9f42-b4b3c7593e28 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:12.372946 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c80be-1812-41b9-9f42-b4b3c7593e28 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:12.378214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f952d-b482-4ac2-a9f7-2158ff69d680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:12.378888 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f952d-b482-4ac2-a9f7-2158ff69d680 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:12.379171 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f952d-b482-4ac2-a9f7-2158ff69d680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:12.379446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f952d-b482-4ac2-a9f7-2158ff69d680 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:12.380206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f952d-b482-4ac2-a9f7-2158ff69d680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:12.381820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f952d-b482-4ac2-a9f7-2158ff69d680 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:12.392495 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1329/2639] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:33:12.397919 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63239769-3d96-4d1f-b663-37880aa612ad admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:12.407932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63239769-3d96-4d1f-b663-37880aa612ad admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:12.413105 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622f5bc-d43e-42f2-9369-1d913e743574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:12.413967 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622f5bc-d43e-42f2-9369-1d913e743574 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:12.414246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622f5bc-d43e-42f2-9369-1d913e743574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:12.414545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622f5bc-d43e-42f2-9369-1d913e743574 admin admin] PATH_INFO: `/v3/projects/1a50bd4c68c6485d87df5910a060fa6f/users/2b33a516fa424ba99004418a8a2746d1/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:12.429349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622f5bc-d43e-42f2-9369-1d913e743574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a50bd4c68c6485d87df5910a060fa6f, user_id=2b33a516fa424ba99004418a8a2746d1, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:12.431982 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622f5bc-d43e-42f2-9369-1d913e743574 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:12.481362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1311/2640] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:33:12 2022] PUT /identity/v3/projects/1a50bd4c68c6485d87df5910a060fa6f/users/2b33a516fa424ba99004418a8a2746d1/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:12.486474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305e262-08c6-4038-8b6e-969f97c82803 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:12.487424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305e262-08c6-4038-8b6e-969f97c82803 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:12.487656 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305e262-08c6-4038-8b6e-969f97c82803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:12.505766 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-8305e262-08c6-4038-8b6e-969f97c82803 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:12.506968 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-8305e262-08c6-4038-8b6e-969f97c82803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:12.519431 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:12.567964 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1330/2641] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:12.577400 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622f5bc-d43e-42f2-9369-1d913e743574 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:12.579123 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d622f5bc-d43e-42f2-9369-1d913e743574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:12.635761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622f5bc-d43e-42f2-9369-1d913e743574 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:12.639666 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4088a-bab6-4652-8cb5-c46a10610d97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:12.640368 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4088a-bab6-4652-8cb5-c46a10610d97 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:12.640645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4088a-bab6-4652-8cb5-c46a10610d97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:12.640915 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4088a-bab6-4652-8cb5-c46a10610d97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:12.651545 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4088a-bab6-4652-8cb5-c46a10610d97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:12.653119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4088a-bab6-4652-8cb5-c46a10610d97 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:12.663697 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1312/2642] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:12.902908 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305e262-08c6-4038-8b6e-969f97c82803 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:12.906291 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-8305e262-08c6-4038-8b6e-969f97c82803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:12.919046 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305e262-08c6-4038-8b6e-969f97c82803 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:12.924420 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d8425-5a3d-4bce-a698-e724fb498cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:12.937766 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d8425-5a3d-4bce-a698-e724fb498cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:12.937766 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d8425-5a3d-4bce-a698-e724fb498cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:12.937766 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d8425-5a3d-4bce-a698-e724fb498cb9 admin admin] PATH_INFO: `/v3/users/143e72cb0b1740ebadcc6fb7b99fbbc1` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:12.937766 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d8425-5a3d-4bce-a698-e724fb498cb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=143e72cb0b1740ebadcc6fb7b99fbbc1)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:12.937766 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d8425-5a3d-4bce-a698-e724fb498cb9 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:13.147457 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-985d8425-5a3d-4bce-a698-e724fb498cb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '143e72cb0b1740ebadcc6fb7b99fbbc1'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:13.161996 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-985d8425-5a3d-4bce-a698-e724fb498cb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '143e72cb0b1740ebadcc6fb7b99fbbc1'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:13.171212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-985d8425-5a3d-4bce-a698-e724fb498cb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '143e72cb0b1740ebadcc6fb7b99fbbc1'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:13.172235 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-985d8425-5a3d-4bce-a698-e724fb498cb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '143e72cb0b1740ebadcc6fb7b99fbbc1'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:13.172867 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-985d8425-5a3d-4bce-a698-e724fb498cb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '143e72cb0b1740ebadcc6fb7b99fbbc1'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:13.264440 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1331/2643] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:33:12 2022] DELETE /identity/v3/users/143e72cb0b1740ebadcc6fb7b99fbbc1 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:13.271624 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6983da-b878-4c09-a5d4-99177ac0af6c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:13.271917 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6983da-b878-4c09-a5d4-99177ac0af6c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:13.272308 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6983da-b878-4c09-a5d4-99177ac0af6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:13.289803 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-0e6983da-b878-4c09-a5d4-99177ac0af6c None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:13.295383 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0e6983da-b878-4c09-a5d4-99177ac0af6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:13.351133 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1313/2644] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:33:13.361434 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d8425-5a3d-4bce-a698-e724fb498cb9 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:13.363420 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-985d8425-5a3d-4bce-a698-e724fb498cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:13.426125 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d8425-5a3d-4bce-a698-e724fb498cb9 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:13.430164 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec1491-cef4-4785-a965-b624191289bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:13.430863 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec1491-cef4-4785-a965-b624191289bf service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:13.431147 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec1491-cef4-4785-a965-b624191289bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:13.431425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec1491-cef4-4785-a965-b624191289bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:13.442281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec1491-cef4-4785-a965-b624191289bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:13.443745 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec1491-cef4-4785-a965-b624191289bf service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:13.455689 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1332/2645] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:33:13.889874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6983da-b878-4c09-a5d4-99177ac0af6c None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:13.891715 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0e6983da-b878-4c09-a5d4-99177ac0af6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:13.917164 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6983da-b878-4c09-a5d4-99177ac0af6c None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:13.922128 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a17ca8-1475-4fde-b6fc-5c86dc127778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:13.923046 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a17ca8-1475-4fde-b6fc-5c86dc127778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:13.923334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a17ca8-1475-4fde-b6fc-5c86dc127778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:13.923611 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a17ca8-1475-4fde-b6fc-5c86dc127778 admin admin] PATH_INFO: `/v3/projects/5cbb67b3188e44f590064d940f8aa652` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:13.925678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a17ca8-1475-4fde-b6fc-5c86dc127778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cbb67b3188e44f590064d940f8aa652)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:13.927573 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a17ca8-1475-4fde-b6fc-5c86dc127778 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:13.985534 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df057d5-223e-4678-bd80-8d390cc057e4 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:13.985792 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df057d5-223e-4678-bd80-8d390cc057e4 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:13.986756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df057d5-223e-4678-bd80-8d390cc057e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:14.022421 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-2df057d5-223e-4678-bd80-8d390cc057e4 None None] MFA Rules not processed for user `2b33a516fa424ba99004418a8a2746d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:14.023661 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-2df057d5-223e-4678-bd80-8d390cc057e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:14.043169 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-59a17ca8-1475-4fde-b6fc-5c86dc127778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cbb67b3188e44f590064d940f8aa652', 'request_id': 'req-59a17ca8-1475-4fde-b6fc-5c86dc127778'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:14.050757 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-59a17ca8-1475-4fde-b6fc-5c86dc127778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cbb67b3188e44f590064d940f8aa652', 'request_id': 'req-59a17ca8-1475-4fde-b6fc-5c86dc127778'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:14.054634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:14.055377 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:14.120415 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1333/2646] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:33:14.121533 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df057d5-223e-4678-bd80-8d390cc057e4 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:14.123486 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-2df057d5-223e-4678-bd80-8d390cc057e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:14.133380 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-59a17ca8-1475-4fde-b6fc-5c86dc127778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cbb67b3188e44f590064d940f8aa652', 'request_id': 'req-59a17ca8-1475-4fde-b6fc-5c86dc127778'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:14.160325 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-59a17ca8-1475-4fde-b6fc-5c86dc127778 admin admin] The token cache is being invalidate because project 5cbb67b3188e44f590064d940f8aa652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:33:14.160611 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-59a17ca8-1475-4fde-b6fc-5c86dc127778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:14.161280 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-59a17ca8-1475-4fde-b6fc-5c86dc127778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:14.167260 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1314/2647] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:33:13 2022] DELETE /identity/v3/projects/5cbb67b3188e44f590064d940f8aa652 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:14.175547 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc28ab8-d4cb-488d-abb7-cd27330f0a0f None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:14.175721 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc28ab8-d4cb-488d-abb7-cd27330f0a0f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:14.175895 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc28ab8-d4cb-488d-abb7-cd27330f0a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:14.200396 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df057d5-223e-4678-bd80-8d390cc057e4 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:14.204368 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-fdc28ab8-d4cb-488d-abb7-cd27330f0a0f None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:14.206048 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4037ec-7dcf-406a-a444-027cb6c9fa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:14.206343 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-fdc28ab8-d4cb-488d-abb7-cd27330f0a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:14.206717 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4037ec-7dcf-406a-a444-027cb6c9fa04 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:14.207057 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4037ec-7dcf-406a-a444-027cb6c9fa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:14.207361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4037ec-7dcf-406a-a444-027cb6c9fa04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:14.208047 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4037ec-7dcf-406a-a444-027cb6c9fa04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:14.210072 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4037ec-7dcf-406a-a444-027cb6c9fa04 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:14.217630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1315/2648] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:14.226551 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29ccf5-fa29-435e-a2be-9a3a292c71ff None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:14.226915 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29ccf5-fa29-435e-a2be-9a3a292c71ff None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:14.227265 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29ccf5-fa29-435e-a2be-9a3a292c71ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:14.246029 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-de29ccf5-fa29-435e-a2be-9a3a292c71ff None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:14.247307 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-de29ccf5-fa29-435e-a2be-9a3a292c71ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:14.255197 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1316/2649] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:33:14.259416 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29ccf5-fa29-435e-a2be-9a3a292c71ff None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:14.268995 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29ccf5-fa29-435e-a2be-9a3a292c71ff None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:14.273867 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06406955-42cd-414c-a707-82b9548265da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:14.274559 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06406955-42cd-414c-a707-82b9548265da admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:14.274845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06406955-42cd-414c-a707-82b9548265da admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:14.275153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06406955-42cd-414c-a707-82b9548265da admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:14.275875 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06406955-42cd-414c-a707-82b9548265da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:33:14.276203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06406955-42cd-414c-a707-82b9548265da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:14.277861 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06406955-42cd-414c-a707-82b9548265da admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:14.290462 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1317/2650] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:33:14.295017 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06406955-42cd-414c-a707-82b9548265da admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:14.305365 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06406955-42cd-414c-a707-82b9548265da admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:14.311795 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1334/2651] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:33:14 2022] POST /identity/v3/projects => generated 373 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:33:14.313221 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ec001-5a50-4be3-81bc-46bda844566c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:14.313221 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ec001-5a50-4be3-81bc-46bda844566c admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:14.313221 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ec001-5a50-4be3-81bc-46bda844566c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:14.313221 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ec001-5a50-4be3-81bc-46bda844566c admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:14.313606 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ec001-5a50-4be3-81bc-46bda844566c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:14.315352 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ec001-5a50-4be3-81bc-46bda844566c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:14.316406 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4037ec-7dcf-406a-a444-027cb6c9fa04 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:14.318045 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-ce4037ec-7dcf-406a-a444-027cb6c9fa04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:14.383686 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4037ec-7dcf-406a-a444-027cb6c9fa04 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:14.388265 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b476333-244c-4dee-b3ee-1d3059790caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:14.388930 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b476333-244c-4dee-b3ee-1d3059790caf admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:14.389206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b476333-244c-4dee-b3ee-1d3059790caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:14.389475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b476333-244c-4dee-b3ee-1d3059790caf admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:14.390156 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b476333-244c-4dee-b3ee-1d3059790caf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:14.392145 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b476333-244c-4dee-b3ee-1d3059790caf admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:14.407410 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1318/2652] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:33:14 2022] POST /identity/v3/projects => generated 359 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:33:14.412123 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ec001-5a50-4be3-81bc-46bda844566c admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:14.475219 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ec001-5a50-4be3-81bc-46bda844566c admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:14.480888 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cd033-8f74-4013-a2cc-fd415c6cfbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:14.481574 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cd033-8f74-4013-a2cc-fd415c6cfbde admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:14.481994 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cd033-8f74-4013-a2cc-fd415c6cfbde admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:14.482411 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cd033-8f74-4013-a2cc-fd415c6cfbde admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:14.483223 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17cd033-8f74-4013-a2cc-fd415c6cfbde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:14.485509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17cd033-8f74-4013-a2cc-fd415c6cfbde admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:14.490619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1335/2653] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:33:14 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:33:14.492730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b476333-244c-4dee-b3ee-1d3059790caf admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:14.503568 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b476333-244c-4dee-b3ee-1d3059790caf admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:14.508397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3a675-6aa0-4529-94e8-4fc20511ff48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:14.509066 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3a675-6aa0-4529-94e8-4fc20511ff48 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:14.509383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3a675-6aa0-4529-94e8-4fc20511ff48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:14.509619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3a675-6aa0-4529-94e8-4fc20511ff48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:14.510348 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3a675-6aa0-4529-94e8-4fc20511ff48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:14.511988 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3a675-6aa0-4529-94e8-4fc20511ff48 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:14.528032 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1336/2654] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:33:14.531655 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3a675-6aa0-4529-94e8-4fc20511ff48 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:14.542475 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3a675-6aa0-4529-94e8-4fc20511ff48 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:14.547889 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2bc8c-79c4-45d3-9f9e-d7599f453096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:14.548850 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2bc8c-79c4-45d3-9f9e-d7599f453096 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:14.549131 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2bc8c-79c4-45d3-9f9e-d7599f453096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:14.549505 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2bc8c-79c4-45d3-9f9e-d7599f453096 admin admin] PATH_INFO: `/v3/projects/48528e443ed4420ebaa0924bc7e1cbf1/users/2402f28d28e84faa932e5ba325919ff0/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:14.567650 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2bc8c-79c4-45d3-9f9e-d7599f453096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48528e443ed4420ebaa0924bc7e1cbf1, user_id=2402f28d28e84faa932e5ba325919ff0, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:14.570337 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2bc8c-79c4-45d3-9f9e-d7599f453096 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:14.582712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1319/2655] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:33:14 2022] POST /identity/v3/users => generated 280 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:33:14.582712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cd033-8f74-4013-a2cc-fd415c6cfbde admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:14.582712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f17cd033-8f74-4013-a2cc-fd415c6cfbde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:14.639736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cd033-8f74-4013-a2cc-fd415c6cfbde admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:14.644067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24701614-0b74-4a23-acde-0e06912b0bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:14.644713 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24701614-0b74-4a23-acde-0e06912b0bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:14.644997 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24701614-0b74-4a23-acde-0e06912b0bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:14.645275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24701614-0b74-4a23-acde-0e06912b0bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:14.647103 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-24701614-0b74-4a23-acde-0e06912b0bb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:14.686461 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1337/2656] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:33:14 2022] PUT /identity/v3/projects/48528e443ed4420ebaa0924bc7e1cbf1/users/2402f28d28e84faa932e5ba325919ff0/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:33:14.689508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2bc8c-79c4-45d3-9f9e-d7599f453096 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:14.689605 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:14.693175 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:14.720791 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24701614-0b74-4a23-acde-0e06912b0bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:14.722255 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24701614-0b74-4a23-acde-0e06912b0bb2 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:14.733785 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1320/2657] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:14.734613 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24701614-0b74-4a23-acde-0e06912b0bb2 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:14.745456 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24701614-0b74-4a23-acde-0e06912b0bb2 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:14.766055 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2bc8c-79c4-45d3-9f9e-d7599f453096 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:14.772083 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe025c-0d64-4cc2-aa38-8277a8ee6bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:14.772845 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe025c-0d64-4cc2-aa38-8277a8ee6bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:14.773134 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe025c-0d64-4cc2-aa38-8277a8ee6bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:14.773420 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe025c-0d64-4cc2-aa38-8277a8ee6bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:14.774180 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe025c-0d64-4cc2-aa38-8277a8ee6bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:14.775771 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe025c-0d64-4cc2-aa38-8277a8ee6bbd admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:14.786277 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1338/2658] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:14.790146 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe025c-0d64-4cc2-aa38-8277a8ee6bbd admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:14.808308 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe025c-0d64-4cc2-aa38-8277a8ee6bbd admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:14.814748 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115da790-e5dd-4c00-be1b-d4eb7fbfa80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:14.816229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115da790-e5dd-4c00-be1b-d4eb7fbfa80d admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:14.816551 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115da790-e5dd-4c00-be1b-d4eb7fbfa80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:14.816831 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115da790-e5dd-4c00-be1b-d4eb7fbfa80d admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:14.817560 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115da790-e5dd-4c00-be1b-d4eb7fbfa80d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:14.819176 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115da790-e5dd-4c00-be1b-d4eb7fbfa80d admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:14.823212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868cea7-75a7-4328-b129-e9f0ffb220ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:14.824016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868cea7-75a7-4328-b129-e9f0ffb220ec admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:14.824317 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868cea7-75a7-4328-b129-e9f0ffb220ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:14.824594 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868cea7-75a7-4328-b129-e9f0ffb220ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:14.825698 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868cea7-75a7-4328-b129-e9f0ffb220ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:14.827135 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868cea7-75a7-4328-b129-e9f0ffb220ec admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:14.832750 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1339/2659] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:14.836745 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115da790-e5dd-4c00-be1b-d4eb7fbfa80d admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:14.844426 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1321/2660] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:14.846301 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868cea7-75a7-4328-b129-e9f0ffb220ec admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:14.848614 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115da790-e5dd-4c00-be1b-d4eb7fbfa80d admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:14.853820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5ecb6-7d29-4adc-ad05-34606a7fecf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:14.859241 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5ecb6-7d29-4adc-ad05-34606a7fecf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:14.859241 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5ecb6-7d29-4adc-ad05-34606a7fecf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:14.859241 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5ecb6-7d29-4adc-ad05-34606a7fecf9 admin admin] PATH_INFO: `/v3/projects/8799775149774d8d8dd73bda53184adf/users/b4ced0d17fc2449eafa324a0bc714902/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:14.859535 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868cea7-75a7-4328-b129-e9f0ffb220ec admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:14.864569 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9867c53-e475-42c3-9345-88f1dcb5fa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:14.865610 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9867c53-e475-42c3-9345-88f1dcb5fa9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:14.865749 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9867c53-e475-42c3-9345-88f1dcb5fa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:14.866028 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9867c53-e475-42c3-9345-88f1dcb5fa9f admin admin] PATH_INFO: `/v3/projects/48528e443ed4420ebaa0924bc7e1cbf1/users/2402f28d28e84faa932e5ba325919ff0/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:14.868143 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9867c53-e475-42c3-9345-88f1dcb5fa9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=48528e443ed4420ebaa0924bc7e1cbf1, user_id=2402f28d28e84faa932e5ba325919ff0, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:14.870952 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9867c53-e475-42c3-9345-88f1dcb5fa9f admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:14.877360 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5ecb6-7d29-4adc-ad05-34606a7fecf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8799775149774d8d8dd73bda53184adf, user_id=b4ced0d17fc2449eafa324a0bc714902, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:14.880625 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5ecb6-7d29-4adc-ad05-34606a7fecf9 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:14.884097 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1322/2661] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:33:14 2022] PUT /identity/v3/projects/48528e443ed4420ebaa0924bc7e1cbf1/users/2402f28d28e84faa932e5ba325919ff0/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:33:14.955714 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1340/2662] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:33:14 2022] PUT /identity/v3/projects/8799775149774d8d8dd73bda53184adf/users/b4ced0d17fc2449eafa324a0bc714902/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:33:14.966096 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a792e-26b9-420c-807b-9323f0445dea None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:14.966544 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a792e-26b9-420c-807b-9323f0445dea None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:14.966964 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a792e-26b9-420c-807b-9323f0445dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:15.000925 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-288a792e-26b9-420c-807b-9323f0445dea None None] MFA Rules not processed for user `b4ced0d17fc2449eafa324a0bc714902`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:15.002196 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-288a792e-26b9-420c-807b-9323f0445dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:15.075899 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1323/2663] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:14 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:15.108670 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff2ce9-e73d-49fc-b580-e2c502cf41d0 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:15.108945 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff2ce9-e73d-49fc-b580-e2c502cf41d0 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:15.109229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff2ce9-e73d-49fc-b580-e2c502cf41d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:15.118224 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a792e-26b9-420c-807b-9323f0445dea None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:15.119626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-288a792e-26b9-420c-807b-9323f0445dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:15.129061 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-f8ff2ce9-e73d-49fc-b580-e2c502cf41d0 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:15.130279 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-f8ff2ce9-e73d-49fc-b580-e2c502cf41d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:15.173885 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:15.192107 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a792e-26b9-420c-807b-9323f0445dea None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:15.196231 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e2cfc-f470-41a3-a3f0-cf36db52e59a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:15.196881 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e2cfc-f470-41a3-a3f0-cf36db52e59a service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:15.197176 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e2cfc-f470-41a3-a3f0-cf36db52e59a service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:15.197426 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e2cfc-f470-41a3-a3f0-cf36db52e59a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:15.206757 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e2cfc-f470-41a3-a3f0-cf36db52e59a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:15.208275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e2cfc-f470-41a3-a3f0-cf36db52e59a service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:15.217542 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1341/2664] 10.222.0.48 () {58 vars in 1016 bytes} [Thu Jun 2 19:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:15.218639 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1324/2665] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:15 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:33:15.232975 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff2ce9-e73d-49fc-b580-e2c502cf41d0 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:15.233420 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e2cfc-f470-41a3-a3f0-cf36db52e59a service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:15.237362 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-f8ff2ce9-e73d-49fc-b580-e2c502cf41d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:15.245070 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e2cfc-f470-41a3-a3f0-cf36db52e59a service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:15.249828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c1d33-0fff-4979-ba91-22963eeb03f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:15.250717 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c1d33-0fff-4979-ba91-22963eeb03f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:15.250996 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c1d33-0fff-4979-ba91-22963eeb03f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:15.253138 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c1d33-0fff-4979-ba91-22963eeb03f0 admin admin] PATH_INFO: `/v3/users/b4ced0d17fc2449eafa324a0bc714902` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:15.253263 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c1d33-0fff-4979-ba91-22963eeb03f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4ced0d17fc2449eafa324a0bc714902)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:15.255158 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c1d33-0fff-4979-ba91-22963eeb03f0 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:15.319942 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:15.326254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff2ce9-e73d-49fc-b580-e2c502cf41d0 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:15.332118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0496c25-3d05-4f7b-ba04-67ae6148d752 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:15.332785 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0496c25-3d05-4f7b-ba04-67ae6148d752 service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:15.333074 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0496c25-3d05-4f7b-ba04-67ae6148d752 service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:15.333355 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0496c25-3d05-4f7b-ba04-67ae6148d752 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:15.343638 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0496c25-3d05-4f7b-ba04-67ae6148d752 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:15.345684 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0496c25-3d05-4f7b-ba04-67ae6148d752 service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:15.357300 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1342/2666] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:15.426004 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-355c1d33-0fff-4979-ba91-22963eeb03f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4ced0d17fc2449eafa324a0bc714902'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:15.435589 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-355c1d33-0fff-4979-ba91-22963eeb03f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4ced0d17fc2449eafa324a0bc714902'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:15.436597 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-355c1d33-0fff-4979-ba91-22963eeb03f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4ced0d17fc2449eafa324a0bc714902'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:15.437287 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-355c1d33-0fff-4979-ba91-22963eeb03f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4ced0d17fc2449eafa324a0bc714902'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:15.451781 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-355c1d33-0fff-4979-ba91-22963eeb03f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4ced0d17fc2449eafa324a0bc714902'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:15.518896 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1325/2667] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:33:15 2022] DELETE /identity/v3/users/b4ced0d17fc2449eafa324a0bc714902 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:15.523607 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd216244-9f7b-48ab-9897-2e6538df0e1d None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:15.523922 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd216244-9f7b-48ab-9897-2e6538df0e1d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:15.524359 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd216244-9f7b-48ab-9897-2e6538df0e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:15.545228 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-bd216244-9f7b-48ab-9897-2e6538df0e1d None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:15.550021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-bd216244-9f7b-48ab-9897-2e6538df0e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:15.618759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1343/2668] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:15.629044 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c1d33-0fff-4979-ba91-22963eeb03f0 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:15.630710 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-355c1d33-0fff-4979-ba91-22963eeb03f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:15.691203 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c1d33-0fff-4979-ba91-22963eeb03f0 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:15.694950 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b0700-623c-41fe-bb77-8e832b149355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:15.695590 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b0700-623c-41fe-bb77-8e832b149355 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:15.695898 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b0700-623c-41fe-bb77-8e832b149355 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:15.696176 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b0700-623c-41fe-bb77-8e832b149355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:15.705903 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b0700-623c-41fe-bb77-8e832b149355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:15.707393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b0700-623c-41fe-bb77-8e832b149355 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:15.717288 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1326/2669] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:16.076734 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3e217-731c-42d8-b6a3-60e07e711713 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:16.077128 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3e217-731c-42d8-b6a3-60e07e711713 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:16.077394 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3e217-731c-42d8-b6a3-60e07e711713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:16.117436 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-58e3e217-731c-42d8-b6a3-60e07e711713 None None] MFA Rules not processed for user `2402f28d28e84faa932e5ba325919ff0`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:16.118752 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-58e3e217-731c-42d8-b6a3-60e07e711713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:16.135435 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b0700-623c-41fe-bb77-8e832b149355 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:16.138495 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-cf6b0700-623c-41fe-bb77-8e832b149355 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:16.155987 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b0700-623c-41fe-bb77-8e832b149355 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:16.162181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d66c9-0d01-4388-9015-8792f050a93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:16.163412 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d66c9-0d01-4388-9015-8792f050a93b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:16.163878 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d66c9-0d01-4388-9015-8792f050a93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:16.164292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d66c9-0d01-4388-9015-8792f050a93b admin admin] PATH_INFO: `/v3/projects/8799775149774d8d8dd73bda53184adf` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:16.165514 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d66c9-0d01-4388-9015-8792f050a93b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8799775149774d8d8dd73bda53184adf)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:16.167427 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d66c9-0d01-4388-9015-8792f050a93b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:16.220023 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1344/2670] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:16.232460 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b4165-9a6e-4d59-81c7-a3505ff62951 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:16.232666 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b4165-9a6e-4d59-81c7-a3505ff62951 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:16.232909 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b4165-9a6e-4d59-81c7-a3505ff62951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:16.251650 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-2c7b4165-9a6e-4d59-81c7-a3505ff62951 None None] MFA Rules not processed for user `2b33a516fa424ba99004418a8a2746d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:16.253448 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-2c7b4165-9a6e-4d59-81c7-a3505ff62951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:16.293617 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-be8d66c9-0d01-4388-9015-8792f050a93b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8799775149774d8d8dd73bda53184adf', 'request_id': 'req-be8d66c9-0d01-4388-9015-8792f050a93b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:16.295587 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:16.300516 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-be8d66c9-0d01-4388-9015-8792f050a93b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8799775149774d8d8dd73bda53184adf', 'request_id': 'req-be8d66c9-0d01-4388-9015-8792f050a93b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:16.311448 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1345/2671] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:33:16.323138 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b4165-9a6e-4d59-81c7-a3505ff62951 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:16.324547 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-2c7b4165-9a6e-4d59-81c7-a3505ff62951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:16.346674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:16.383053 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-be8d66c9-0d01-4388-9015-8792f050a93b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8799775149774d8d8dd73bda53184adf', 'request_id': 'req-be8d66c9-0d01-4388-9015-8792f050a93b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:16.394988 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-be8d66c9-0d01-4388-9015-8792f050a93b admin admin] The token cache is being invalidate because project 8799775149774d8d8dd73bda53184adf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:33:16.395472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-be8d66c9-0d01-4388-9015-8792f050a93b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:16.396141 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-be8d66c9-0d01-4388-9015-8792f050a93b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:16.397784 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1327/2672] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:33:16 2022] DELETE /identity/v3/projects/8799775149774d8d8dd73bda53184adf => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:33:16.401478 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b4165-9a6e-4d59-81c7-a3505ff62951 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:16.403065 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbddad-9e9f-42d5-b24f-677db4d9dd24 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:16.403422 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbddad-9e9f-42d5-b24f-677db4d9dd24 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:16.403799 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbddad-9e9f-42d5-b24f-677db4d9dd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:16.423151 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-d3dbddad-9e9f-42d5-b24f-677db4d9dd24 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:16.428402 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d3dbddad-9e9f-42d5-b24f-677db4d9dd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:16.469060 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcef75-cc63-4dde-b883-675d6379478d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '575f61ef70314f86b5d9dad3ba1b3aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:16.469771 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcef75-cc63-4dde-b883-675d6379478d service nova] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:16.470053 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcef75-cc63-4dde-b883-675d6379478d service nova] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:16.470328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcef75-cc63-4dde-b883-675d6379478d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:16.472906 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-10dcef75-cc63-4dde-b883-675d6379478d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:16.491422 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1328/2673] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:33:16.542668 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcef75-cc63-4dde-b883-675d6379478d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:16.544331 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcef75-cc63-4dde-b883-675d6379478d service nova] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:16.554779 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1346/2674] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:16 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:33:16.555004 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e59cf-a01b-427f-a3ed-8599c9389039 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:16.555111 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e59cf-a01b-427f-a3ed-8599c9389039 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:16.555334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e59cf-a01b-427f-a3ed-8599c9389039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:16.574430 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-127e59cf-a01b-427f-a3ed-8599c9389039 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:16.575904 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-127e59cf-a01b-427f-a3ed-8599c9389039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:16.584570 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1329/2675] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:33:16.586563 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcef75-cc63-4dde-b883-675d6379478d service nova] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:16.587981 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-10dcef75-cc63-4dde-b883-675d6379478d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:16.588813 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e59cf-a01b-427f-a3ed-8599c9389039 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:16.598527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e59cf-a01b-427f-a3ed-8599c9389039 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:16.603903 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7c53f-8125-4bfb-926a-6c291486c716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:16.604603 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7c53f-8125-4bfb-926a-6c291486c716 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:16.604876 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7c53f-8125-4bfb-926a-6c291486c716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:16.605149 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7c53f-8125-4bfb-926a-6c291486c716 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:16.605881 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7c53f-8125-4bfb-926a-6c291486c716 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:33:16.606181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7c53f-8125-4bfb-926a-6c291486c716 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:16.607796 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7c53f-8125-4bfb-926a-6c291486c716 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:16.623129 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1330/2676] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:33:16.624123 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7c53f-8125-4bfb-926a-6c291486c716 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:16.633929 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7c53f-8125-4bfb-926a-6c291486c716 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:16.639794 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d41b6-8a4c-4b38-a8e0-ac95c8128638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:16.640494 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d41b6-8a4c-4b38-a8e0-ac95c8128638 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:16.640779 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d41b6-8a4c-4b38-a8e0-ac95c8128638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:16.641059 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d41b6-8a4c-4b38-a8e0-ac95c8128638 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:16.641783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d41b6-8a4c-4b38-a8e0-ac95c8128638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:16.644237 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d41b6-8a4c-4b38-a8e0-ac95c8128638 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:16.647062 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcef75-cc63-4dde-b883-675d6379478d service nova] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:16.651390 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373496d-68fe-427b-992a-f9e3c5301277 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '226743f4f93c44c5aef5919a7813bd3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:16.652431 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373496d-68fe-427b-992a-f9e3c5301277 service glance] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:16.652871 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373496d-68fe-427b-992a-f9e3c5301277 service glance] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:16.653799 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373496d-68fe-427b-992a-f9e3c5301277 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:16.656060 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-2373496d-68fe-427b-992a-f9e3c5301277 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:16.672189 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373496d-68fe-427b-992a-f9e3c5301277 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:16.673725 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373496d-68fe-427b-992a-f9e3c5301277 service glance] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:16.679387 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:16.686882 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1347/2677] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:16.730765 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1331/2678] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:33:16 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:33:16.733573 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373496d-68fe-427b-992a-f9e3c5301277 service glance] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:16.744834 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373496d-68fe-427b-992a-f9e3c5301277 service glance] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:16.816990 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b229d5-afa9-466e-94a3-98457c26e222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:16.818453 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b229d5-afa9-466e-94a3-98457c26e222 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:16.818740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b229d5-afa9-466e-94a3-98457c26e222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:16.819021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b229d5-afa9-466e-94a3-98457c26e222 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:16.820360 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b229d5-afa9-466e-94a3-98457c26e222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:16.822973 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b229d5-afa9-466e-94a3-98457c26e222 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:16.910823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1348/2679] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:33:16 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:33:16.914725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d41b6-8a4c-4b38-a8e0-ac95c8128638 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:16.925962 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d41b6-8a4c-4b38-a8e0-ac95c8128638 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:16.931134 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1f776-210a-46ca-ad1b-7203abb24761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:16.931816 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1f776-210a-46ca-ad1b-7203abb24761 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:16.932132 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1f776-210a-46ca-ad1b-7203abb24761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:16.932463 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1f776-210a-46ca-ad1b-7203abb24761 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:16.933419 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1f776-210a-46ca-ad1b-7203abb24761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:16.935090 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1f776-210a-46ca-ad1b-7203abb24761 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:16.947452 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1332/2680] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:16.951226 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b229d5-afa9-466e-94a3-98457c26e222 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:16.962866 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b229d5-afa9-466e-94a3-98457c26e222 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:16.968272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abfb145-6918-4251-af08-763a5d16951b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:16.969272 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfb145-6918-4251-af08-763a5d16951b admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:16.969391 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfb145-6918-4251-af08-763a5d16951b admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:16.969647 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfb145-6918-4251-af08-763a5d16951b admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:16.971073 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abfb145-6918-4251-af08-763a5d16951b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:16.972882 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abfb145-6918-4251-af08-763a5d16951b admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:16.987001 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1349/2681] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:16.995325 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1f776-210a-46ca-ad1b-7203abb24761 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:17.008787 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1f776-210a-46ca-ad1b-7203abb24761 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:17.014137 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdfb07a-1365-4a7c-b91b-5291c998f1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:17.015413 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfb07a-1365-4a7c-b91b-5291c998f1bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:17.015762 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfb07a-1365-4a7c-b91b-5291c998f1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:17.016147 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfb07a-1365-4a7c-b91b-5291c998f1bd admin admin] PATH_INFO: `/v3/projects/c6042b6192d349d0843c7d954daf6006/users/8338ed69103344aa834b120d09de4e8b/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:17.035699 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdfb07a-1365-4a7c-b91b-5291c998f1bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6042b6192d349d0843c7d954daf6006, user_id=8338ed69103344aa834b120d09de4e8b, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:17.039641 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdfb07a-1365-4a7c-b91b-5291c998f1bd admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:17.160838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1333/2682] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:33:16 2022] PUT /identity/v3/projects/c6042b6192d349d0843c7d954daf6006/users/8338ed69103344aa834b120d09de4e8b/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:33:17.162219 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9947b1c-5f9d-4f48-a2eb-38cc2838fc15 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:17.162510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9947b1c-5f9d-4f48-a2eb-38cc2838fc15 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:17.162790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9947b1c-5f9d-4f48-a2eb-38cc2838fc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:17.196214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-e9947b1c-5f9d-4f48-a2eb-38cc2838fc15 None None] MFA Rules not processed for user `8338ed69103344aa834b120d09de4e8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:17.198040 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-e9947b1c-5f9d-4f48-a2eb-38cc2838fc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:17.290679 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1350/2683] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:33:17.295460 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdfb07a-1365-4a7c-b91b-5291c998f1bd admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:17.388756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdfb07a-1365-4a7c-b91b-5291c998f1bd admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:17.403462 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdfeea-4d1e-471f-b766-424232f17e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:17.404183 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdfeea-4d1e-471f-b766-424232f17e1d admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:17.404467 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdfeea-4d1e-471f-b766-424232f17e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:17.405104 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdfeea-4d1e-471f-b766-424232f17e1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:17.405688 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcdfeea-4d1e-471f-b766-424232f17e1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:17.408073 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcdfeea-4d1e-471f-b766-424232f17e1d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:17.420740 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:17.494838 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1334/2684] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:33:17 2022] POST /identity/v3/projects => generated 375 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:33:17.498765 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9947b1c-5f9d-4f48-a2eb-38cc2838fc15 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:17.510790 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9947b1c-5f9d-4f48-a2eb-38cc2838fc15 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:17.574213 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849f84d-7bea-4a79-b97f-7b9a66274c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:17.574822 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849f84d-7bea-4a79-b97f-7b9a66274c02 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:17.575107 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849f84d-7bea-4a79-b97f-7b9a66274c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:17.575386 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849f84d-7bea-4a79-b97f-7b9a66274c02 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:17.576208 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849f84d-7bea-4a79-b97f-7b9a66274c02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:17.578206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849f84d-7bea-4a79-b97f-7b9a66274c02 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:17.589424 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:17.704696 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1351/2685] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:33:17 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:33:17.708845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdfeea-4d1e-471f-b766-424232f17e1d admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:17.739448 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdfeea-4d1e-471f-b766-424232f17e1d admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:17.752142 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dfabd-78da-4233-a283-07bcff7ac7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:17.753013 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dfabd-78da-4233-a283-07bcff7ac7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:17.753330 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dfabd-78da-4233-a283-07bcff7ac7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:17.754140 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dfabd-78da-4233-a283-07bcff7ac7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:17.754897 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dfabd-78da-4233-a283-07bcff7ac7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:17.757379 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dfabd-78da-4233-a283-07bcff7ac7c4 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:17.773096 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1335/2686] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:17.777106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849f84d-7bea-4a79-b97f-7b9a66274c02 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:17.797510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849f84d-7bea-4a79-b97f-7b9a66274c02 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:17.805564 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbba92-f4e1-4323-86f6-39607bacc60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:17.806593 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbba92-f4e1-4323-86f6-39607bacc60c admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:17.806756 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbba92-f4e1-4323-86f6-39607bacc60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:17.807154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbba92-f4e1-4323-86f6-39607bacc60c admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:17.808090 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbba92-f4e1-4323-86f6-39607bacc60c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:17.810192 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbba92-f4e1-4323-86f6-39607bacc60c admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:17.830642 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1352/2687] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:17.830833 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dfabd-78da-4233-a283-07bcff7ac7c4 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:17.840111 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dfabd-78da-4233-a283-07bcff7ac7c4 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:17.846689 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfb042-1138-455b-ad67-b919a94ac3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:17.847731 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfb042-1138-455b-ad67-b919a94ac3ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:17.848026 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfb042-1138-455b-ad67-b919a94ac3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:17.854687 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfb042-1138-455b-ad67-b919a94ac3ee admin admin] PATH_INFO: `/v3/projects/3d96706fd08a4e3bb56626ab95431e69/users/ecb456bb1f584f82b65b73db737607a3/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:17.872211 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfb042-1138-455b-ad67-b919a94ac3ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d96706fd08a4e3bb56626ab95431e69, user_id=ecb456bb1f584f82b65b73db737607a3, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:17.875013 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfb042-1138-455b-ad67-b919a94ac3ee admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:17.973550 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1336/2688] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:33:17 2022] PUT /identity/v3/projects/3d96706fd08a4e3bb56626ab95431e69/users/ecb456bb1f584f82b65b73db737607a3/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:33:17.983765 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49a548-7413-434d-9604-103d8bd66404 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:17.984236 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49a548-7413-434d-9604-103d8bd66404 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:17.984534 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49a548-7413-434d-9604-103d8bd66404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:18.013447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-5b49a548-7413-434d-9604-103d8bd66404 None None] MFA Rules not processed for user `ecb456bb1f584f82b65b73db737607a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:18.014696 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5b49a548-7413-434d-9604-103d8bd66404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:18.118187 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1353/2689] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:18.123703 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfb042-1138-455b-ad67-b919a94ac3ee admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:18.198194 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfb042-1138-455b-ad67-b919a94ac3ee admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:18.203510 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c4216-2c1a-4ad7-a0cc-8db807030faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:18.210887 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c4216-2c1a-4ad7-a0cc-8db807030faf admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:18.210887 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c4216-2c1a-4ad7-a0cc-8db807030faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:18.210887 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c4216-2c1a-4ad7-a0cc-8db807030faf admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:18.210887 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c4216-2c1a-4ad7-a0cc-8db807030faf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:18.210887 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c4216-2c1a-4ad7-a0cc-8db807030faf admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:18.326580 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1337/2690] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:33:18 2022] POST /identity/v3/projects => generated 377 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:33:18.327817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49a548-7413-434d-9604-103d8bd66404 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:18.339950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49a548-7413-434d-9604-103d8bd66404 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:18.410366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bf4cc-d330-4c14-b396-ea3a80c84e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:18.411104 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bf4cc-d330-4c14-b396-ea3a80c84e21 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:18.411389 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bf4cc-d330-4c14-b396-ea3a80c84e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:18.411668 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bf4cc-d330-4c14-b396-ea3a80c84e21 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:18.412426 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547bf4cc-d330-4c14-b396-ea3a80c84e21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:18.414375 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547bf4cc-d330-4c14-b396-ea3a80c84e21 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:18.508097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1354/2691] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:33:18 2022] POST /identity/v3/users => generated 295 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:33:18.509521 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c4216-2c1a-4ad7-a0cc-8db807030faf admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:18.526760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c4216-2c1a-4ad7-a0cc-8db807030faf admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:18.532128 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4d3c3-5ca3-4554-8b62-054b978bef77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:18.546311 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4d3c3-5ca3-4554-8b62-054b978bef77 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:18.546311 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4d3c3-5ca3-4554-8b62-054b978bef77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:18.546311 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4d3c3-5ca3-4554-8b62-054b978bef77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:18.546311 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4d3c3-5ca3-4554-8b62-054b978bef77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:18.546311 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4d3c3-5ca3-4554-8b62-054b978bef77 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:18.549242 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1338/2692] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:18.552571 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bf4cc-d330-4c14-b396-ea3a80c84e21 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:18.564618 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bf4cc-d330-4c14-b396-ea3a80c84e21 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:18.570555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b35fbf-45ef-4830-985e-36aa7b2fe0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:18.571454 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b35fbf-45ef-4830-985e-36aa7b2fe0ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:18.571734 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b35fbf-45ef-4830-985e-36aa7b2fe0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:18.572025 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b35fbf-45ef-4830-985e-36aa7b2fe0ff admin admin] PATH_INFO: `/v3/projects/5732ec8252ab4d48ad6a87867821913c/users/8ee83f5fcbd64387a5814c61e844a2a2/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:18.590133 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b35fbf-45ef-4830-985e-36aa7b2fe0ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=5732ec8252ab4d48ad6a87867821913c, user_id=8ee83f5fcbd64387a5814c61e844a2a2, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:18.593156 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b35fbf-45ef-4830-985e-36aa7b2fe0ff admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:18.710297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1355/2693] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:33:18 2022] PUT /identity/v3/projects/5732ec8252ab4d48ad6a87867821913c/users/8ee83f5fcbd64387a5814c61e844a2a2/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:33:18.714262 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4d3c3-5ca3-4554-8b62-054b978bef77 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:18.727584 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4d3c3-5ca3-4554-8b62-054b978bef77 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:18.787626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624798c-5935-45eb-8d30-325b78c89902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:18.788343 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624798c-5935-45eb-8d30-325b78c89902 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:18.788622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624798c-5935-45eb-8d30-325b78c89902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:18.788893 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624798c-5935-45eb-8d30-325b78c89902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:18.789620 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624798c-5935-45eb-8d30-325b78c89902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:18.791217 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624798c-5935-45eb-8d30-325b78c89902 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:18.803168 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1339/2694] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:18.813034 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b35fbf-45ef-4830-985e-36aa7b2fe0ff admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:18.825010 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b35fbf-45ef-4830-985e-36aa7b2fe0ff admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:18.830035 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239a676-c1e1-42b2-8caa-e3188b14ab03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:18.831111 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239a676-c1e1-42b2-8caa-e3188b14ab03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:18.831464 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239a676-c1e1-42b2-8caa-e3188b14ab03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:18.831820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239a676-c1e1-42b2-8caa-e3188b14ab03 admin admin] PATH_INFO: `/v3/projects/5732ec8252ab4d48ad6a87867821913c/users/8ee83f5fcbd64387a5814c61e844a2a2/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:18.833896 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239a676-c1e1-42b2-8caa-e3188b14ab03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5732ec8252ab4d48ad6a87867821913c, user_id=8ee83f5fcbd64387a5814c61e844a2a2, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:18.836640 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239a676-c1e1-42b2-8caa-e3188b14ab03 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:18.848117 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1356/2695] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:33:18 2022] PUT /identity/v3/projects/5732ec8252ab4d48ad6a87867821913c/users/8ee83f5fcbd64387a5814c61e844a2a2/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:18.859462 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567fe42-12b8-4ac6-9f20-42338381b2dc None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:18.859750 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567fe42-12b8-4ac6-9f20-42338381b2dc None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:18.860111 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567fe42-12b8-4ac6-9f20-42338381b2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:18.890356 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f567fe42-12b8-4ac6-9f20-42338381b2dc None None] MFA Rules not processed for user `8ee83f5fcbd64387a5814c61e844a2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:18.891615 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f567fe42-12b8-4ac6-9f20-42338381b2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:18.904970 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:18.988458 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1340/2696] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:18.996040 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239a676-c1e1-42b2-8caa-e3188b14ab03 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:19.004439 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-0239a676-c1e1-42b2-8caa-e3188b14ab03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:19.058814 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:19.088619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239a676-c1e1-42b2-8caa-e3188b14ab03 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:19.092810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a8333-d5b4-490e-87d2-21e7d93682aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:19.093474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a8333-d5b4-490e-87d2-21e7d93682aa service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:19.093757 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a8333-d5b4-490e-87d2-21e7d93682aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:19.094034 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a8333-d5b4-490e-87d2-21e7d93682aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:19.166948 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a8333-d5b4-490e-87d2-21e7d93682aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:19.168453 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a8333-d5b4-490e-87d2-21e7d93682aa service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:19.184106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1357/2697] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:21.229363 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567fe42-12b8-4ac6-9f20-42338381b2dc None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:21.230819 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f567fe42-12b8-4ac6-9f20-42338381b2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:21.243708 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567fe42-12b8-4ac6-9f20-42338381b2dc None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:21.247834 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24697348-97e8-40e8-9581-e692bb54b70c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:21.248605 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24697348-97e8-40e8-9581-e692bb54b70c service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:21.248887 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24697348-97e8-40e8-9581-e692bb54b70c service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:21.249160 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24697348-97e8-40e8-9581-e692bb54b70c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:21.322551 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24697348-97e8-40e8-9581-e692bb54b70c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:21.324014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24697348-97e8-40e8-9581-e692bb54b70c service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:21.335913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1341/2698] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:21.524416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a8333-d5b4-490e-87d2-21e7d93682aa service cinder] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:21.526105 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-760a8333-d5b4-490e-87d2-21e7d93682aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:21.586864 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a8333-d5b4-490e-87d2-21e7d93682aa service cinder] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:21.590595 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4d411-2249-4ed1-bc71-58e5ca89f83f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:21.591276 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4d411-2249-4ed1-bc71-58e5ca89f83f service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:21.591553 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4d411-2249-4ed1-bc71-58e5ca89f83f service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:21.591823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4d411-2249-4ed1-bc71-58e5ca89f83f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:21.593759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-25a4d411-2249-4ed1-bc71-58e5ca89f83f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:21.603661 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4d411-2249-4ed1-bc71-58e5ca89f83f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:21.605161 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4d411-2249-4ed1-bc71-58e5ca89f83f service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:21.614029 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1358/2699] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:23.158556 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24697348-97e8-40e8-9581-e692bb54b70c service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:23.167591 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24697348-97e8-40e8-9581-e692bb54b70c service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:23.172162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eeba9e-eabc-41c4-a040-ee344fa6ea79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:23.172805 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeba9e-eabc-41c4-a040-ee344fa6ea79 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:23.173084 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeba9e-eabc-41c4-a040-ee344fa6ea79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:23.173355 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeba9e-eabc-41c4-a040-ee344fa6ea79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:23.196843 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eeba9e-eabc-41c4-a040-ee344fa6ea79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:23.196843 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eeba9e-eabc-41c4-a040-ee344fa6ea79 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:23.203300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1342/2700] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:23.241541 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4d411-2249-4ed1-bc71-58e5ca89f83f service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:23.250143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4d411-2249-4ed1-bc71-58e5ca89f83f service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:23.255008 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfacbd-4f3e-473c-b276-cb2b6b0be3dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:23.255231 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfacbd-4f3e-473c-b276-cb2b6b0be3dd service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:23.255544 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfacbd-4f3e-473c-b276-cb2b6b0be3dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:23.255818 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfacbd-4f3e-473c-b276-cb2b6b0be3dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:23.257736 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-76dfacbd-4f3e-473c-b276-cb2b6b0be3dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:23.321253 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfacbd-4f3e-473c-b276-cb2b6b0be3dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:23.322613 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfacbd-4f3e-473c-b276-cb2b6b0be3dd service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:23.332453 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1359/2701] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:27.836434 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eeba9e-eabc-41c4-a040-ee344fa6ea79 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:27.838505 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-88eeba9e-eabc-41c4-a040-ee344fa6ea79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:27.852394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eeba9e-eabc-41c4-a040-ee344fa6ea79 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:27.857008 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2971da1d-6b7d-40aa-8b55-7420e9a3cfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:27.857882 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971da1d-6b7d-40aa-8b55-7420e9a3cfd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:27.858166 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971da1d-6b7d-40aa-8b55-7420e9a3cfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:27.858440 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971da1d-6b7d-40aa-8b55-7420e9a3cfd1 admin admin] PATH_INFO: `/v3/users/f8890c84089c48d291b3ff73e9b2e423` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:27.874102 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2971da1d-6b7d-40aa-8b55-7420e9a3cfd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8890c84089c48d291b3ff73e9b2e423)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:27.876151 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2971da1d-6b7d-40aa-8b55-7420e9a3cfd1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:27.963950 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfacbd-4f3e-473c-b276-cb2b6b0be3dd service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:27.974508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfacbd-4f3e-473c-b276-cb2b6b0be3dd service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:27.979130 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b14b5b-193e-4679-9c21-d962d7fb5896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:27.980280 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b14b5b-193e-4679-9c21-d962d7fb5896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:27.981983 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b14b5b-193e-4679-9c21-d962d7fb5896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:27.981983 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b14b5b-193e-4679-9c21-d962d7fb5896 admin admin] PATH_INFO: `/v3/users/8338ed69103344aa834b120d09de4e8b` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:27.982246 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b14b5b-193e-4679-9c21-d962d7fb5896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8338ed69103344aa834b120d09de4e8b)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:27.984228 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b14b5b-193e-4679-9c21-d962d7fb5896 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:27.998051 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:28.072590 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2971da1d-6b7d-40aa-8b55-7420e9a3cfd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8890c84089c48d291b3ff73e9b2e423'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:28.080063 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2971da1d-6b7d-40aa-8b55-7420e9a3cfd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8890c84089c48d291b3ff73e9b2e423'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:28.083469 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2971da1d-6b7d-40aa-8b55-7420e9a3cfd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8890c84089c48d291b3ff73e9b2e423'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:28.083469 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2971da1d-6b7d-40aa-8b55-7420e9a3cfd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8890c84089c48d291b3ff73e9b2e423'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:28.096423 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2971da1d-6b7d-40aa-8b55-7420e9a3cfd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8890c84089c48d291b3ff73e9b2e423'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:28.100537 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:28.186415 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1343/2702] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:33:27 2022] DELETE /identity/v3/users/f8890c84089c48d291b3ff73e9b2e423 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:28.193684 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-e0b14b5b-193e-4679-9c21-d962d7fb5896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8338ed69103344aa834b120d09de4e8b'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:28.206632 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-e0b14b5b-193e-4679-9c21-d962d7fb5896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8338ed69103344aa834b120d09de4e8b'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:28.226666 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-e0b14b5b-193e-4679-9c21-d962d7fb5896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8338ed69103344aa834b120d09de4e8b'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:28.227545 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-e0b14b5b-193e-4679-9c21-d962d7fb5896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8338ed69103344aa834b120d09de4e8b'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:28.228183 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-e0b14b5b-193e-4679-9c21-d962d7fb5896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8338ed69103344aa834b120d09de4e8b'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:28.298462 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1360/2703] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:33:27 2022] DELETE /identity/v3/users/8338ed69103344aa834b120d09de4e8b => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:33:28.310584 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af179fe9-4578-4516-8caf-7a2659882eb1 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:28.310875 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af179fe9-4578-4516-8caf-7a2659882eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:28.311158 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af179fe9-4578-4516-8caf-7a2659882eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:28.334181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-af179fe9-4578-4516-8caf-7a2659882eb1 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:28.334181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-af179fe9-4578-4516-8caf-7a2659882eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:28.394137 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1344/2704] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:33:28.403861 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b14b5b-193e-4679-9c21-d962d7fb5896 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:28.405309 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-e0b14b5b-193e-4679-9c21-d962d7fb5896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:28.430736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af179fe9-4578-4516-8caf-7a2659882eb1 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:28.432239 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-af179fe9-4578-4516-8caf-7a2659882eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:28.446683 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af179fe9-4578-4516-8caf-7a2659882eb1 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:28.452138 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423040ff-c5b9-43a9-9ff8-308094f01826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:28.453957 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423040ff-c5b9-43a9-9ff8-308094f01826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:28.454347 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423040ff-c5b9-43a9-9ff8-308094f01826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:28.454727 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423040ff-c5b9-43a9-9ff8-308094f01826 admin admin] PATH_INFO: `/v3/projects/5a4a4f0451d14230bc5086449cbc7a48` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:28.469367 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423040ff-c5b9-43a9-9ff8-308094f01826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a4a4f0451d14230bc5086449cbc7a48)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:28.471944 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423040ff-c5b9-43a9-9ff8-308094f01826 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:28.478299 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b14b5b-193e-4679-9c21-d962d7fb5896 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:28.482064 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b2c27-4385-441c-a507-f4e05645da11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:28.482710 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b2c27-4385-441c-a507-f4e05645da11 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:28.482989 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b2c27-4385-441c-a507-f4e05645da11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:28.483327 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b2c27-4385-441c-a507-f4e05645da11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:28.494157 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b2c27-4385-441c-a507-f4e05645da11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:28.495735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b2c27-4385-441c-a507-f4e05645da11 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:28.505883 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1361/2705] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:28.579379 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-423040ff-c5b9-43a9-9ff8-308094f01826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a4a4f0451d14230bc5086449cbc7a48', 'request_id': 'req-423040ff-c5b9-43a9-9ff8-308094f01826'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:28.588451 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-423040ff-c5b9-43a9-9ff8-308094f01826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a4a4f0451d14230bc5086449cbc7a48', 'request_id': 'req-423040ff-c5b9-43a9-9ff8-308094f01826'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:28.697653 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-423040ff-c5b9-43a9-9ff8-308094f01826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a4a4f0451d14230bc5086449cbc7a48', 'request_id': 'req-423040ff-c5b9-43a9-9ff8-308094f01826'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:28.711163 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-423040ff-c5b9-43a9-9ff8-308094f01826 admin admin] The token cache is being invalidate because project 5a4a4f0451d14230bc5086449cbc7a48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:33:28.711509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-423040ff-c5b9-43a9-9ff8-308094f01826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:28.712252 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-423040ff-c5b9-43a9-9ff8-308094f01826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:28.714189 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1345/2706] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:33:28 2022] DELETE /identity/v3/projects/5a4a4f0451d14230bc5086449cbc7a48 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:28.723243 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f57b0e-2e58-4e6f-8a56-af36f5074b15 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:28.723711 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f57b0e-2e58-4e6f-8a56-af36f5074b15 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:28.724323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f57b0e-2e58-4e6f-8a56-af36f5074b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:28.754168 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-73f57b0e-2e58-4e6f-8a56-af36f5074b15 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:28.756260 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-73f57b0e-2e58-4e6f-8a56-af36f5074b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:28.832600 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1362/2707] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:28.840960 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0108a84-33f6-43c0-9b37-07595012e68b None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:28.841466 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0108a84-33f6-43c0-9b37-07595012e68b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:28.841685 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0108a84-33f6-43c0-9b37-07595012e68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:28.861275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-d0108a84-33f6-43c0-9b37-07595012e68b None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:28.862573 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d0108a84-33f6-43c0-9b37-07595012e68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:28.880825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1346/2708] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:28.885265 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f57b0e-2e58-4e6f-8a56-af36f5074b15 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:28.895939 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f57b0e-2e58-4e6f-8a56-af36f5074b15 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:28.900764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a45d3-8446-491e-9bd5-d83edee8103a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:28.901641 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a45d3-8446-491e-9bd5-d83edee8103a admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:28.901943 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a45d3-8446-491e-9bd5-d83edee8103a admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:28.902224 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a45d3-8446-491e-9bd5-d83edee8103a admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:28.902963 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a45d3-8446-491e-9bd5-d83edee8103a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:33:28.903271 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a45d3-8446-491e-9bd5-d83edee8103a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:28.904914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a45d3-8446-491e-9bd5-d83edee8103a admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:28.918512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1363/2709] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:33:28.922939 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0108a84-33f6-43c0-9b37-07595012e68b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:28.933025 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0108a84-33f6-43c0-9b37-07595012e68b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:28.937952 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5a51b-dd0d-492f-9a4c-4b2dab8af095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:28.938720 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5a51b-dd0d-492f-9a4c-4b2dab8af095 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:28.939004 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5a51b-dd0d-492f-9a4c-4b2dab8af095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:28.939280 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5a51b-dd0d-492f-9a4c-4b2dab8af095 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:28.940781 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b5a51b-dd0d-492f-9a4c-4b2dab8af095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:28.942737 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b5a51b-dd0d-492f-9a4c-4b2dab8af095 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:28.979096 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a45d3-8446-491e-9bd5-d83edee8103a admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:28.981603 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-192a45d3-8446-491e-9bd5-d83edee8103a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:28.995483 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a45d3-8446-491e-9bd5-d83edee8103a admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:29.001119 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cecdb-ea1e-4520-891c-aa47a25b6399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:29.002548 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cecdb-ea1e-4520-891c-aa47a25b6399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:29.003479 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cecdb-ea1e-4520-891c-aa47a25b6399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:29.003765 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cecdb-ea1e-4520-891c-aa47a25b6399 admin admin] PATH_INFO: `/v3/projects/c6042b6192d349d0843c7d954daf6006` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:29.005230 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9cecdb-ea1e-4520-891c-aa47a25b6399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6042b6192d349d0843c7d954daf6006)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:29.007186 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9cecdb-ea1e-4520-891c-aa47a25b6399 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:29.025725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1347/2710] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:33:28 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:33:29.027698 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:29.029835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5a51b-dd0d-492f-9a4c-4b2dab8af095 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:29.075544 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:29.094445 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5a51b-dd0d-492f-9a4c-4b2dab8af095 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:29.099765 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebc087-4c51-4dd2-8282-ad780c334ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:29.100539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebc087-4c51-4dd2-8282-ad780c334ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:29.102534 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebc087-4c51-4dd2-8282-ad780c334ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:29.102534 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebc087-4c51-4dd2-8282-ad780c334ba5 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:29.102534 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebc087-4c51-4dd2-8282-ad780c334ba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:29.103824 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebc087-4c51-4dd2-8282-ad780c334ba5 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:29.121182 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-2f9cecdb-ea1e-4520-891c-aa47a25b6399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6042b6192d349d0843c7d954daf6006', 'request_id': 'req-2f9cecdb-ea1e-4520-891c-aa47a25b6399'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:29.189593 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1348/2711] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:33:29 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:33:29.194480 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebc087-4c51-4dd2-8282-ad780c334ba5 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:29.204828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebc087-4c51-4dd2-8282-ad780c334ba5 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:29.214653 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-2f9cecdb-ea1e-4520-891c-aa47a25b6399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6042b6192d349d0843c7d954daf6006', 'request_id': 'req-2f9cecdb-ea1e-4520-891c-aa47a25b6399'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:29.221070 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-2f9cecdb-ea1e-4520-891c-aa47a25b6399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6042b6192d349d0843c7d954daf6006', 'request_id': 'req-2f9cecdb-ea1e-4520-891c-aa47a25b6399'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:29.234216 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-2f9cecdb-ea1e-4520-891c-aa47a25b6399 admin admin] The token cache is being invalidate because project c6042b6192d349d0843c7d954daf6006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:33:29.234494 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-2f9cecdb-ea1e-4520-891c-aa47a25b6399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:29.235161 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-2f9cecdb-ea1e-4520-891c-aa47a25b6399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:29.237758 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1364/2712] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:33:28 2022] DELETE /identity/v3/projects/c6042b6192d349d0843c7d954daf6006 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:29.241854 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cecdb-ea1e-4520-891c-aa47a25b6399 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:29.242727 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-2f9cecdb-ea1e-4520-891c-aa47a25b6399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:29.263243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6f835-7c55-4606-9df0-e899ca8ce75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:29.264042 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6f835-7c55-4606-9df0-e899ca8ce75b admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:29.264398 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6f835-7c55-4606-9df0-e899ca8ce75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:29.270177 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6f835-7c55-4606-9df0-e899ca8ce75b admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:29.270177 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6f835-7c55-4606-9df0-e899ca8ce75b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:29.270177 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6f835-7c55-4606-9df0-e899ca8ce75b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:29.277945 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1349/2713] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:33:29.282226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6f835-7c55-4606-9df0-e899ca8ce75b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:29.285854 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-55d6f835-7c55-4606-9df0-e899ca8ce75b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:29.301951 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6f835-7c55-4606-9df0-e899ca8ce75b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:29.308492 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff8347-6550-489a-b8b5-393c1fb803f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:29.309438 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff8347-6550-489a-b8b5-393c1fb803f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:29.309905 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff8347-6550-489a-b8b5-393c1fb803f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:29.310323 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff8347-6550-489a-b8b5-393c1fb803f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:29.311318 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff8347-6550-489a-b8b5-393c1fb803f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:29.313666 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff8347-6550-489a-b8b5-393c1fb803f1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:29.326185 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1350/2714] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:33:29.330594 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff8347-6550-489a-b8b5-393c1fb803f1 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:29.333434 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cecdb-ea1e-4520-891c-aa47a25b6399 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:29.338691 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2fd77-312d-4dbc-95f6-65ad67e6827a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:29.339565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2fd77-312d-4dbc-95f6-65ad67e6827a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:29.339843 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2fd77-312d-4dbc-95f6-65ad67e6827a admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:29.340715 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2fd77-312d-4dbc-95f6-65ad67e6827a admin admin] PATH_INFO: `/v3/users/ecb456bb1f584f82b65b73db737607a3` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:29.342038 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2fd77-312d-4dbc-95f6-65ad67e6827a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecb456bb1f584f82b65b73db737607a3)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:29.342851 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff8347-6550-489a-b8b5-393c1fb803f1 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:29.343960 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2fd77-312d-4dbc-95f6-65ad67e6827a admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:29.353552 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb7423-10a1-4695-8847-3af0c172b159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:29.353552 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb7423-10a1-4695-8847-3af0c172b159 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:29.353552 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb7423-10a1-4695-8847-3af0c172b159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:29.353552 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb7423-10a1-4695-8847-3af0c172b159 admin admin] PATH_INFO: `/v3/projects/f2036a41c32a43758ebe5e21eb568942/users/59716e5eb95843208f7df810f2ad414b/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:29.372224 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb7423-10a1-4695-8847-3af0c172b159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2036a41c32a43758ebe5e21eb568942, user_id=59716e5eb95843208f7df810f2ad414b, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:29.375014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb7423-10a1-4695-8847-3af0c172b159 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:29.469502 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1351/2715] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:33:29 2022] PUT /identity/v3/projects/f2036a41c32a43758ebe5e21eb568942/users/59716e5eb95843208f7df810f2ad414b/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:33:29.479792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c49c6-dc6c-44cd-94b1-0951bdb0da57 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:29.480135 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c49c6-dc6c-44cd-94b1-0951bdb0da57 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:29.480414 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c49c6-dc6c-44cd-94b1-0951bdb0da57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:29.504184 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-65c2fd77-312d-4dbc-95f6-65ad67e6827a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecb456bb1f584f82b65b73db737607a3'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:29.510796 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-903c49c6-dc6c-44cd-94b1-0951bdb0da57 None None] MFA Rules not processed for user `59716e5eb95843208f7df810f2ad414b`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:29.512087 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-903c49c6-dc6c-44cd-94b1-0951bdb0da57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:29.517225 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-65c2fd77-312d-4dbc-95f6-65ad67e6827a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecb456bb1f584f82b65b73db737607a3'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:29.524129 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-65c2fd77-312d-4dbc-95f6-65ad67e6827a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecb456bb1f584f82b65b73db737607a3'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:29.525081 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-65c2fd77-312d-4dbc-95f6-65ad67e6827a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecb456bb1f584f82b65b73db737607a3'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:29.525770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-65c2fd77-312d-4dbc-95f6-65ad67e6827a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecb456bb1f584f82b65b73db737607a3'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:29.576460 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1352/2716] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:33:29.585518 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c49c6-dc6c-44cd-94b1-0951bdb0da57 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:29.586951 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-903c49c6-dc6c-44cd-94b1-0951bdb0da57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:29.611231 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1365/2717] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:33:29 2022] DELETE /identity/v3/users/ecb456bb1f584f82b65b73db737607a3 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:33:29.652709 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c49c6-dc6c-44cd-94b1-0951bdb0da57 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:29.687379 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:29.731628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b902aba-05d9-4d81-acef-1af68ed10787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:29.732317 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b902aba-05d9-4d81-acef-1af68ed10787 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:29.732599 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b902aba-05d9-4d81-acef-1af68ed10787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:29.732868 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b902aba-05d9-4d81-acef-1af68ed10787 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:29.733567 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b902aba-05d9-4d81-acef-1af68ed10787 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:29.735652 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b902aba-05d9-4d81-acef-1af68ed10787 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:29.868509 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1353/2718] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:33:29 2022] POST /identity/v3/projects => generated 385 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:33:29.871981 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2fd77-312d-4dbc-95f6-65ad67e6827a admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:29.882740 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2fd77-312d-4dbc-95f6-65ad67e6827a admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:29.903654 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:29.945539 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3bef0-151f-4ab8-b26b-0bd722f93ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:29.946229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3bef0-151f-4ab8-b26b-0bd722f93ebf admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:29.946512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3bef0-151f-4ab8-b26b-0bd722f93ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:29.946785 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3bef0-151f-4ab8-b26b-0bd722f93ebf admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:29.947498 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3bef0-151f-4ab8-b26b-0bd722f93ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:29.949438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3bef0-151f-4ab8-b26b-0bd722f93ebf admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:29.991290 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b902aba-05d9-4d81-acef-1af68ed10787 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:29.993133 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1b902aba-05d9-4d81-acef-1af68ed10787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:30.018148 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1366/2719] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:33:29 2022] POST /identity/v3/users => generated 299 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:33:30.018883 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b902aba-05d9-4d81-acef-1af68ed10787 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:30.019493 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3bef0-151f-4ab8-b26b-0bd722f93ebf admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:30.030711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98700069-5730-4b07-bccd-5cae95fef510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:30.030711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98700069-5730-4b07-bccd-5cae95fef510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:30.030711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98700069-5730-4b07-bccd-5cae95fef510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:30.030711 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98700069-5730-4b07-bccd-5cae95fef510 admin admin] PATH_INFO: `/v3/projects/3d96706fd08a4e3bb56626ab95431e69` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:30.031549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98700069-5730-4b07-bccd-5cae95fef510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d96706fd08a4e3bb56626ab95431e69)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:30.031549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98700069-5730-4b07-bccd-5cae95fef510 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:30.032212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3bef0-151f-4ab8-b26b-0bd722f93ebf admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:30.038383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1466d8-abfc-4c6c-946c-311881f67aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:30.039177 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1466d8-abfc-4c6c-946c-311881f67aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:30.039463 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1466d8-abfc-4c6c-946c-311881f67aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:30.039732 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1466d8-abfc-4c6c-946c-311881f67aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:30.041078 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1466d8-abfc-4c6c-946c-311881f67aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:30.043366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1466d8-abfc-4c6c-946c-311881f67aa1 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:30.061710 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1367/2720] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:33:30.066140 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1466d8-abfc-4c6c-946c-311881f67aa1 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:30.077347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1466d8-abfc-4c6c-946c-311881f67aa1 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:30.083704 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84877e-ca31-4390-bccd-15c5ba46eae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:30.084909 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84877e-ca31-4390-bccd-15c5ba46eae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:30.085199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84877e-ca31-4390-bccd-15c5ba46eae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:30.085497 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84877e-ca31-4390-bccd-15c5ba46eae5 admin admin] PATH_INFO: `/v3/projects/cf568446ae934a05a514355d2192e39a/users/b1cf20b8f5b3433e889f73ac1d545180/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:30.102120 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84877e-ca31-4390-bccd-15c5ba46eae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf568446ae934a05a514355d2192e39a, user_id=b1cf20b8f5b3433e889f73ac1d545180, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:30.104839 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84877e-ca31-4390-bccd-15c5ba46eae5 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:30.168397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1368/2721] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:33:30 2022] PUT /identity/v3/projects/cf568446ae934a05a514355d2192e39a/users/b1cf20b8f5b3433e889f73ac1d545180/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:33:30.169512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84877e-ca31-4390-bccd-15c5ba46eae5 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:30.176023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-98700069-5730-4b07-bccd-5cae95fef510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d96706fd08a4e3bb56626ab95431e69', 'request_id': 'req-98700069-5730-4b07-bccd-5cae95fef510'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:30.196411 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-98700069-5730-4b07-bccd-5cae95fef510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d96706fd08a4e3bb56626ab95431e69', 'request_id': 'req-98700069-5730-4b07-bccd-5cae95fef510'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:30.247385 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84877e-ca31-4390-bccd-15c5ba46eae5 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:30.297696 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-98700069-5730-4b07-bccd-5cae95fef510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d96706fd08a4e3bb56626ab95431e69', 'request_id': 'req-98700069-5730-4b07-bccd-5cae95fef510'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:30.304919 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb9902-2cf1-4d41-8eac-dac1760a359b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:30.305710 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb9902-2cf1-4d41-8eac-dac1760a359b admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:30.305987 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb9902-2cf1-4d41-8eac-dac1760a359b admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:30.306261 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb9902-2cf1-4d41-8eac-dac1760a359b admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:30.306991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb9902-2cf1-4d41-8eac-dac1760a359b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:30.308743 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb9902-2cf1-4d41-8eac-dac1760a359b admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:30.315791 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-98700069-5730-4b07-bccd-5cae95fef510 admin admin] The token cache is being invalidate because project 3d96706fd08a4e3bb56626ab95431e69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:33:30.316281 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-98700069-5730-4b07-bccd-5cae95fef510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:30.317049 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-98700069-5730-4b07-bccd-5cae95fef510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:30.318718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1354/2722] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:33:29 2022] DELETE /identity/v3/projects/3d96706fd08a4e3bb56626ab95431e69 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:33:30.320151 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1369/2723] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:33:30.322522 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98700069-5730-4b07-bccd-5cae95fef510 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:30.326067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-98700069-5730-4b07-bccd-5cae95fef510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:30.329023 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb9902-2cf1-4d41-8eac-dac1760a359b admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:30.331257 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-e1eb9902-2cf1-4d41-8eac-dac1760a359b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:30.337695 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98700069-5730-4b07-bccd-5cae95fef510 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:30.342568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7e5fc-d5b1-40fb-80fe-b4a166def80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:30.343483 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7e5fc-d5b1-40fb-80fe-b4a166def80b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:30.343767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7e5fc-d5b1-40fb-80fe-b4a166def80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:30.344078 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7e5fc-d5b1-40fb-80fe-b4a166def80b admin admin] PATH_INFO: `/v3/users/8ee83f5fcbd64387a5814c61e844a2a2` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:30.344870 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb9902-2cf1-4d41-8eac-dac1760a359b admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:30.345296 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7e5fc-d5b1-40fb-80fe-b4a166def80b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ee83f5fcbd64387a5814c61e844a2a2)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:30.347462 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7e5fc-d5b1-40fb-80fe-b4a166def80b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:30.349732 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136a3f2-3dec-4747-abc3-9e22c59fcd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:30.350620 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136a3f2-3dec-4747-abc3-9e22c59fcd3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:30.351079 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136a3f2-3dec-4747-abc3-9e22c59fcd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:30.351422 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136a3f2-3dec-4747-abc3-9e22c59fcd3d admin admin] PATH_INFO: `/v3/projects/cf568446ae934a05a514355d2192e39a/users/b1cf20b8f5b3433e889f73ac1d545180/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:30.353490 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136a3f2-3dec-4747-abc3-9e22c59fcd3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf568446ae934a05a514355d2192e39a, user_id=b1cf20b8f5b3433e889f73ac1d545180, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:30.356220 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136a3f2-3dec-4747-abc3-9e22c59fcd3d admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:30.368680 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1370/2724] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:33:30 2022] PUT /identity/v3/projects/cf568446ae934a05a514355d2192e39a/users/b1cf20b8f5b3433e889f73ac1d545180/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:33:30.380342 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bf309-bcea-4319-b32f-d964879c8928 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:30.380629 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bf309-bcea-4319-b32f-d964879c8928 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:30.384289 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bf309-bcea-4319-b32f-d964879c8928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:30.394313 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:30.408440 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-0e5bf309-bcea-4319-b32f-d964879c8928 None None] MFA Rules not processed for user `b1cf20b8f5b3433e889f73ac1d545180`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:30.409652 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-0e5bf309-bcea-4319-b32f-d964879c8928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:30.488776 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1371/2725] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:33:30.493898 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:30.500383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bf309-bcea-4319-b32f-d964879c8928 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:30.502726 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-0e5bf309-bcea-4319-b32f-d964879c8928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:30.510676 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-62a7e5fc-d5b1-40fb-80fe-b4a166def80b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ee83f5fcbd64387a5814c61e844a2a2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:30.519266 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-62a7e5fc-d5b1-40fb-80fe-b4a166def80b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ee83f5fcbd64387a5814c61e844a2a2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:30.520027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-62a7e5fc-d5b1-40fb-80fe-b4a166def80b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ee83f5fcbd64387a5814c61e844a2a2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:30.520665 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-62a7e5fc-d5b1-40fb-80fe-b4a166def80b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ee83f5fcbd64387a5814c61e844a2a2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:30.533512 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-62a7e5fc-d5b1-40fb-80fe-b4a166def80b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ee83f5fcbd64387a5814c61e844a2a2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:30.567653 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bf309-bcea-4319-b32f-d964879c8928 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:30.572073 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcae097-1179-442e-ae88-6623c148f19d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:30.572764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcae097-1179-442e-ae88-6623c148f19d service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:30.573046 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcae097-1179-442e-ae88-6623c148f19d service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:30.573321 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcae097-1179-442e-ae88-6623c148f19d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:30.575141 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-cbcae097-1179-442e-ae88-6623c148f19d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:30.588165 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcae097-1179-442e-ae88-6623c148f19d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:30.589638 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcae097-1179-442e-ae88-6623c148f19d service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:30.599259 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1372/2726] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:33:30.610311 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1355/2727] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:33:30 2022] DELETE /identity/v3/users/8ee83f5fcbd64387a5814c61e844a2a2 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:30.667873 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcae097-1179-442e-ae88-6623c148f19d service cinder] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:30.669490 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-cbcae097-1179-442e-ae88-6623c148f19d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:30.754730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcae097-1179-442e-ae88-6623c148f19d service cinder] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:30.802967 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=100 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:30.842922 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba4ecc-0583-4e84-b118-41ad34ddb496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:30.844291 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba4ecc-0583-4e84-b118-41ad34ddb496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:30.844831 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba4ecc-0583-4e84-b118-41ad34ddb496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:30.845133 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba4ecc-0583-4e84-b118-41ad34ddb496 admin admin] PATH_INFO: `/v3/users/59716e5eb95843208f7df810f2ad414b` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:30.846563 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba4ecc-0583-4e84-b118-41ad34ddb496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59716e5eb95843208f7df810f2ad414b)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:30.853196 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba4ecc-0583-4e84-b118-41ad34ddb496 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:31.055672 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-5eba4ecc-0583-4e84-b118-41ad34ddb496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59716e5eb95843208f7df810f2ad414b'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:31.075217 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-5eba4ecc-0583-4e84-b118-41ad34ddb496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59716e5eb95843208f7df810f2ad414b'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:31.076720 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7e5fc-d5b1-40fb-80fe-b4a166def80b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:31.079267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-62a7e5fc-d5b1-40fb-80fe-b4a166def80b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:31.084080 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-5eba4ecc-0583-4e84-b118-41ad34ddb496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59716e5eb95843208f7df810f2ad414b'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:31.084916 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-5eba4ecc-0583-4e84-b118-41ad34ddb496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59716e5eb95843208f7df810f2ad414b'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:31.085591 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-5eba4ecc-0583-4e84-b118-41ad34ddb496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59716e5eb95843208f7df810f2ad414b'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:31.101961 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7e5fc-d5b1-40fb-80fe-b4a166def80b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:31.108471 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb762ae-711b-4eeb-b7f4-9922d88f792a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:31.109463 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb762ae-711b-4eeb-b7f4-9922d88f792a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:31.109791 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb762ae-711b-4eeb-b7f4-9922d88f792a admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:31.110067 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb762ae-711b-4eeb-b7f4-9922d88f792a admin admin] PATH_INFO: `/v3/projects/5732ec8252ab4d48ad6a87867821913c` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:31.111628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb762ae-711b-4eeb-b7f4-9922d88f792a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5732ec8252ab4d48ad6a87867821913c)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:31.113521 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb762ae-711b-4eeb-b7f4-9922d88f792a admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:31.172873 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1373/2728] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:33:30 2022] DELETE /identity/v3/users/59716e5eb95843208f7df810f2ad414b => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:31.177467 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474cc38-2704-4236-bd67-2ded7e6b758a None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:31.177759 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474cc38-2704-4236-bd67-2ded7e6b758a None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:31.178057 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474cc38-2704-4236-bd67-2ded7e6b758a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:31.200196 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-4474cc38-2704-4236-bd67-2ded7e6b758a None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:31.200196 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-4474cc38-2704-4236-bd67-2ded7e6b758a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:31.269511 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0fb762ae-711b-4eeb-b7f4-9922d88f792a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5732ec8252ab4d48ad6a87867821913c', 'request_id': 'req-0fb762ae-711b-4eeb-b7f4-9922d88f792a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:31.272043 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1374/2729] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:33:31.281939 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0fb762ae-711b-4eeb-b7f4-9922d88f792a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5732ec8252ab4d48ad6a87867821913c', 'request_id': 'req-0fb762ae-711b-4eeb-b7f4-9922d88f792a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:31.295114 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474cc38-2704-4236-bd67-2ded7e6b758a None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:31.296645 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-4474cc38-2704-4236-bd67-2ded7e6b758a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:31.343040 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0fb762ae-711b-4eeb-b7f4-9922d88f792a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5732ec8252ab4d48ad6a87867821913c', 'request_id': 'req-0fb762ae-711b-4eeb-b7f4-9922d88f792a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:31.355113 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0fb762ae-711b-4eeb-b7f4-9922d88f792a admin admin] The token cache is being invalidate because project 5732ec8252ab4d48ad6a87867821913c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:33:31.355403 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0fb762ae-711b-4eeb-b7f4-9922d88f792a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:31.356078 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0fb762ae-711b-4eeb-b7f4-9922d88f792a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:31.363022 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1356/2730] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:33:31 2022] DELETE /identity/v3/projects/5732ec8252ab4d48ad6a87867821913c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:33:31.371124 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474cc38-2704-4236-bd67-2ded7e6b758a None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:31.393317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:31.441471 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961783b0-e559-42fa-82d1-b6d81f74c756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:31.442326 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961783b0-e559-42fa-82d1-b6d81f74c756 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:31.442735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961783b0-e559-42fa-82d1-b6d81f74c756 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:31.443105 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961783b0-e559-42fa-82d1-b6d81f74c756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:31.445442 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-961783b0-e559-42fa-82d1-b6d81f74c756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:31.519304 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961783b0-e559-42fa-82d1-b6d81f74c756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:31.520502 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961783b0-e559-42fa-82d1-b6d81f74c756 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:31.532728 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1375/2731] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:33:32.025511 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb762ae-711b-4eeb-b7f4-9922d88f792a admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:32.027041 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0fb762ae-711b-4eeb-b7f4-9922d88f792a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:32.047971 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb762ae-711b-4eeb-b7f4-9922d88f792a admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:32.048727 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630237fa-b6fe-4d13-9168-65a572153a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:32.050251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630237fa-b6fe-4d13-9168-65a572153a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:32.050521 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630237fa-b6fe-4d13-9168-65a572153a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:32.050822 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630237fa-b6fe-4d13-9168-65a572153a26 admin admin] PATH_INFO: `/v3/projects/f2036a41c32a43758ebe5e21eb568942` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:32.052189 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630237fa-b6fe-4d13-9168-65a572153a26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2036a41c32a43758ebe5e21eb568942)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:32.055204 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630237fa-b6fe-4d13-9168-65a572153a26 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:32.156981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-630237fa-b6fe-4d13-9168-65a572153a26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2036a41c32a43758ebe5e21eb568942', 'request_id': 'req-630237fa-b6fe-4d13-9168-65a572153a26'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:32.164352 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-630237fa-b6fe-4d13-9168-65a572153a26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2036a41c32a43758ebe5e21eb568942', 'request_id': 'req-630237fa-b6fe-4d13-9168-65a572153a26'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:32.223402 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-630237fa-b6fe-4d13-9168-65a572153a26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2036a41c32a43758ebe5e21eb568942', 'request_id': 'req-630237fa-b6fe-4d13-9168-65a572153a26'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:32.234386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-630237fa-b6fe-4d13-9168-65a572153a26 admin admin] The token cache is being invalidate because project f2036a41c32a43758ebe5e21eb568942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:33:32.234673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-630237fa-b6fe-4d13-9168-65a572153a26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:32.235301 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-630237fa-b6fe-4d13-9168-65a572153a26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:32.236922 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1357/2732] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:33:32 2022] DELETE /identity/v3/projects/f2036a41c32a43758ebe5e21eb568942 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:32.240903 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961783b0-e559-42fa-82d1-b6d81f74c756 service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:32.251211 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961783b0-e559-42fa-82d1-b6d81f74c756 service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:32.317229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34b14d-119e-481a-b31d-45fe351dddf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:32.318038 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34b14d-119e-481a-b31d-45fe351dddf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:32.318464 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34b14d-119e-481a-b31d-45fe351dddf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:32.318720 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34b14d-119e-481a-b31d-45fe351dddf3 admin admin] PATH_INFO: `/v3/users/b1cf20b8f5b3433e889f73ac1d545180` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:32.320135 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34b14d-119e-481a-b31d-45fe351dddf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1cf20b8f5b3433e889f73ac1d545180)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:32.322088 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34b14d-119e-481a-b31d-45fe351dddf3 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:32.514680 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-1f34b14d-119e-481a-b31d-45fe351dddf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1cf20b8f5b3433e889f73ac1d545180'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:32.529041 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-1f34b14d-119e-481a-b31d-45fe351dddf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1cf20b8f5b3433e889f73ac1d545180'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:32.534047 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:32.537865 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-1f34b14d-119e-481a-b31d-45fe351dddf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1cf20b8f5b3433e889f73ac1d545180'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:32.538659 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-1f34b14d-119e-481a-b31d-45fe351dddf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1cf20b8f5b3433e889f73ac1d545180'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:32.539334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-1f34b14d-119e-481a-b31d-45fe351dddf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1cf20b8f5b3433e889f73ac1d545180'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:32.623558 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1376/2733] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:33:32 2022] DELETE /identity/v3/users/b1cf20b8f5b3433e889f73ac1d545180 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:33.053793 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630237fa-b6fe-4d13-9168-65a572153a26 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:33.055555 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-630237fa-b6fe-4d13-9168-65a572153a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:33.070967 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630237fa-b6fe-4d13-9168-65a572153a26 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:33.084232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=78,keystone:DELETE=19,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:33.136148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a809c4-699a-4eb1-95db-17a137618e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:33.137086 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a809c4-699a-4eb1-95db-17a137618e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:33.137852 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a809c4-699a-4eb1-95db-17a137618e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:33.137852 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a809c4-699a-4eb1-95db-17a137618e2d admin admin] PATH_INFO: `/v3/projects/cf568446ae934a05a514355d2192e39a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:33.138957 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a809c4-699a-4eb1-95db-17a137618e2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf568446ae934a05a514355d2192e39a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:33.140933 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a809c4-699a-4eb1-95db-17a137618e2d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:33.241761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-02a809c4-699a-4eb1-95db-17a137618e2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf568446ae934a05a514355d2192e39a', 'request_id': 'req-02a809c4-699a-4eb1-95db-17a137618e2d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:33.248166 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-02a809c4-699a-4eb1-95db-17a137618e2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf568446ae934a05a514355d2192e39a', 'request_id': 'req-02a809c4-699a-4eb1-95db-17a137618e2d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:33.314302 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-02a809c4-699a-4eb1-95db-17a137618e2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf568446ae934a05a514355d2192e39a', 'request_id': 'req-02a809c4-699a-4eb1-95db-17a137618e2d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:33.327715 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-02a809c4-699a-4eb1-95db-17a137618e2d admin admin] The token cache is being invalidate because project cf568446ae934a05a514355d2192e39a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:33:33.328028 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-02a809c4-699a-4eb1-95db-17a137618e2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:33.328670 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-02a809c4-699a-4eb1-95db-17a137618e2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:33.330987 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1358/2734] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:33:33 2022] DELETE /identity/v3/projects/cf568446ae934a05a514355d2192e39a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:33.337075 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee2983-699b-4cbd-b701-5ceff45501f9 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:33.337621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee2983-699b-4cbd-b701-5ceff45501f9 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:33.338020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee2983-699b-4cbd-b701-5ceff45501f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:33.368397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-26ee2983-699b-4cbd-b701-5ceff45501f9 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:33.369546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-26ee2983-699b-4cbd-b701-5ceff45501f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:33.434301 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1377/2735] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:33.442853 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf39c5-99d4-4356-b8b0-9de7969f5662 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:33.443146 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf39c5-99d4-4356-b8b0-9de7969f5662 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:33.443419 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf39c5-99d4-4356-b8b0-9de7969f5662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:33.463980 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-fdcf39c5-99d4-4356-b8b0-9de7969f5662 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:33.465212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-fdcf39c5-99d4-4356-b8b0-9de7969f5662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:33.473677 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1359/2736] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:33.477751 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee2983-699b-4cbd-b701-5ceff45501f9 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:33.487983 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee2983-699b-4cbd-b701-5ceff45501f9 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:33.495784 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115e9f2-8f29-4a5d-ab21-62bce82e29b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:33.495784 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115e9f2-8f29-4a5d-ab21-62bce82e29b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:33.495784 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115e9f2-8f29-4a5d-ab21-62bce82e29b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:33.495784 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115e9f2-8f29-4a5d-ab21-62bce82e29b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:33.496412 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115e9f2-8f29-4a5d-ab21-62bce82e29b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:33:33.496412 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115e9f2-8f29-4a5d-ab21-62bce82e29b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:33.496677 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115e9f2-8f29-4a5d-ab21-62bce82e29b9 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:33.508922 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1378/2737] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:33:33.513409 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf39c5-99d4-4356-b8b0-9de7969f5662 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:33.524502 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf39c5-99d4-4356-b8b0-9de7969f5662 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:33.529460 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296a031-c422-4d4e-bc0a-ecb472e836c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:33.530047 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296a031-c422-4d4e-bc0a-ecb472e836c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:33.530414 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296a031-c422-4d4e-bc0a-ecb472e836c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:33.530634 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296a031-c422-4d4e-bc0a-ecb472e836c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:33.531406 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296a031-c422-4d4e-bc0a-ecb472e836c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:33.533577 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296a031-c422-4d4e-bc0a-ecb472e836c9 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:33.642842 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1360/2738] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:33:33 2022] POST /identity/v3/projects => generated 381 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:33:33.647032 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115e9f2-8f29-4a5d-ab21-62bce82e29b9 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:33.658810 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115e9f2-8f29-4a5d-ab21-62bce82e29b9 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:33.734250 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda6c1e-19c6-4386-acd1-8d9d0c6ddc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:33.734926 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda6c1e-19c6-4386-acd1-8d9d0c6ddc72 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:33.735208 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda6c1e-19c6-4386-acd1-8d9d0c6ddc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:33.735484 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda6c1e-19c6-4386-acd1-8d9d0c6ddc72 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:33.736866 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda6c1e-19c6-4386-acd1-8d9d0c6ddc72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:33.740482 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda6c1e-19c6-4386-acd1-8d9d0c6ddc72 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:33.857885 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1379/2739] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:33:33 2022] POST /identity/v3/users => generated 291 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:33:33.862374 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296a031-c422-4d4e-bc0a-ecb472e836c9 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:33.872602 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296a031-c422-4d4e-bc0a-ecb472e836c9 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:33.877874 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71dd067-aed8-40e6-bc85-7d6797f54b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:33.878523 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dd067-aed8-40e6-bc85-7d6797f54b4a admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:33.878752 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dd067-aed8-40e6-bc85-7d6797f54b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:33.879028 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dd067-aed8-40e6-bc85-7d6797f54b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:33.879757 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71dd067-aed8-40e6-bc85-7d6797f54b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:33.881411 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71dd067-aed8-40e6-bc85-7d6797f54b4a admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:33.896490 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1361/2740] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:33.897729 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda6c1e-19c6-4386-acd1-8d9d0c6ddc72 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:33.908172 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda6c1e-19c6-4386-acd1-8d9d0c6ddc72 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:33.913070 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fe716-46d0-4b99-9a7b-5c503b85f660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:33.913742 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fe716-46d0-4b99-9a7b-5c503b85f660 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:33.914027 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fe716-46d0-4b99-9a7b-5c503b85f660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:33.914301 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fe716-46d0-4b99-9a7b-5c503b85f660 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:33.915028 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34fe716-46d0-4b99-9a7b-5c503b85f660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:33.916667 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34fe716-46d0-4b99-9a7b-5c503b85f660 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:33.928974 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1380/2741] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:33.933303 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71dd067-aed8-40e6-bc85-7d6797f54b4a admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:33.944429 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71dd067-aed8-40e6-bc85-7d6797f54b4a admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:33.949188 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba722b-e99b-4ebe-8d4f-69901b127872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:33.950073 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba722b-e99b-4ebe-8d4f-69901b127872 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:33.950352 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba722b-e99b-4ebe-8d4f-69901b127872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:33.950622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba722b-e99b-4ebe-8d4f-69901b127872 admin admin] PATH_INFO: `/v3/projects/ef3757825f1548319434cc9cfd99ba40/users/48911d6497c3404da566903f9626a1f4/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:33.966547 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba722b-e99b-4ebe-8d4f-69901b127872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef3757825f1548319434cc9cfd99ba40, user_id=48911d6497c3404da566903f9626a1f4, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:33.969277 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba722b-e99b-4ebe-8d4f-69901b127872 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:34.069719 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1362/2742] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:33:33 2022] PUT /identity/v3/projects/ef3757825f1548319434cc9cfd99ba40/users/48911d6497c3404da566903f9626a1f4/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:34.081254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9e4b5-f24e-4db7-97b5-c2d9908aff9b None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:34.081544 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9e4b5-f24e-4db7-97b5-c2d9908aff9b None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:34.081821 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9e4b5-f24e-4db7-97b5-c2d9908aff9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:34.111868 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-78c9e4b5-f24e-4db7-97b5-c2d9908aff9b None None] MFA Rules not processed for user `48911d6497c3404da566903f9626a1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:34.113829 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-78c9e4b5-f24e-4db7-97b5-c2d9908aff9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:34.159591 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:34.193612 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1381/2743] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:34.198595 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba722b-e99b-4ebe-8d4f-69901b127872 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:34.250472 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:34.268474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba722b-e99b-4ebe-8d4f-69901b127872 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:34.273291 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e9d8b-643e-4589-80d6-bbfe4b0d55c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:34.273995 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e9d8b-643e-4589-80d6-bbfe4b0d55c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:34.274340 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e9d8b-643e-4589-80d6-bbfe4b0d55c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:34.274618 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e9d8b-643e-4589-80d6-bbfe4b0d55c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:34.275323 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e9d8b-643e-4589-80d6-bbfe4b0d55c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:34.277247 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e9d8b-643e-4589-80d6-bbfe4b0d55c3 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:34.339266 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1363/2744] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:33:34 2022] POST /identity/v3/projects => generated 381 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:33:34.343327 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9e4b5-f24e-4db7-97b5-c2d9908aff9b None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:34.355001 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9e4b5-f24e-4db7-97b5-c2d9908aff9b None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:34.410579 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdca621-9b1f-4ba1-a9a0-e5cbb3470563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:34.411163 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdca621-9b1f-4ba1-a9a0-e5cbb3470563 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:34.411448 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdca621-9b1f-4ba1-a9a0-e5cbb3470563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:34.411726 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdca621-9b1f-4ba1-a9a0-e5cbb3470563 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:34.412455 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdca621-9b1f-4ba1-a9a0-e5cbb3470563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:34.414497 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdca621-9b1f-4ba1-a9a0-e5cbb3470563 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:34.487392 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1382/2745] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:33:34 2022] POST /identity/v3/users => generated 297 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:33:34.490718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e9d8b-643e-4589-80d6-bbfe4b0d55c3 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:34.503952 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e9d8b-643e-4589-80d6-bbfe4b0d55c3 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:34.512075 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328f074-4b2f-4412-a38b-be04ae87415e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:34.513897 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328f074-4b2f-4412-a38b-be04ae87415e admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:34.513897 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328f074-4b2f-4412-a38b-be04ae87415e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:34.513897 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328f074-4b2f-4412-a38b-be04ae87415e admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:34.514184 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328f074-4b2f-4412-a38b-be04ae87415e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:34.515633 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328f074-4b2f-4412-a38b-be04ae87415e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:34.528727 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1364/2746] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:34.533353 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdca621-9b1f-4ba1-a9a0-e5cbb3470563 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:34.545037 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdca621-9b1f-4ba1-a9a0-e5cbb3470563 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:34.559662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6e755-1a28-4588-a4b5-bfb0efb1c9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:34.561325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6e755-1a28-4588-a4b5-bfb0efb1c9f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:34.561694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6e755-1a28-4588-a4b5-bfb0efb1c9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:34.561933 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6e755-1a28-4588-a4b5-bfb0efb1c9f9 admin admin] PATH_INFO: `/v3/projects/14c610ca3f5c49b081ff185ef5b92f05/users/c5a5c0eaced0403291cbb1ca8e54387f/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:34.582546 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6e755-1a28-4588-a4b5-bfb0efb1c9f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14c610ca3f5c49b081ff185ef5b92f05, user_id=c5a5c0eaced0403291cbb1ca8e54387f, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:34.585622 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6e755-1a28-4588-a4b5-bfb0efb1c9f9 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:34.670052 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1383/2747] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:33:34 2022] PUT /identity/v3/projects/14c610ca3f5c49b081ff185ef5b92f05/users/c5a5c0eaced0403291cbb1ca8e54387f/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:34.674078 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328f074-4b2f-4412-a38b-be04ae87415e admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:34.684073 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328f074-4b2f-4412-a38b-be04ae87415e admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:34.745813 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e9a88-8b38-4e47-b8db-0299726b5ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:34.746857 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e9a88-8b38-4e47-b8db-0299726b5ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:34.747427 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e9a88-8b38-4e47-b8db-0299726b5ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:34.747892 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e9a88-8b38-4e47-b8db-0299726b5ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:34.748834 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e9a88-8b38-4e47-b8db-0299726b5ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:34.750724 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e9a88-8b38-4e47-b8db-0299726b5ac4 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:34.761947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1365/2748] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:34.766369 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6e755-1a28-4588-a4b5-bfb0efb1c9f9 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:34.777864 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6e755-1a28-4588-a4b5-bfb0efb1c9f9 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:34.783194 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f3a26-2300-4146-a372-a9b6f3de13a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:34.785283 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f3a26-2300-4146-a372-a9b6f3de13a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:34.785283 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f3a26-2300-4146-a372-a9b6f3de13a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:34.785283 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f3a26-2300-4146-a372-a9b6f3de13a4 admin admin] PATH_INFO: `/v3/projects/14c610ca3f5c49b081ff185ef5b92f05/users/c5a5c0eaced0403291cbb1ca8e54387f/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:34.787700 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f3a26-2300-4146-a372-a9b6f3de13a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14c610ca3f5c49b081ff185ef5b92f05, user_id=c5a5c0eaced0403291cbb1ca8e54387f, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:34.790411 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f3a26-2300-4146-a372-a9b6f3de13a4 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:34.808474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1384/2749] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:33:34 2022] PUT /identity/v3/projects/14c610ca3f5c49b081ff185ef5b92f05/users/c5a5c0eaced0403291cbb1ca8e54387f/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:34.817818 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc487f-eb9d-4bf6-aa57-87bb01761e0a None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:34.819731 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc487f-eb9d-4bf6-aa57-87bb01761e0a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:34.819731 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc487f-eb9d-4bf6-aa57-87bb01761e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:34.847832 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-0dfc487f-eb9d-4bf6-aa57-87bb01761e0a None None] MFA Rules not processed for user `c5a5c0eaced0403291cbb1ca8e54387f`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:34.849087 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0dfc487f-eb9d-4bf6-aa57-87bb01761e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:34.920514 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1366/2750] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:34.933566 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f3a26-2300-4146-a372-a9b6f3de13a4 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:34.935275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-fc4f3a26-2300-4146-a372-a9b6f3de13a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:35.004686 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f3a26-2300-4146-a372-a9b6f3de13a4 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:35.011802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a1529-d25f-4fa1-89df-97052d123ceb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:35.011802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a1529-d25f-4fa1-89df-97052d123ceb service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:35.011802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a1529-d25f-4fa1-89df-97052d123ceb service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:35.011802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a1529-d25f-4fa1-89df-97052d123ceb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:35.023834 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a1529-d25f-4fa1-89df-97052d123ceb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:35.025684 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a1529-d25f-4fa1-89df-97052d123ceb service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:35.040573 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1385/2751] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:35.975602 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc487f-eb9d-4bf6-aa57-87bb01761e0a None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:35.984936 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc487f-eb9d-4bf6-aa57-87bb01761e0a None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:35.990046 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30c658-0080-4d9b-8736-1e1e5420d0ad tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5a5c0eaced0403291cbb1ca8e54387f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14c610ca3f5c49b081ff185ef5b92f05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:35.990725 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30c658-0080-4d9b-8736-1e1e5420d0ad tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:35.991008 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30c658-0080-4d9b-8736-1e1e5420d0ad tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:35.991285 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30c658-0080-4d9b-8736-1e1e5420d0ad tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:35.992015 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30c658-0080-4d9b-8736-1e1e5420d0ad tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:33:35.992331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30c658-0080-4d9b-8736-1e1e5420d0ad tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:35.993913 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30c658-0080-4d9b-8736-1e1e5420d0ad tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:36.005999 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1367/2752] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:33:36.010134 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a1529-d25f-4fa1-89df-97052d123ceb service cinder] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:36.019283 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a1529-d25f-4fa1-89df-97052d123ceb service cinder] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:36.023823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954283dd-6003-45ac-9961-0ee96414e305 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5a5c0eaced0403291cbb1ca8e54387f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14c610ca3f5c49b081ff185ef5b92f05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:36.024501 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954283dd-6003-45ac-9961-0ee96414e305 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:36.024789 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954283dd-6003-45ac-9961-0ee96414e305 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:36.025067 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954283dd-6003-45ac-9961-0ee96414e305 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:36.025749 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954283dd-6003-45ac-9961-0ee96414e305 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:36.027635 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954283dd-6003-45ac-9961-0ee96414e305 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:36.110334 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1386/2753] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:33:36 2022] POST /identity/v3/projects => generated 353 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:33:36.115251 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30c658-0080-4d9b-8736-1e1e5420d0ad tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:36.125431 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30c658-0080-4d9b-8736-1e1e5420d0ad tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:36.148139 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:36.183339 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26620a-b67d-444d-a219-a9c79e93cbf8 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5a5c0eaced0403291cbb1ca8e54387f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14c610ca3f5c49b081ff185ef5b92f05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:36.184016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26620a-b67d-444d-a219-a9c79e93cbf8 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:36.184452 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26620a-b67d-444d-a219-a9c79e93cbf8 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:36.184736 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26620a-b67d-444d-a219-a9c79e93cbf8 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:36.185453 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26620a-b67d-444d-a219-a9c79e93cbf8 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:33:36.185755 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26620a-b67d-444d-a219-a9c79e93cbf8 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:36.187468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26620a-b67d-444d-a219-a9c79e93cbf8 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:36.199714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1368/2754] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:33:36.236398 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954283dd-6003-45ac-9961-0ee96414e305 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:36.247509 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954283dd-6003-45ac-9961-0ee96414e305 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:36.252610 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fa78d-f080-4432-8582-58fb100d3cd1 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5a5c0eaced0403291cbb1ca8e54387f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14c610ca3f5c49b081ff185ef5b92f05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:36.253263 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fa78d-f080-4432-8582-58fb100d3cd1 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:36.253549 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fa78d-f080-4432-8582-58fb100d3cd1 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:36.253923 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fa78d-f080-4432-8582-58fb100d3cd1 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] PATH_INFO: `/v3/projects/b6e016d4d1a041f9941ca5e1cb9b3c2e` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:36.255048 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fa78d-f080-4432-8582-58fb100d3cd1 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b6e016d4d1a041f9941ca5e1cb9b3c2e)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:36.256972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fa78d-f080-4432-8582-58fb100d3cd1 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:36.269128 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:36.384190 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-727fa78d-f080-4432-8582-58fb100d3cd1 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6e016d4d1a041f9941ca5e1cb9b3c2e', 'request_id': 'req-727fa78d-f080-4432-8582-58fb100d3cd1'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:36.474259 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-727fa78d-f080-4432-8582-58fb100d3cd1 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6e016d4d1a041f9941ca5e1cb9b3c2e', 'request_id': 'req-727fa78d-f080-4432-8582-58fb100d3cd1'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:36.481396 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-727fa78d-f080-4432-8582-58fb100d3cd1 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6e016d4d1a041f9941ca5e1cb9b3c2e', 'request_id': 'req-727fa78d-f080-4432-8582-58fb100d3cd1'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:36.493041 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-727fa78d-f080-4432-8582-58fb100d3cd1 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] The token cache is being invalidate because project b6e016d4d1a041f9941ca5e1cb9b3c2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:33:36.493327 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-727fa78d-f080-4432-8582-58fb100d3cd1 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:36.493977 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-727fa78d-f080-4432-8582-58fb100d3cd1 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:36.495773 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1387/2755] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:33:36 2022] DELETE /identity/v3/projects/b6e016d4d1a041f9941ca5e1cb9b3c2e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:36.988372 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26620a-b67d-444d-a219-a9c79e93cbf8 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:36.990191 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ae26620a-b67d-444d-a219-a9c79e93cbf8 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:37.057569 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26620a-b67d-444d-a219-a9c79e93cbf8 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:37.119832 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbba97-d4d8-4cd1-a631-cc08a845d12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:37.120753 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbba97-d4d8-4cd1-a631-cc08a845d12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:37.121052 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbba97-d4d8-4cd1-a631-cc08a845d12e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:37.121290 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbba97-d4d8-4cd1-a631-cc08a845d12e admin admin] PATH_INFO: `/v3/users/48911d6497c3404da566903f9626a1f4` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:37.122514 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbba97-d4d8-4cd1-a631-cc08a845d12e admin admin] RBAC: Authorizing `identity:delete_user(user_id=48911d6497c3404da566903f9626a1f4)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:37.124549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbba97-d4d8-4cd1-a631-cc08a845d12e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:37.222892 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fa78d-f080-4432-8582-58fb100d3cd1 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:37.224407 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-727fa78d-f080-4432-8582-58fb100d3cd1 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:37.277512 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-67dbba97-d4d8-4cd1-a631-cc08a845d12e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48911d6497c3404da566903f9626a1f4'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:37.283830 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fa78d-f080-4432-8582-58fb100d3cd1 tempest-VolumeQuotaClassesTest-1362878447 tempest-VolumeQuotaClassesTest-1362878447-project-admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:37.285889 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-67dbba97-d4d8-4cd1-a631-cc08a845d12e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48911d6497c3404da566903f9626a1f4'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:37.286628 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-67dbba97-d4d8-4cd1-a631-cc08a845d12e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48911d6497c3404da566903f9626a1f4'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:37.287228 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-67dbba97-d4d8-4cd1-a631-cc08a845d12e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48911d6497c3404da566903f9626a1f4'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:37.287675 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48b2c9-e8cf-458a-aa96-0c610d8d4384 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:37.288356 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48b2c9-e8cf-458a-aa96-0c610d8d4384 service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:37.288640 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48b2c9-e8cf-458a-aa96-0c610d8d4384 service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:37.288926 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48b2c9-e8cf-458a-aa96-0c610d8d4384 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:37.290717 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5a48b2c9-e8cf-458a-aa96-0c610d8d4384 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:37.295740 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:37.300193 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-67dbba97-d4d8-4cd1-a631-cc08a845d12e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48911d6497c3404da566903f9626a1f4'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:37.356413 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1369/2756] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:33:36 2022] DELETE /identity/v3/users/48911d6497c3404da566903f9626a1f4 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:37.360632 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf69af-f2a6-408f-b42a-763b2cb6c3b2 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:37.360923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf69af-f2a6-408f-b42a-763b2cb6c3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:37.361091 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48b2c9-e8cf-458a-aa96-0c610d8d4384 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:37.361199 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf69af-f2a6-408f-b42a-763b2cb6c3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:37.363435 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48b2c9-e8cf-458a-aa96-0c610d8d4384 service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:37.374461 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1388/2757] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:33:37.381132 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-8aaf69af-f2a6-408f-b42a-763b2cb6c3b2 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:37.382319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8aaf69af-f2a6-408f-b42a-763b2cb6c3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:37.446420 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1370/2758] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:33:37.456581 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48b2c9-e8cf-458a-aa96-0c610d8d4384 service cinder] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:37.457970 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5a48b2c9-e8cf-458a-aa96-0c610d8d4384 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:37.522016 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:37.526117 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48b2c9-e8cf-458a-aa96-0c610d8d4384 service cinder] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:37.579174 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709347ac-913f-4de5-b995-6ec79e6057aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:37.579836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709347ac-913f-4de5-b995-6ec79e6057aa service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:37.580149 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709347ac-913f-4de5-b995-6ec79e6057aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:37.580427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709347ac-913f-4de5-b995-6ec79e6057aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:37.596509 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709347ac-913f-4de5-b995-6ec79e6057aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:37.597958 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709347ac-913f-4de5-b995-6ec79e6057aa service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:37.611658 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1389/2759] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:38.020097 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf69af-f2a6-408f-b42a-763b2cb6c3b2 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:38.021730 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8aaf69af-f2a6-408f-b42a-763b2cb6c3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:38.055968 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf69af-f2a6-408f-b42a-763b2cb6c3b2 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:38.066798 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67678f-44c4-4d7b-98b1-7ee4ffc0190a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:38.067814 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67678f-44c4-4d7b-98b1-7ee4ffc0190a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:38.069247 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67678f-44c4-4d7b-98b1-7ee4ffc0190a admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:38.069758 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67678f-44c4-4d7b-98b1-7ee4ffc0190a admin admin] PATH_INFO: `/v3/projects/ef3757825f1548319434cc9cfd99ba40` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:38.071223 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67678f-44c4-4d7b-98b1-7ee4ffc0190a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef3757825f1548319434cc9cfd99ba40)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:38.073331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67678f-44c4-4d7b-98b1-7ee4ffc0190a admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:38.171158 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ab67678f-44c4-4d7b-98b1-7ee4ffc0190a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef3757825f1548319434cc9cfd99ba40', 'request_id': 'req-ab67678f-44c4-4d7b-98b1-7ee4ffc0190a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:38.179360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ab67678f-44c4-4d7b-98b1-7ee4ffc0190a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef3757825f1548319434cc9cfd99ba40', 'request_id': 'req-ab67678f-44c4-4d7b-98b1-7ee4ffc0190a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:38.280128 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ab67678f-44c4-4d7b-98b1-7ee4ffc0190a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef3757825f1548319434cc9cfd99ba40', 'request_id': 'req-ab67678f-44c4-4d7b-98b1-7ee4ffc0190a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:38.293816 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ab67678f-44c4-4d7b-98b1-7ee4ffc0190a admin admin] The token cache is being invalidate because project ef3757825f1548319434cc9cfd99ba40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:33:38.294260 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ab67678f-44c4-4d7b-98b1-7ee4ffc0190a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:38.295172 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ab67678f-44c4-4d7b-98b1-7ee4ffc0190a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:38.296893 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1371/2760] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:33:38 2022] DELETE /identity/v3/projects/ef3757825f1548319434cc9cfd99ba40 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:38.300769 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709347ac-913f-4de5-b995-6ec79e6057aa service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:38.311129 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709347ac-913f-4de5-b995-6ec79e6057aa service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:38.376938 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8838913-ef8e-4fb4-86ce-f9dd449b0f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:38.377913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8838913-ef8e-4fb4-86ce-f9dd449b0f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:38.378194 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8838913-ef8e-4fb4-86ce-f9dd449b0f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:38.378470 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8838913-ef8e-4fb4-86ce-f9dd449b0f83 admin admin] PATH_INFO: `/v3/users/c5a5c0eaced0403291cbb1ca8e54387f` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:38.380902 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8838913-ef8e-4fb4-86ce-f9dd449b0f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5a5c0eaced0403291cbb1ca8e54387f)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:38.382716 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8838913-ef8e-4fb4-86ce-f9dd449b0f83 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:38.602330 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-b8838913-ef8e-4fb4-86ce-f9dd449b0f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5a5c0eaced0403291cbb1ca8e54387f'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:38.615052 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-b8838913-ef8e-4fb4-86ce-f9dd449b0f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5a5c0eaced0403291cbb1ca8e54387f'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:38.623332 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-b8838913-ef8e-4fb4-86ce-f9dd449b0f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5a5c0eaced0403291cbb1ca8e54387f'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:38.624042 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-b8838913-ef8e-4fb4-86ce-f9dd449b0f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5a5c0eaced0403291cbb1ca8e54387f'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:38.624984 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-b8838913-ef8e-4fb4-86ce-f9dd449b0f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5a5c0eaced0403291cbb1ca8e54387f'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:38.731655 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1390/2761] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:33:38 2022] DELETE /identity/v3/users/c5a5c0eaced0403291cbb1ca8e54387f => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:39.092790 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67678f-44c4-4d7b-98b1-7ee4ffc0190a admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:39.094278 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ab67678f-44c4-4d7b-98b1-7ee4ffc0190a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:39.107653 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67678f-44c4-4d7b-98b1-7ee4ffc0190a admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:39.168493 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760c4b8-593a-4c9a-8130-7794bc584690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:39.169358 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760c4b8-593a-4c9a-8130-7794bc584690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:39.169675 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760c4b8-593a-4c9a-8130-7794bc584690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:39.169908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760c4b8-593a-4c9a-8130-7794bc584690 admin admin] PATH_INFO: `/v3/projects/14c610ca3f5c49b081ff185ef5b92f05` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:39.171109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760c4b8-593a-4c9a-8130-7794bc584690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14c610ca3f5c49b081ff185ef5b92f05)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:39.173165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760c4b8-593a-4c9a-8130-7794bc584690 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:39.185418 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:39.263676 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c760c4b8-593a-4c9a-8130-7794bc584690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14c610ca3f5c49b081ff185ef5b92f05', 'request_id': 'req-c760c4b8-593a-4c9a-8130-7794bc584690'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:39.270151 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c760c4b8-593a-4c9a-8130-7794bc584690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14c610ca3f5c49b081ff185ef5b92f05', 'request_id': 'req-c760c4b8-593a-4c9a-8130-7794bc584690'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:39.394100 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c760c4b8-593a-4c9a-8130-7794bc584690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14c610ca3f5c49b081ff185ef5b92f05', 'request_id': 'req-c760c4b8-593a-4c9a-8130-7794bc584690'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:39.405347 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c760c4b8-593a-4c9a-8130-7794bc584690 admin admin] The token cache is being invalidate because project 14c610ca3f5c49b081ff185ef5b92f05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:33:39.405630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c760c4b8-593a-4c9a-8130-7794bc584690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:39.406355 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c760c4b8-593a-4c9a-8130-7794bc584690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:39.407952 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1372/2762] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:33:39 2022] DELETE /identity/v3/projects/14c610ca3f5c49b081ff185ef5b92f05 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:39.413616 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd722fd-cc42-4235-a781-d6c78d69b7e4 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:39.414149 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd722fd-cc42-4235-a781-d6c78d69b7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:39.414448 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd722fd-cc42-4235-a781-d6c78d69b7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:39.433034 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-1bd722fd-cc42-4235-a781-d6c78d69b7e4 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:39.434289 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-1bd722fd-cc42-4235-a781-d6c78d69b7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:39.456468 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:39.503393 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1391/2763] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:39.505086 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e92b4f-4a04-4e45-9975-778fffde6bf5 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:39.505352 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e92b4f-4a04-4e45-9975-778fffde6bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:39.505654 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e92b4f-4a04-4e45-9975-778fffde6bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:39.527054 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-83e92b4f-4a04-4e45-9975-778fffde6bf5 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:39.527054 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-83e92b4f-4a04-4e45-9975-778fffde6bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:39.535300 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1373/2764] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:39.539423 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd722fd-cc42-4235-a781-d6c78d69b7e4 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:39.549142 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd722fd-cc42-4235-a781-d6c78d69b7e4 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:39.555486 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31767799-ad2c-402a-8afe-890cd4c14dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:39.556187 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31767799-ad2c-402a-8afe-890cd4c14dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:39.556471 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31767799-ad2c-402a-8afe-890cd4c14dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:39.556745 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31767799-ad2c-402a-8afe-890cd4c14dd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:39.557471 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31767799-ad2c-402a-8afe-890cd4c14dd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:33:39.557780 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31767799-ad2c-402a-8afe-890cd4c14dd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:39.559391 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31767799-ad2c-402a-8afe-890cd4c14dd2 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:39.574595 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1392/2765] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:33:39.575715 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e92b4f-4a04-4e45-9975-778fffde6bf5 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:39.585474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e92b4f-4a04-4e45-9975-778fffde6bf5 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:39.590176 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bb141-bc19-4f4f-8757-eb427a566197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:39.590837 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bb141-bc19-4f4f-8757-eb427a566197 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:39.591122 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bb141-bc19-4f4f-8757-eb427a566197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:39.591401 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bb141-bc19-4f4f-8757-eb427a566197 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:39.592134 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bb141-bc19-4f4f-8757-eb427a566197 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:39.594062 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bb141-bc19-4f4f-8757-eb427a566197 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:39.745732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1374/2766] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:33:39 2022] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:33:39.751858 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31767799-ad2c-402a-8afe-890cd4c14dd2 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:39.762098 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31767799-ad2c-402a-8afe-890cd4c14dd2 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:39.819173 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426c228-aa05-41e3-80cb-8d40f0b4964c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:39.819844 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426c228-aa05-41e3-80cb-8d40f0b4964c admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:39.823485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426c228-aa05-41e3-80cb-8d40f0b4964c admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:39.823485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426c228-aa05-41e3-80cb-8d40f0b4964c admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:39.823485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426c228-aa05-41e3-80cb-8d40f0b4964c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:39.823485 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426c228-aa05-41e3-80cb-8d40f0b4964c admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:39.903687 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1393/2767] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:33:39 2022] POST /identity/v3/users => generated 291 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:33:39.907937 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bb141-bc19-4f4f-8757-eb427a566197 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:39.918792 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bb141-bc19-4f4f-8757-eb427a566197 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:39.923381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3627d9c-ce6e-47cc-a253-cf5155d83e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:39.924077 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3627d9c-ce6e-47cc-a253-cf5155d83e9c admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:39.924360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3627d9c-ce6e-47cc-a253-cf5155d83e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:39.924644 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3627d9c-ce6e-47cc-a253-cf5155d83e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:39.925391 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3627d9c-ce6e-47cc-a253-cf5155d83e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:39.926981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3627d9c-ce6e-47cc-a253-cf5155d83e9c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:39.937353 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1375/2768] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:39.941562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426c228-aa05-41e3-80cb-8d40f0b4964c admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:39.951731 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426c228-aa05-41e3-80cb-8d40f0b4964c admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:39.957709 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f78f3-2911-439b-a5f3-b5ac030b18ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:39.958394 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f78f3-2911-439b-a5f3-b5ac030b18ea admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:39.958676 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f78f3-2911-439b-a5f3-b5ac030b18ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:39.958949 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f78f3-2911-439b-a5f3-b5ac030b18ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:39.959699 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f78f3-2911-439b-a5f3-b5ac030b18ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:39.961347 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f78f3-2911-439b-a5f3-b5ac030b18ea admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:39.972303 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1394/2769] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:39.976702 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3627d9c-ce6e-47cc-a253-cf5155d83e9c admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:39.986687 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3627d9c-ce6e-47cc-a253-cf5155d83e9c admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:39.991422 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0260af-4ab4-4731-8256-197b5289d53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:39.992348 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0260af-4ab4-4731-8256-197b5289d53d admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:39.992638 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0260af-4ab4-4731-8256-197b5289d53d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:39.992912 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0260af-4ab4-4731-8256-197b5289d53d admin admin] PATH_INFO: `/v3/projects/b14708aeda2b48f9b2b225a71959a261/users/30d657ee8c984a708a82b1a27c04cac2/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:40.009437 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0260af-4ab4-4731-8256-197b5289d53d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b14708aeda2b48f9b2b225a71959a261, user_id=30d657ee8c984a708a82b1a27c04cac2, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:40.012174 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0260af-4ab4-4731-8256-197b5289d53d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:40.069893 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1376/2770] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:33:39 2022] PUT /identity/v3/projects/b14708aeda2b48f9b2b225a71959a261/users/30d657ee8c984a708a82b1a27c04cac2/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:33:40.082153 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ffedb-2437-4b9d-8fae-0c6cfdb4026e None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:40.082454 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ffedb-2437-4b9d-8fae-0c6cfdb4026e None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:40.082765 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ffedb-2437-4b9d-8fae-0c6cfdb4026e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:40.112556 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-f17ffedb-2437-4b9d-8fae-0c6cfdb4026e None None] MFA Rules not processed for user `30d657ee8c984a708a82b1a27c04cac2`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:40.113960 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-f17ffedb-2437-4b9d-8fae-0c6cfdb4026e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:40.182195 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1395/2771] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:40.187246 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0260af-4ab4-4731-8256-197b5289d53d admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:40.252966 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0260af-4ab4-4731-8256-197b5289d53d admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:40.258476 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea95995-b120-4f00-9ce5-68d130c6240d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:40.258645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea95995-b120-4f00-9ce5-68d130c6240d admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:40.258841 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea95995-b120-4f00-9ce5-68d130c6240d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:40.259121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea95995-b120-4f00-9ce5-68d130c6240d admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:40.259825 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea95995-b120-4f00-9ce5-68d130c6240d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:40.261775 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea95995-b120-4f00-9ce5-68d130c6240d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:40.407924 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1377/2772] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:33:40 2022] POST /identity/v3/projects => generated 381 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:33:40.411833 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ffedb-2437-4b9d-8fae-0c6cfdb4026e None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:40.422686 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ffedb-2437-4b9d-8fae-0c6cfdb4026e None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:40.443506 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:40.491311 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ee8f7-f37e-4360-a89d-9094f2477e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:40.492028 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ee8f7-f37e-4360-a89d-9094f2477e46 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:40.492345 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ee8f7-f37e-4360-a89d-9094f2477e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:40.492619 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ee8f7-f37e-4360-a89d-9094f2477e46 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:40.493333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ee8f7-f37e-4360-a89d-9094f2477e46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:40.495288 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ee8f7-f37e-4360-a89d-9094f2477e46 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:40.568465 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1396/2773] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:33:40 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:33:40.572783 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea95995-b120-4f00-9ce5-68d130c6240d admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:40.583720 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea95995-b120-4f00-9ce5-68d130c6240d admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:40.588680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0824f5-7ed5-4e5e-a2f8-97482239f10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:40.589346 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0824f5-7ed5-4e5e-a2f8-97482239f10f admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:40.589630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0824f5-7ed5-4e5e-a2f8-97482239f10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:40.589908 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0824f5-7ed5-4e5e-a2f8-97482239f10f admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:40.590761 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0824f5-7ed5-4e5e-a2f8-97482239f10f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:40.592272 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0824f5-7ed5-4e5e-a2f8-97482239f10f admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:40.605066 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1378/2774] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:33:40.609401 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ee8f7-f37e-4360-a89d-9094f2477e46 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:40.622599 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ee8f7-f37e-4360-a89d-9094f2477e46 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:40.627333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fbc5c-86bf-4308-8b5f-83861b160ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:40.628938 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fbc5c-86bf-4308-8b5f-83861b160ad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:40.629218 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fbc5c-86bf-4308-8b5f-83861b160ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:40.629493 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fbc5c-86bf-4308-8b5f-83861b160ad1 admin admin] PATH_INFO: `/v3/projects/53009ea3477c410c831464995fb53730/users/a15ae94bf9ae42429ce7bf3aef26497b/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:40.647328 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6fbc5c-86bf-4308-8b5f-83861b160ad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53009ea3477c410c831464995fb53730, user_id=a15ae94bf9ae42429ce7bf3aef26497b, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:40.650129 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6fbc5c-86bf-4308-8b5f-83861b160ad1 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:40.726947 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1397/2775] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:33:40 2022] PUT /identity/v3/projects/53009ea3477c410c831464995fb53730/users/a15ae94bf9ae42429ce7bf3aef26497b/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:40.731027 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0824f5-7ed5-4e5e-a2f8-97482239f10f admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:40.742248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0824f5-7ed5-4e5e-a2f8-97482239f10f admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:40.750103 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:40.823369 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a65ebe-fd93-4b44-a779-015448fffc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:40.824076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a65ebe-fd93-4b44-a779-015448fffc5b admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:40.824371 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a65ebe-fd93-4b44-a779-015448fffc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:40.824684 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a65ebe-fd93-4b44-a779-015448fffc5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:40.825526 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a65ebe-fd93-4b44-a779-015448fffc5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:40.827130 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a65ebe-fd93-4b44-a779-015448fffc5b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:40.840596 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1379/2776] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:40.841858 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fbc5c-86bf-4308-8b5f-83861b160ad1 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:40.854696 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fbc5c-86bf-4308-8b5f-83861b160ad1 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:40.867556 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a6973-be05-43f0-a664-691094ca376f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:40.868497 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a6973-be05-43f0-a664-691094ca376f admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:40.868965 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a6973-be05-43f0-a664-691094ca376f admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:40.869245 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a6973-be05-43f0-a664-691094ca376f admin admin] PATH_INFO: `/v3/projects/53009ea3477c410c831464995fb53730/users/a15ae94bf9ae42429ce7bf3aef26497b/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:40.871325 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a6973-be05-43f0-a664-691094ca376f admin admin] RBAC: Authorizing `identity:create_grant(project_id=53009ea3477c410c831464995fb53730, user_id=a15ae94bf9ae42429ce7bf3aef26497b, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:40.874049 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a6973-be05-43f0-a664-691094ca376f admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:40.884853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1398/2777] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:33:40 2022] PUT /identity/v3/projects/53009ea3477c410c831464995fb53730/users/a15ae94bf9ae42429ce7bf3aef26497b/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:40.895192 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195dbee-351a-4d82-aacd-df8f4eea9491 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:40.895479 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195dbee-351a-4d82-aacd-df8f4eea9491 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:40.895901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195dbee-351a-4d82-aacd-df8f4eea9491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:40.924267 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-7195dbee-351a-4d82-aacd-df8f4eea9491 None None] MFA Rules not processed for user `a15ae94bf9ae42429ce7bf3aef26497b`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:40.926096 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7195dbee-351a-4d82-aacd-df8f4eea9491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:40.996449 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1380/2778] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:41.006961 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a6973-be05-43f0-a664-691094ca376f admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:41.008664 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-177a6973-be05-43f0-a664-691094ca376f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:41.069692 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a6973-be05-43f0-a664-691094ca376f admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:41.077019 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b5e1c-1962-4f1b-9847-89cb02135df8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:41.078127 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b5e1c-1962-4f1b-9847-89cb02135df8 service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:41.078616 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b5e1c-1962-4f1b-9847-89cb02135df8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:41.078897 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b5e1c-1962-4f1b-9847-89cb02135df8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:41.089566 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b5e1c-1962-4f1b-9847-89cb02135df8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:41.091013 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b5e1c-1962-4f1b-9847-89cb02135df8 service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:41.101991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1399/2779] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:41.217407 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195dbee-351a-4d82-aacd-df8f4eea9491 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:41.228449 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195dbee-351a-4d82-aacd-df8f4eea9491 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:41.232130 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a712a-888c-4970-b404-b1198f765f15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:41.232884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a712a-888c-4970-b404-b1198f765f15 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:41.233163 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a712a-888c-4970-b404-b1198f765f15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:41.233438 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a712a-888c-4970-b404-b1198f765f15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:41.300424 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a712a-888c-4970-b404-b1198f765f15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:41.301963 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a712a-888c-4970-b404-b1198f765f15 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:41.311010 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1381/2780] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:44.451242 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b5e1c-1962-4f1b-9847-89cb02135df8 service cinder] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:44.513965 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b5e1c-1962-4f1b-9847-89cb02135df8 service cinder] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:44.519341 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb0983-589b-4e4d-a105-e06015795123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:44.522040 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb0983-589b-4e4d-a105-e06015795123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:44.522040 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb0983-589b-4e4d-a105-e06015795123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:44.522040 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb0983-589b-4e4d-a105-e06015795123 admin admin] PATH_INFO: `/v3/users/30d657ee8c984a708a82b1a27c04cac2` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:44.522040 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb0983-589b-4e4d-a105-e06015795123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30d657ee8c984a708a82b1a27c04cac2)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:44.524015 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb0983-589b-4e4d-a105-e06015795123 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:44.545783 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:44.706446 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-73bb0983-589b-4e4d-a105-e06015795123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30d657ee8c984a708a82b1a27c04cac2'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:44.723437 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-73bb0983-589b-4e4d-a105-e06015795123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30d657ee8c984a708a82b1a27c04cac2'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:44.731104 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-73bb0983-589b-4e4d-a105-e06015795123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30d657ee8c984a708a82b1a27c04cac2'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:44.731848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-73bb0983-589b-4e4d-a105-e06015795123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30d657ee8c984a708a82b1a27c04cac2'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:44.732489 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-73bb0983-589b-4e4d-a105-e06015795123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30d657ee8c984a708a82b1a27c04cac2'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:44.809043 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1400/2781] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:33:44 2022] DELETE /identity/v3/users/30d657ee8c984a708a82b1a27c04cac2 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:44.813499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7b606-6a60-42c6-bd02-e042ccc13592 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:44.813988 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7b606-6a60-42c6-bd02-e042ccc13592 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:44.814077 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7b606-6a60-42c6-bd02-e042ccc13592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:44.834166 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-0ea7b606-6a60-42c6-bd02-e042ccc13592 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:44.835362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0ea7b606-6a60-42c6-bd02-e042ccc13592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:44.859510 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:44.894515 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1382/2782] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:33:44.904107 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb0983-589b-4e4d-a105-e06015795123 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:44.905530 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-73bb0983-589b-4e4d-a105-e06015795123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:44.964772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb0983-589b-4e4d-a105-e06015795123 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:44.968959 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c132f-7cfe-4c63-a017-d4ba285eee06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:44.969626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c132f-7cfe-4c63-a017-d4ba285eee06 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:44.969904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c132f-7cfe-4c63-a017-d4ba285eee06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:44.970175 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c132f-7cfe-4c63-a017-d4ba285eee06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:44.984708 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c132f-7cfe-4c63-a017-d4ba285eee06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:44.987304 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c132f-7cfe-4c63-a017-d4ba285eee06 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:45.000729 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1401/2783] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:45.436166 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7b606-6a60-42c6-bd02-e042ccc13592 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:45.438034 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0ea7b606-6a60-42c6-bd02-e042ccc13592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:45.454045 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7b606-6a60-42c6-bd02-e042ccc13592 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:45.458024 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9d9e8-e45b-4e43-b6a9-3047b20a6cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:45.459437 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9d9e8-e45b-4e43-b6a9-3047b20a6cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:45.459735 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9d9e8-e45b-4e43-b6a9-3047b20a6cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:45.460054 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9d9e8-e45b-4e43-b6a9-3047b20a6cad admin admin] PATH_INFO: `/v3/projects/b14708aeda2b48f9b2b225a71959a261` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:45.461627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9d9e8-e45b-4e43-b6a9-3047b20a6cad admin admin] RBAC: Authorizing `identity:delete_project(project_id=b14708aeda2b48f9b2b225a71959a261)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:45.463527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9d9e8-e45b-4e43-b6a9-3047b20a6cad admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:45.562474 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-68d9d9e8-e45b-4e43-b6a9-3047b20a6cad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b14708aeda2b48f9b2b225a71959a261', 'request_id': 'req-68d9d9e8-e45b-4e43-b6a9-3047b20a6cad'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:45.569842 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-68d9d9e8-e45b-4e43-b6a9-3047b20a6cad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b14708aeda2b48f9b2b225a71959a261', 'request_id': 'req-68d9d9e8-e45b-4e43-b6a9-3047b20a6cad'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:45.737425 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-68d9d9e8-e45b-4e43-b6a9-3047b20a6cad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b14708aeda2b48f9b2b225a71959a261', 'request_id': 'req-68d9d9e8-e45b-4e43-b6a9-3047b20a6cad'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:45.748651 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-68d9d9e8-e45b-4e43-b6a9-3047b20a6cad admin admin] The token cache is being invalidate because project b14708aeda2b48f9b2b225a71959a261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:33:45.748943 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-68d9d9e8-e45b-4e43-b6a9-3047b20a6cad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:45.749658 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-68d9d9e8-e45b-4e43-b6a9-3047b20a6cad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:45.751319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1383/2784] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:33:45 2022] DELETE /identity/v3/projects/b14708aeda2b48f9b2b225a71959a261 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:45.755416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c132f-7cfe-4c63-a017-d4ba285eee06 service neutron] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:45.774429 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c132f-7cfe-4c63-a017-d4ba285eee06 service neutron] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:45.839092 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7ada8-8a68-489c-ad1a-f567a6336878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:45.839959 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7ada8-8a68-489c-ad1a-f567a6336878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:45.840268 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7ada8-8a68-489c-ad1a-f567a6336878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:45.840549 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7ada8-8a68-489c-ad1a-f567a6336878 admin admin] PATH_INFO: `/v3/users/a15ae94bf9ae42429ce7bf3aef26497b` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:45.841738 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7ada8-8a68-489c-ad1a-f567a6336878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a15ae94bf9ae42429ce7bf3aef26497b)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:45.843697 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7ada8-8a68-489c-ad1a-f567a6336878 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:46.030685 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:46.036542 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-26d7ada8-8a68-489c-ad1a-f567a6336878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a15ae94bf9ae42429ce7bf3aef26497b'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:46.057465 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-26d7ada8-8a68-489c-ad1a-f567a6336878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a15ae94bf9ae42429ce7bf3aef26497b'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:46.066541 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-26d7ada8-8a68-489c-ad1a-f567a6336878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a15ae94bf9ae42429ce7bf3aef26497b'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:46.067121 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-26d7ada8-8a68-489c-ad1a-f567a6336878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a15ae94bf9ae42429ce7bf3aef26497b'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:46.067731 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-26d7ada8-8a68-489c-ad1a-f567a6336878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a15ae94bf9ae42429ce7bf3aef26497b'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:46.131679 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1402/2785] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:33:45 2022] DELETE /identity/v3/users/a15ae94bf9ae42429ce7bf3aef26497b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:46.527009 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9d9e8-e45b-4e43-b6a9-3047b20a6cad admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:46.528494 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-68d9d9e8-e45b-4e43-b6a9-3047b20a6cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:46.550757 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9d9e8-e45b-4e43-b6a9-3047b20a6cad admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:46.610041 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab1710-9334-410d-8aa9-403f866e0cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:46.610958 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab1710-9334-410d-8aa9-403f866e0cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:46.611216 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab1710-9334-410d-8aa9-403f866e0cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:46.611492 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab1710-9334-410d-8aa9-403f866e0cdd admin admin] PATH_INFO: `/v3/projects/53009ea3477c410c831464995fb53730` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:46.613351 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab1710-9334-410d-8aa9-403f866e0cdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=53009ea3477c410c831464995fb53730)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:46.615245 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab1710-9334-410d-8aa9-403f866e0cdd admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:46.790079 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fcab1710-9334-410d-8aa9-403f866e0cdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53009ea3477c410c831464995fb53730', 'request_id': 'req-fcab1710-9334-410d-8aa9-403f866e0cdd'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:46.801492 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fcab1710-9334-410d-8aa9-403f866e0cdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53009ea3477c410c831464995fb53730', 'request_id': 'req-fcab1710-9334-410d-8aa9-403f866e0cdd'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:46.803524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:46.897262 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fcab1710-9334-410d-8aa9-403f866e0cdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53009ea3477c410c831464995fb53730', 'request_id': 'req-fcab1710-9334-410d-8aa9-403f866e0cdd'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:46.909139 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fcab1710-9334-410d-8aa9-403f866e0cdd admin admin] The token cache is being invalidate because project 53009ea3477c410c831464995fb53730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:33:46.909891 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fcab1710-9334-410d-8aa9-403f866e0cdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:46.911631 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fcab1710-9334-410d-8aa9-403f866e0cdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:46.913008 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1384/2786] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:33:46 2022] DELETE /identity/v3/projects/53009ea3477c410c831464995fb53730 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:46.917934 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01504a8c-ea9e-4448-b7a8-86766370b601 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:46.918399 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01504a8c-ea9e-4448-b7a8-86766370b601 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:46.918630 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01504a8c-ea9e-4448-b7a8-86766370b601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:46.937875 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-01504a8c-ea9e-4448-b7a8-86766370b601 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:46.939336 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-01504a8c-ea9e-4448-b7a8-86766370b601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:47.001705 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1403/2787] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:47.009465 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca33f3-8832-4811-be50-e5ec5b77b1fe None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:47.009756 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca33f3-8832-4811-be50-e5ec5b77b1fe None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:47.010031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca33f3-8832-4811-be50-e5ec5b77b1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:47.028554 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-aeca33f3-8832-4811-be50-e5ec5b77b1fe None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:47.029769 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-aeca33f3-8832-4811-be50-e5ec5b77b1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:47.038550 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1385/2788] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:47.042839 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01504a8c-ea9e-4448-b7a8-86766370b601 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:47.058276 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01504a8c-ea9e-4448-b7a8-86766370b601 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:47.063864 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b7cec-02da-4c48-9184-f7980c1c31e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:47.064613 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b7cec-02da-4c48-9184-f7980c1c31e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:47.064913 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b7cec-02da-4c48-9184-f7980c1c31e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:47.065582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b7cec-02da-4c48-9184-f7980c1c31e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:47.066331 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b7cec-02da-4c48-9184-f7980c1c31e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:33:47.066683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b7cec-02da-4c48-9184-f7980c1c31e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:47.068807 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b7cec-02da-4c48-9184-f7980c1c31e3 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:47.085754 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1404/2789] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:33:47.086903 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca33f3-8832-4811-be50-e5ec5b77b1fe None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:47.102126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca33f3-8832-4811-be50-e5ec5b77b1fe None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:47.109188 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5a2b0-1f21-4dc6-871e-d1766a90289e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:47.109872 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5a2b0-1f21-4dc6-871e-d1766a90289e admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:47.110159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5a2b0-1f21-4dc6-871e-d1766a90289e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:47.110432 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5a2b0-1f21-4dc6-871e-d1766a90289e admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:47.111144 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5a2b0-1f21-4dc6-871e-d1766a90289e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:47.113123 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5a2b0-1f21-4dc6-871e-d1766a90289e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:47.230882 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1386/2790] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:33:47 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:33:47.235036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b7cec-02da-4c48-9184-f7980c1c31e3 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:47.245275 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b7cec-02da-4c48-9184-f7980c1c31e3 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:47.307653 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae715d7-569e-4aba-9c98-73e90c29ff0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:47.308358 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae715d7-569e-4aba-9c98-73e90c29ff0c admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:47.308634 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae715d7-569e-4aba-9c98-73e90c29ff0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:47.308903 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae715d7-569e-4aba-9c98-73e90c29ff0c admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:47.309823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae715d7-569e-4aba-9c98-73e90c29ff0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:47.311798 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae715d7-569e-4aba-9c98-73e90c29ff0c admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:47.390048 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1405/2791] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:33:47 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:33:47.392879 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5a2b0-1f21-4dc6-871e-d1766a90289e admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:47.404133 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5a2b0-1f21-4dc6-871e-d1766a90289e admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:47.409442 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26604eab-2579-4d22-8062-9775518a6d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:47.410101 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26604eab-2579-4d22-8062-9775518a6d30 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:47.410497 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26604eab-2579-4d22-8062-9775518a6d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:47.416388 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26604eab-2579-4d22-8062-9775518a6d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:47.416388 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26604eab-2579-4d22-8062-9775518a6d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:47.416388 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26604eab-2579-4d22-8062-9775518a6d30 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:47.423791 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1387/2792] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:47.428034 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae715d7-569e-4aba-9c98-73e90c29ff0c admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:47.437922 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae715d7-569e-4aba-9c98-73e90c29ff0c admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:47.443530 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10200016-700a-4b83-a12a-a95b03430e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:47.444262 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10200016-700a-4b83-a12a-a95b03430e0f admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:47.444545 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10200016-700a-4b83-a12a-a95b03430e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:47.444818 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10200016-700a-4b83-a12a-a95b03430e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:47.445538 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10200016-700a-4b83-a12a-a95b03430e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:47.447155 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10200016-700a-4b83-a12a-a95b03430e0f admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:47.457730 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1406/2793] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:47.461906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26604eab-2579-4d22-8062-9775518a6d30 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:47.472714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26604eab-2579-4d22-8062-9775518a6d30 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:47.477537 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9b8a7-8fbf-4b04-809d-3b18a06376d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:47.478654 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9b8a7-8fbf-4b04-809d-3b18a06376d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:47.478930 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9b8a7-8fbf-4b04-809d-3b18a06376d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:47.479211 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9b8a7-8fbf-4b04-809d-3b18a06376d7 admin admin] PATH_INFO: `/v3/projects/6a1743282cf8444992141133948487e9/users/45463c6924914e869e9e06f189e8e694/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:47.499282 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9b8a7-8fbf-4b04-809d-3b18a06376d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1743282cf8444992141133948487e9, user_id=45463c6924914e869e9e06f189e8e694, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:47.502021 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9b8a7-8fbf-4b04-809d-3b18a06376d7 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:47.600972 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1388/2794] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:33:47 2022] PUT /identity/v3/projects/6a1743282cf8444992141133948487e9/users/45463c6924914e869e9e06f189e8e694/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:33:47.612451 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc40dac-daae-4613-8258-91d933a45647 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:47.612734 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc40dac-daae-4613-8258-91d933a45647 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:47.613039 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc40dac-daae-4613-8258-91d933a45647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:47.641258 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-acc40dac-daae-4613-8258-91d933a45647 None None] MFA Rules not processed for user `45463c6924914e869e9e06f189e8e694`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:47.642525 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-acc40dac-daae-4613-8258-91d933a45647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:47.655185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:47.709955 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1407/2795] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:47.714889 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9b8a7-8fbf-4b04-809d-3b18a06376d7 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:47.784828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9b8a7-8fbf-4b04-809d-3b18a06376d7 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:47.789411 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38011e3-8c75-482e-9502-e1c4c90ac08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:47.790066 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38011e3-8c75-482e-9502-e1c4c90ac08a admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:47.790347 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38011e3-8c75-482e-9502-e1c4c90ac08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:47.790626 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38011e3-8c75-482e-9502-e1c4c90ac08a admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:47.791343 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38011e3-8c75-482e-9502-e1c4c90ac08a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:47.793278 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38011e3-8c75-482e-9502-e1c4c90ac08a admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:47.887590 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1389/2796] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:33:47 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:33:47.891988 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc40dac-daae-4613-8258-91d933a45647 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:47.903456 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc40dac-daae-4613-8258-91d933a45647 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:47.962289 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae13275-0eae-46cf-94ea-3e8691c1c75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:47.962963 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae13275-0eae-46cf-94ea-3e8691c1c75d admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:47.963246 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae13275-0eae-46cf-94ea-3e8691c1c75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:47.963519 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae13275-0eae-46cf-94ea-3e8691c1c75d admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:47.964253 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae13275-0eae-46cf-94ea-3e8691c1c75d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:47.966239 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae13275-0eae-46cf-94ea-3e8691c1c75d admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:48.057770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1408/2797] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:33:47 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:33:48.061864 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38011e3-8c75-482e-9502-e1c4c90ac08a admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:48.073227 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38011e3-8c75-482e-9502-e1c4c90ac08a admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:48.077803 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971e382-db59-4a0c-9e05-5d3e04a857ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:48.078518 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971e382-db59-4a0c-9e05-5d3e04a857ed admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:48.078793 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971e382-db59-4a0c-9e05-5d3e04a857ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:48.079063 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971e382-db59-4a0c-9e05-5d3e04a857ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:48.079782 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971e382-db59-4a0c-9e05-5d3e04a857ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:48.081404 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971e382-db59-4a0c-9e05-5d3e04a857ed admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:48.092164 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1390/2798] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:48.096108 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae13275-0eae-46cf-94ea-3e8691c1c75d admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:48.106015 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae13275-0eae-46cf-94ea-3e8691c1c75d admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:48.110552 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ae908-2c5c-4a9a-a46d-22b3e5ea03ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:48.111201 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ae908-2c5c-4a9a-a46d-22b3e5ea03ec admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:48.111478 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ae908-2c5c-4a9a-a46d-22b3e5ea03ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:48.112316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ae908-2c5c-4a9a-a46d-22b3e5ea03ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:48.113037 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ae908-2c5c-4a9a-a46d-22b3e5ea03ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:48.114628 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ae908-2c5c-4a9a-a46d-22b3e5ea03ec admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:48.127064 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1409/2799] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:48.152534 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971e382-db59-4a0c-9e05-5d3e04a857ed admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:48.152534 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971e382-db59-4a0c-9e05-5d3e04a857ed admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:48.152998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8c1fd-1820-446f-ac08-ab726f7479ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:48.154019 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8c1fd-1820-446f-ac08-ab726f7479ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:48.154019 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8c1fd-1820-446f-ac08-ab726f7479ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:48.154249 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8c1fd-1820-446f-ac08-ab726f7479ae admin admin] PATH_INFO: `/v3/projects/33a76dbdb7a74d2684d34b2f1bbb4f78/users/cecbefda8825424cbaaa712aa15ec4af/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:48.171560 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8c1fd-1820-446f-ac08-ab726f7479ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a76dbdb7a74d2684d34b2f1bbb4f78, user_id=cecbefda8825424cbaaa712aa15ec4af, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:48.174995 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8c1fd-1820-446f-ac08-ab726f7479ae admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:48.262943 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1391/2800] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:33:48 2022] PUT /identity/v3/projects/33a76dbdb7a74d2684d34b2f1bbb4f78/users/cecbefda8825424cbaaa712aa15ec4af/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:48.273171 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed243d8-6d83-40fe-a113-f9fac32e2cf2 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:48.273460 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed243d8-6d83-40fe-a113-f9fac32e2cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:48.273737 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed243d8-6d83-40fe-a113-f9fac32e2cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:48.302461 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-aed243d8-6d83-40fe-a113-f9fac32e2cf2 None None] MFA Rules not processed for user `cecbefda8825424cbaaa712aa15ec4af`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:48.303727 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-aed243d8-6d83-40fe-a113-f9fac32e2cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:48.379588 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1410/2801] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:48.384504 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8c1fd-1820-446f-ac08-ab726f7479ae admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:48.423822 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:48.453859 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8c1fd-1820-446f-ac08-ab726f7479ae admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:48.461441 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1bfc1-4f39-434a-98a7-4a0e1559595d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:48.462112 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1bfc1-4f39-434a-98a7-4a0e1559595d admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:48.479670 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1bfc1-4f39-434a-98a7-4a0e1559595d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:48.479670 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1bfc1-4f39-434a-98a7-4a0e1559595d admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:48.479670 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1bfc1-4f39-434a-98a7-4a0e1559595d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:48.479670 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1bfc1-4f39-434a-98a7-4a0e1559595d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:48.588039 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1392/2802] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:33:48 2022] POST /identity/v3/projects => generated 379 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:33:48.597473 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed243d8-6d83-40fe-a113-f9fac32e2cf2 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:48.608357 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed243d8-6d83-40fe-a113-f9fac32e2cf2 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:48.627371 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:48.666616 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84bfdf-3b73-466b-829b-3c8af0103f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:48.667307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84bfdf-3b73-466b-829b-3c8af0103f6c admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:48.667587 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84bfdf-3b73-466b-829b-3c8af0103f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:48.667927 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84bfdf-3b73-466b-829b-3c8af0103f6c admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:48.668618 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84bfdf-3b73-466b-829b-3c8af0103f6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:48.670562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84bfdf-3b73-466b-829b-3c8af0103f6c admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:48.777709 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1411/2803] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:33:48 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:33:48.779014 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1bfc1-4f39-434a-98a7-4a0e1559595d admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:48.794197 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1bfc1-4f39-434a-98a7-4a0e1559595d admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:48.804387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5e111-392c-4269-9daa-9419530d29b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:48.805499 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5e111-392c-4269-9daa-9419530d29b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:48.805999 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5e111-392c-4269-9daa-9419530d29b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:48.806492 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5e111-392c-4269-9daa-9419530d29b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:48.807850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5e111-392c-4269-9daa-9419530d29b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:48.811023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5e111-392c-4269-9daa-9419530d29b8 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:48.832434 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1393/2804] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:48.836575 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84bfdf-3b73-466b-829b-3c8af0103f6c admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:48.849292 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84bfdf-3b73-466b-829b-3c8af0103f6c admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:48.854175 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4098a5-f4a2-4125-b8f2-4c0ac7dab512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:48.855132 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4098a5-f4a2-4125-b8f2-4c0ac7dab512 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:48.855416 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4098a5-f4a2-4125-b8f2-4c0ac7dab512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:48.855735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4098a5-f4a2-4125-b8f2-4c0ac7dab512 admin admin] PATH_INFO: `/v3/projects/4acb0c7458ad4a64bbdae4e3798dd5ae/users/9918258469c240afb93deae6a5913a64/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:48.870542 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4098a5-f4a2-4125-b8f2-4c0ac7dab512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4acb0c7458ad4a64bbdae4e3798dd5ae, user_id=9918258469c240afb93deae6a5913a64, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:48.873295 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4098a5-f4a2-4125-b8f2-4c0ac7dab512 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:48.944368 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1412/2805] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:33:48 2022] PUT /identity/v3/projects/4acb0c7458ad4a64bbdae4e3798dd5ae/users/9918258469c240afb93deae6a5913a64/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:33:48.948397 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5e111-392c-4269-9daa-9419530d29b8 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:48.959438 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5e111-392c-4269-9daa-9419530d29b8 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:49.016868 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2fb34-eeba-419a-9a3d-ac91a2a9dd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:49.017730 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2fb34-eeba-419a-9a3d-ac91a2a9dd33 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:49.018680 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2fb34-eeba-419a-9a3d-ac91a2a9dd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:49.018965 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2fb34-eeba-419a-9a3d-ac91a2a9dd33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:49.019693 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2fb34-eeba-419a-9a3d-ac91a2a9dd33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:49.021426 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2fb34-eeba-419a-9a3d-ac91a2a9dd33 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:49.031422 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1394/2806] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:49.035775 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4098a5-f4a2-4125-b8f2-4c0ac7dab512 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:49.046037 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4098a5-f4a2-4125-b8f2-4c0ac7dab512 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:49.050702 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a1c67-ba23-4c6a-b301-d1ec9721ec76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:49.051597 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a1c67-ba23-4c6a-b301-d1ec9721ec76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:49.051878 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a1c67-ba23-4c6a-b301-d1ec9721ec76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:49.052185 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a1c67-ba23-4c6a-b301-d1ec9721ec76 admin admin] PATH_INFO: `/v3/projects/4acb0c7458ad4a64bbdae4e3798dd5ae/users/9918258469c240afb93deae6a5913a64/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:49.055026 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a1c67-ba23-4c6a-b301-d1ec9721ec76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4acb0c7458ad4a64bbdae4e3798dd5ae, user_id=9918258469c240afb93deae6a5913a64, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:49.056890 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a1c67-ba23-4c6a-b301-d1ec9721ec76 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:49.068294 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1413/2807] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:33:49 2022] PUT /identity/v3/projects/4acb0c7458ad4a64bbdae4e3798dd5ae/users/9918258469c240afb93deae6a5913a64/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:49.079710 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ca4e0-5fc0-4f4f-8f95-a17e04a79814 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:49.080013 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ca4e0-5fc0-4f4f-8f95-a17e04a79814 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:49.080320 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ca4e0-5fc0-4f4f-8f95-a17e04a79814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:49.107217 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-ee5ca4e0-5fc0-4f4f-8f95-a17e04a79814 None None] MFA Rules not processed for user `9918258469c240afb93deae6a5913a64`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:49.108450 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ee5ca4e0-5fc0-4f4f-8f95-a17e04a79814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:49.177385 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1395/2808] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:33:49.189246 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a1c67-ba23-4c6a-b301-d1ec9721ec76 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:49.191834 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-e39a1c67-ba23-4c6a-b301-d1ec9721ec76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:49.260290 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a1c67-ba23-4c6a-b301-d1ec9721ec76 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:49.264156 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e2a19-8e5d-4620-ae59-700ce71710e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:49.264819 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e2a19-8e5d-4620-ae59-700ce71710e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:49.265099 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e2a19-8e5d-4620-ae59-700ce71710e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:49.265376 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e2a19-8e5d-4620-ae59-700ce71710e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:49.275765 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e2a19-8e5d-4620-ae59-700ce71710e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:49.277238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e2a19-8e5d-4620-ae59-700ce71710e7 service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:49.286809 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1414/2809] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:49.407797 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ca4e0-5fc0-4f4f-8f95-a17e04a79814 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:49.409358 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ee5ca4e0-5fc0-4f4f-8f95-a17e04a79814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:49.421443 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ca4e0-5fc0-4f4f-8f95-a17e04a79814 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:49.425489 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b6024-19ad-45b0-9b4c-b00b45de7952 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:49.426126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b6024-19ad-45b0-9b4c-b00b45de7952 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:49.426405 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b6024-19ad-45b0-9b4c-b00b45de7952 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:49.426676 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b6024-19ad-45b0-9b4c-b00b45de7952 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:49.448109 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:49.483352 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b6024-19ad-45b0-9b4c-b00b45de7952 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:49.484821 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b6024-19ad-45b0-9b4c-b00b45de7952 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:49.496569 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1396/2810] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:53.617364 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e2a19-8e5d-4620-ae59-700ce71710e7 service cinder] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:53.618844 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-894e2a19-8e5d-4620-ae59-700ce71710e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:53.697540 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e2a19-8e5d-4620-ae59-700ce71710e7 service cinder] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:53.703589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef440988-7f84-4433-bcb6-73013715dc66 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ebc95c1b3284c1d8321900cf442a811', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:53.704501 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef440988-7f84-4433-bcb6-73013715dc66 service placement] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:53.704914 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef440988-7f84-4433-bcb6-73013715dc66 service placement] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:53.705297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef440988-7f84-4433-bcb6-73013715dc66 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:53.707281 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-ef440988-7f84-4433-bcb6-73013715dc66 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:53.720479 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef440988-7f84-4433-bcb6-73013715dc66 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:53.723451 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef440988-7f84-4433-bcb6-73013715dc66 service placement] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:53.735232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1415/2811] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:54.062117 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b6024-19ad-45b0-9b4c-b00b45de7952 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:54.063618 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-907b6024-19ad-45b0-9b4c-b00b45de7952 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:54.078975 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef440988-7f84-4433-bcb6-73013715dc66 service placement] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:54.089240 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:54.145923 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b6024-19ad-45b0-9b4c-b00b45de7952 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:54.150759 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f0ff4-6d14-435f-a8a8-572f170b74c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:54.151770 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f0ff4-6d14-435f-a8a8-572f170b74c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:54.152092 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f0ff4-6d14-435f-a8a8-572f170b74c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:54.155050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f0ff4-6d14-435f-a8a8-572f170b74c9 admin admin] PATH_INFO: `/v3/users/b73ac3812b9741b0b09a30c592fe7af2` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:54.155050 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f0ff4-6d14-435f-a8a8-572f170b74c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b73ac3812b9741b0b09a30c592fe7af2)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:54.155363 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef440988-7f84-4433-bcb6-73013715dc66 service placement] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:54.155714 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f0ff4-6d14-435f-a8a8-572f170b74c9 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:54.159399 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed20e0b-2a6f-4d22-9ad8-d1d666116cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:54.160840 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed20e0b-2a6f-4d22-9ad8-d1d666116cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:54.161128 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed20e0b-2a6f-4d22-9ad8-d1d666116cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:54.161400 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed20e0b-2a6f-4d22-9ad8-d1d666116cc2 admin admin] PATH_INFO: `/v3/users/45463c6924914e869e9e06f189e8e694` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:54.162613 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed20e0b-2a6f-4d22-9ad8-d1d666116cc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45463c6924914e869e9e06f189e8e694)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:54.164862 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed20e0b-2a6f-4d22-9ad8-d1d666116cc2 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:54.323208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-303f0ff4-6d14-435f-a8a8-572f170b74c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b73ac3812b9741b0b09a30c592fe7af2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:54.323432 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-7ed20e0b-2a6f-4d22-9ad8-d1d666116cc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45463c6924914e869e9e06f189e8e694'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:54.331008 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-303f0ff4-6d14-435f-a8a8-572f170b74c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b73ac3812b9741b0b09a30c592fe7af2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:54.332775 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-303f0ff4-6d14-435f-a8a8-572f170b74c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b73ac3812b9741b0b09a30c592fe7af2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:54.333510 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-303f0ff4-6d14-435f-a8a8-572f170b74c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b73ac3812b9741b0b09a30c592fe7af2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:54.337069 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-7ed20e0b-2a6f-4d22-9ad8-d1d666116cc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45463c6924914e869e9e06f189e8e694'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:54.344269 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-7ed20e0b-2a6f-4d22-9ad8-d1d666116cc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45463c6924914e869e9e06f189e8e694'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:54.344973 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-7ed20e0b-2a6f-4d22-9ad8-d1d666116cc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45463c6924914e869e9e06f189e8e694'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:54.345691 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-7ed20e0b-2a6f-4d22-9ad8-d1d666116cc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45463c6924914e869e9e06f189e8e694'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:54.346411 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-303f0ff4-6d14-435f-a8a8-572f170b74c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b73ac3812b9741b0b09a30c592fe7af2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:54.417735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1416/2812] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:33:54 2022] DELETE /identity/v3/users/45463c6924914e869e9e06f189e8e694 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:54.422254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c63b15-a9a0-4a5e-a74e-06f938835d49 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:54.422548 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c63b15-a9a0-4a5e-a74e-06f938835d49 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:54.422844 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c63b15-a9a0-4a5e-a74e-06f938835d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:54.439888 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-f9c63b15-a9a0-4a5e-a74e-06f938835d49 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:54.441893 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-f9c63b15-a9a0-4a5e-a74e-06f938835d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:54.475208 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1397/2813] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:33:54 2022] DELETE /identity/v3/users/b73ac3812b9741b0b09a30c592fe7af2 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:54.508497 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1417/2814] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:33:54.518399 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f0ff4-6d14-435f-a8a8-572f170b74c9 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:54.520630 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-303f0ff4-6d14-435f-a8a8-572f170b74c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:54.579665 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:54.592901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f0ff4-6d14-435f-a8a8-572f170b74c9 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:54.595687 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8889954-7b9a-46cd-94bc-6a6cc671b1ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:54.596498 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8889954-7b9a-46cd-94bc-6a6cc671b1ff service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:54.596859 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8889954-7b9a-46cd-94bc-6a6cc671b1ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:54.597284 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8889954-7b9a-46cd-94bc-6a6cc671b1ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:54.678778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8889954-7b9a-46cd-94bc-6a6cc671b1ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:54.680259 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8889954-7b9a-46cd-94bc-6a6cc671b1ff service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:54.691376 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1398/2815] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:54.790154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c63b15-a9a0-4a5e-a74e-06f938835d49 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:54.792361 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-f9c63b15-a9a0-4a5e-a74e-06f938835d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:54.810683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c63b15-a9a0-4a5e-a74e-06f938835d49 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:54.817819 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ec2da-6eda-4a8c-98ed-6bd849435b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:54.817819 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ec2da-6eda-4a8c-98ed-6bd849435b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:54.817819 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ec2da-6eda-4a8c-98ed-6bd849435b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:54.817819 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ec2da-6eda-4a8c-98ed-6bd849435b0b admin admin] PATH_INFO: `/v3/projects/09d0fa6f616d4fcba8dad7b9924864a7` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:54.818998 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ec2da-6eda-4a8c-98ed-6bd849435b0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d0fa6f616d4fcba8dad7b9924864a7)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:54.820944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ec2da-6eda-4a8c-98ed-6bd849435b0b admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:54.844866 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:54.943402 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-f12ec2da-6eda-4a8c-98ed-6bd849435b0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d0fa6f616d4fcba8dad7b9924864a7', 'request_id': 'req-f12ec2da-6eda-4a8c-98ed-6bd849435b0b'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:55.011438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-f12ec2da-6eda-4a8c-98ed-6bd849435b0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d0fa6f616d4fcba8dad7b9924864a7', 'request_id': 'req-f12ec2da-6eda-4a8c-98ed-6bd849435b0b'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:55.018497 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-f12ec2da-6eda-4a8c-98ed-6bd849435b0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d0fa6f616d4fcba8dad7b9924864a7', 'request_id': 'req-f12ec2da-6eda-4a8c-98ed-6bd849435b0b'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:55.030297 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-f12ec2da-6eda-4a8c-98ed-6bd849435b0b admin admin] The token cache is being invalidate because project 09d0fa6f616d4fcba8dad7b9924864a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:33:55.030580 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-f12ec2da-6eda-4a8c-98ed-6bd849435b0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:55.031230 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-f12ec2da-6eda-4a8c-98ed-6bd849435b0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:55.032832 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1418/2816] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:33:54 2022] DELETE /identity/v3/projects/09d0fa6f616d4fcba8dad7b9924864a7 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:55.087415 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8889954-7b9a-46cd-94bc-6a6cc671b1ff service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:55.087415 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f8889954-7b9a-46cd-94bc-6a6cc671b1ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:55.101232 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8889954-7b9a-46cd-94bc-6a6cc671b1ff service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:55.190660 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bdd9e-de1c-4ac5-a89c-f7123b1f6789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:55.193610 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bdd9e-de1c-4ac5-a89c-f7123b1f6789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:55.193610 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bdd9e-de1c-4ac5-a89c-f7123b1f6789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:55.193610 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bdd9e-de1c-4ac5-a89c-f7123b1f6789 admin admin] PATH_INFO: `/v3/projects/6a1743282cf8444992141133948487e9` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:55.193610 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bdd9e-de1c-4ac5-a89c-f7123b1f6789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a1743282cf8444992141133948487e9)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:55.195573 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bdd9e-de1c-4ac5-a89c-f7123b1f6789 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:55.323620 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6d9bdd9e-de1c-4ac5-a89c-f7123b1f6789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a1743282cf8444992141133948487e9', 'request_id': 'req-6d9bdd9e-de1c-4ac5-a89c-f7123b1f6789'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:55.330111 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6d9bdd9e-de1c-4ac5-a89c-f7123b1f6789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a1743282cf8444992141133948487e9', 'request_id': 'req-6d9bdd9e-de1c-4ac5-a89c-f7123b1f6789'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:55.411748 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6d9bdd9e-de1c-4ac5-a89c-f7123b1f6789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a1743282cf8444992141133948487e9', 'request_id': 'req-6d9bdd9e-de1c-4ac5-a89c-f7123b1f6789'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:55.422860 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6d9bdd9e-de1c-4ac5-a89c-f7123b1f6789 admin admin] The token cache is being invalidate because project 6a1743282cf8444992141133948487e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:33:55.425559 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6d9bdd9e-de1c-4ac5-a89c-f7123b1f6789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:55.425559 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6d9bdd9e-de1c-4ac5-a89c-f7123b1f6789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:55.425559 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1399/2817] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:33:55 2022] DELETE /identity/v3/projects/6a1743282cf8444992141133948487e9 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:55.429222 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ec2da-6eda-4a8c-98ed-6bd849435b0b admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:55.430610 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-f12ec2da-6eda-4a8c-98ed-6bd849435b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:55.443953 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ec2da-6eda-4a8c-98ed-6bd849435b0b admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:55.501666 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26910007-2aa1-4c0c-be4b-bf5d9165d563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:55.502553 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26910007-2aa1-4c0c-be4b-bf5d9165d563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:55.502835 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26910007-2aa1-4c0c-be4b-bf5d9165d563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:55.503138 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26910007-2aa1-4c0c-be4b-bf5d9165d563 admin admin] PATH_INFO: `/v3/users/cecbefda8825424cbaaa712aa15ec4af` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:55.504405 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26910007-2aa1-4c0c-be4b-bf5d9165d563 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cecbefda8825424cbaaa712aa15ec4af)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:55.506382 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26910007-2aa1-4c0c-be4b-bf5d9165d563 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:55.745473 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-26910007-2aa1-4c0c-be4b-bf5d9165d563 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cecbefda8825424cbaaa712aa15ec4af'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:55.758516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-26910007-2aa1-4c0c-be4b-bf5d9165d563 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cecbefda8825424cbaaa712aa15ec4af'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:55.765315 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-26910007-2aa1-4c0c-be4b-bf5d9165d563 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cecbefda8825424cbaaa712aa15ec4af'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:55.766242 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-26910007-2aa1-4c0c-be4b-bf5d9165d563 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cecbefda8825424cbaaa712aa15ec4af'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:55.766924 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-26910007-2aa1-4c0c-be4b-bf5d9165d563 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cecbefda8825424cbaaa712aa15ec4af'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:55.862819 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1419/2818] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:33:55 2022] DELETE /identity/v3/users/cecbefda8825424cbaaa712aa15ec4af => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:56.247345 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bdd9e-de1c-4ac5-a89c-f7123b1f6789 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:56.248808 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6d9bdd9e-de1c-4ac5-a89c-f7123b1f6789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:56.264091 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bdd9e-de1c-4ac5-a89c-f7123b1f6789 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:56.284413 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:56.325552 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b27437-802a-4f6b-8f6d-24078a81dd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:56.326428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b27437-802a-4f6b-8f6d-24078a81dd5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:56.326713 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b27437-802a-4f6b-8f6d-24078a81dd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:56.326989 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b27437-802a-4f6b-8f6d-24078a81dd5c admin admin] PATH_INFO: `/v3/projects/33a76dbdb7a74d2684d34b2f1bbb4f78` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:56.328250 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b27437-802a-4f6b-8f6d-24078a81dd5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=33a76dbdb7a74d2684d34b2f1bbb4f78)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:56.330165 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b27437-802a-4f6b-8f6d-24078a81dd5c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:56.453343 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-18b27437-802a-4f6b-8f6d-24078a81dd5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33a76dbdb7a74d2684d34b2f1bbb4f78', 'request_id': 'req-18b27437-802a-4f6b-8f6d-24078a81dd5c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:56.459655 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-18b27437-802a-4f6b-8f6d-24078a81dd5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33a76dbdb7a74d2684d34b2f1bbb4f78', 'request_id': 'req-18b27437-802a-4f6b-8f6d-24078a81dd5c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:56.559659 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-18b27437-802a-4f6b-8f6d-24078a81dd5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33a76dbdb7a74d2684d34b2f1bbb4f78', 'request_id': 'req-18b27437-802a-4f6b-8f6d-24078a81dd5c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:56.572138 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-18b27437-802a-4f6b-8f6d-24078a81dd5c admin admin] The token cache is being invalidate because project 33a76dbdb7a74d2684d34b2f1bbb4f78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:33:56.572428 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-18b27437-802a-4f6b-8f6d-24078a81dd5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:56.573113 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-18b27437-802a-4f6b-8f6d-24078a81dd5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:56.574685 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1400/2819] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:33:56 2022] DELETE /identity/v3/projects/33a76dbdb7a74d2684d34b2f1bbb4f78 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:56.578777 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26910007-2aa1-4c0c-be4b-bf5d9165d563 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:56.580350 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-26910007-2aa1-4c0c-be4b-bf5d9165d563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:56.593715 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26910007-2aa1-4c0c-be4b-bf5d9165d563 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:56.623768 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:56.657051 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2d906-d2f3-4d1f-a7bd-c470d6f68c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:56.657940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2d906-d2f3-4d1f-a7bd-c470d6f68c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:56.658249 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2d906-d2f3-4d1f-a7bd-c470d6f68c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:56.658499 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2d906-d2f3-4d1f-a7bd-c470d6f68c60 admin admin] PATH_INFO: `/v3/users/9918258469c240afb93deae6a5913a64` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:56.660312 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2d906-d2f3-4d1f-a7bd-c470d6f68c60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9918258469c240afb93deae6a5913a64)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:56.662271 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2d906-d2f3-4d1f-a7bd-c470d6f68c60 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:56.860678 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4fd2d906-d2f3-4d1f-a7bd-c470d6f68c60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9918258469c240afb93deae6a5913a64'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:56.872487 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4fd2d906-d2f3-4d1f-a7bd-c470d6f68c60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9918258469c240afb93deae6a5913a64'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:56.879567 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4fd2d906-d2f3-4d1f-a7bd-c470d6f68c60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9918258469c240afb93deae6a5913a64'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:56.880320 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4fd2d906-d2f3-4d1f-a7bd-c470d6f68c60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9918258469c240afb93deae6a5913a64'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:56.880961 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-4fd2d906-d2f3-4d1f-a7bd-c470d6f68c60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9918258469c240afb93deae6a5913a64'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:56.972555 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1420/2820] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:33:56 2022] DELETE /identity/v3/users/9918258469c240afb93deae6a5913a64 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:57.407416 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b27437-802a-4f6b-8f6d-24078a81dd5c admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:57.409158 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-18b27437-802a-4f6b-8f6d-24078a81dd5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:57.422852 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b27437-802a-4f6b-8f6d-24078a81dd5c admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:57.482527 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c503d2c-5ab5-45ba-ab04-a6e4d8e360a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:57.483470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c503d2c-5ab5-45ba-ab04-a6e4d8e360a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:57.483766 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c503d2c-5ab5-45ba-ab04-a6e4d8e360a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:57.484100 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c503d2c-5ab5-45ba-ab04-a6e4d8e360a6 admin admin] PATH_INFO: `/v3/projects/4acb0c7458ad4a64bbdae4e3798dd5ae` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:57.485310 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c503d2c-5ab5-45ba-ab04-a6e4d8e360a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4acb0c7458ad4a64bbdae4e3798dd5ae)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:57.487225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c503d2c-5ab5-45ba-ab04-a6e4d8e360a6 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:57.623718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0c503d2c-5ab5-45ba-ab04-a6e4d8e360a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4acb0c7458ad4a64bbdae4e3798dd5ae', 'request_id': 'req-0c503d2c-5ab5-45ba-ab04-a6e4d8e360a6'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:57.630718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0c503d2c-5ab5-45ba-ab04-a6e4d8e360a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4acb0c7458ad4a64bbdae4e3798dd5ae', 'request_id': 'req-0c503d2c-5ab5-45ba-ab04-a6e4d8e360a6'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:57.632455 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:57.687376 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0c503d2c-5ab5-45ba-ab04-a6e4d8e360a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4acb0c7458ad4a64bbdae4e3798dd5ae', 'request_id': 'req-0c503d2c-5ab5-45ba-ab04-a6e4d8e360a6'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:57.700653 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0c503d2c-5ab5-45ba-ab04-a6e4d8e360a6 admin admin] The token cache is being invalidate because project 4acb0c7458ad4a64bbdae4e3798dd5ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:33:57.701058 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0c503d2c-5ab5-45ba-ab04-a6e4d8e360a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:57.701749 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0c503d2c-5ab5-45ba-ab04-a6e4d8e360a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:57.703295 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1401/2821] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:33:57 2022] DELETE /identity/v3/projects/4acb0c7458ad4a64bbdae4e3798dd5ae => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:57.710460 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af90db-fa26-4bfd-b463-415828c0bb90 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:57.710744 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af90db-fa26-4bfd-b463-415828c0bb90 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:57.711015 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af90db-fa26-4bfd-b463-415828c0bb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:57.729481 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-f5af90db-fa26-4bfd-b463-415828c0bb90 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:57.730717 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-f5af90db-fa26-4bfd-b463-415828c0bb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:57.795413 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1421/2822] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:57.801422 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf25775-f4b5-4eb1-93a7-3b0ce478a966 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:57.801710 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf25775-f4b5-4eb1-93a7-3b0ce478a966 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:57.802013 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf25775-f4b5-4eb1-93a7-3b0ce478a966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:57.821592 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-6bf25775-f4b5-4eb1-93a7-3b0ce478a966 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:57.822816 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6bf25775-f4b5-4eb1-93a7-3b0ce478a966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:57.831005 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1402/2823] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:57.835375 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af90db-fa26-4bfd-b463-415828c0bb90 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:57.845415 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af90db-fa26-4bfd-b463-415828c0bb90 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:57.850526 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb41a5b-b072-4bbb-a3fb-bef7fff44032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:57.850906 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb41a5b-b072-4bbb-a3fb-bef7fff44032 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:57.851184 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb41a5b-b072-4bbb-a3fb-bef7fff44032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:57.851455 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb41a5b-b072-4bbb-a3fb-bef7fff44032 admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:57.852206 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb41a5b-b072-4bbb-a3fb-bef7fff44032 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:33:57.852507 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb41a5b-b072-4bbb-a3fb-bef7fff44032 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:57.854106 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb41a5b-b072-4bbb-a3fb-bef7fff44032 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:57.866392 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1422/2824] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:33:57.870733 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf25775-f4b5-4eb1-93a7-3b0ce478a966 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:57.880612 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf25775-f4b5-4eb1-93a7-3b0ce478a966 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:57.885314 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8219c7-ff85-469e-9f11-15f39946bcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:57.885961 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8219c7-ff85-469e-9f11-15f39946bcd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:57.886242 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8219c7-ff85-469e-9f11-15f39946bcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:57.886516 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8219c7-ff85-469e-9f11-15f39946bcd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:57.887202 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8219c7-ff85-469e-9f11-15f39946bcd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:57.889134 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8219c7-ff85-469e-9f11-15f39946bcd3 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:57.958033 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1403/2825] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:33:57 2022] POST /identity/v3/projects => generated 369 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:33:57.959526 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb41a5b-b072-4bbb-a3fb-bef7fff44032 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:57.969820 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb41a5b-b072-4bbb-a3fb-bef7fff44032 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:58.003316 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:58.027579 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b924c-2324-48ab-bd69-2ccd62169c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:58.028284 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b924c-2324-48ab-bd69-2ccd62169c4a admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:58.028570 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b924c-2324-48ab-bd69-2ccd62169c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:58.028845 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b924c-2324-48ab-bd69-2ccd62169c4a admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:58.029537 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b924c-2324-48ab-bd69-2ccd62169c4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:58.031526 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b924c-2324-48ab-bd69-2ccd62169c4a admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:58.148598 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1423/2826] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:33:57 2022] POST /identity/v3/users => generated 285 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:33:58.152788 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8219c7-ff85-469e-9f11-15f39946bcd3 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:58.163524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8219c7-ff85-469e-9f11-15f39946bcd3 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:58.168334 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5e0be-a21b-422d-a37d-d1d0e36c5f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:58.168987 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5e0be-a21b-422d-a37d-d1d0e36c5f6d admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:58.169268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5e0be-a21b-422d-a37d-d1d0e36c5f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:58.169538 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5e0be-a21b-422d-a37d-d1d0e36c5f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:58.170348 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5e0be-a21b-422d-a37d-d1d0e36c5f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:58.171924 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5e0be-a21b-422d-a37d-d1d0e36c5f6d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:58.183016 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1404/2827] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:58.187056 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b924c-2324-48ab-bd69-2ccd62169c4a admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:58.197408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b924c-2324-48ab-bd69-2ccd62169c4a admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:58.202199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8be7f-76a6-42f5-8f05-0b35d795ada8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:58.202849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8be7f-76a6-42f5-8f05-0b35d795ada8 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:58.209048 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8be7f-76a6-42f5-8f05-0b35d795ada8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:58.209048 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8be7f-76a6-42f5-8f05-0b35d795ada8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:58.209048 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8be7f-76a6-42f5-8f05-0b35d795ada8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:58.209048 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8be7f-76a6-42f5-8f05-0b35d795ada8 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:58.216574 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1424/2828] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:58.220780 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5e0be-a21b-422d-a37d-d1d0e36c5f6d admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:58.231381 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5e0be-a21b-422d-a37d-d1d0e36c5f6d admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:58.236018 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf9b3c-c583-4df8-94a9-17602af941e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:58.238969 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf9b3c-c583-4df8-94a9-17602af941e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:58.238969 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf9b3c-c583-4df8-94a9-17602af941e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:58.238969 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf9b3c-c583-4df8-94a9-17602af941e6 admin admin] PATH_INFO: `/v3/projects/0dbf230525284371bab891250f74f13e/users/27eb7569a5164c2e883508db4a4f2892/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:58.252563 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf9b3c-c583-4df8-94a9-17602af941e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dbf230525284371bab891250f74f13e, user_id=27eb7569a5164c2e883508db4a4f2892, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:58.255290 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf9b3c-c583-4df8-94a9-17602af941e6 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:58.321494 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1405/2829] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:33:58 2022] PUT /identity/v3/projects/0dbf230525284371bab891250f74f13e/users/27eb7569a5164c2e883508db4a4f2892/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:58.333160 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa7f97-9eb6-404a-83c9-52c44a4edb7d None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:58.333447 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa7f97-9eb6-404a-83c9-52c44a4edb7d None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:58.333707 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa7f97-9eb6-404a-83c9-52c44a4edb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:58.365734 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-a9fa7f97-9eb6-404a-83c9-52c44a4edb7d None None] MFA Rules not processed for user `27eb7569a5164c2e883508db4a4f2892`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:58.366946 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-a9fa7f97-9eb6-404a-83c9-52c44a4edb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:58.445287 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1425/2830] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:33:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:58.458316 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf9b3c-c583-4df8-94a9-17602af941e6 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:58.460182 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9eaf9b3c-c583-4df8-94a9-17602af941e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:58.528167 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf9b3c-c583-4df8-94a9-17602af941e6 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:58.532031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83621400-d726-47c0-8faf-8aaf2f03e22e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '226743f4f93c44c5aef5919a7813bd3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:58.532718 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83621400-d726-47c0-8faf-8aaf2f03e22e service glance] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:58.532998 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83621400-d726-47c0-8faf-8aaf2f03e22e service glance] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:58.533275 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83621400-d726-47c0-8faf-8aaf2f03e22e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:58.542884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83621400-d726-47c0-8faf-8aaf2f03e22e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:58.544406 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83621400-d726-47c0-8faf-8aaf2f03e22e service glance] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:58.553953 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1406/2831] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:58 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:34:01.131019 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa7f97-9eb6-404a-83c9-52c44a4edb7d None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:01.135087 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-a9fa7f97-9eb6-404a-83c9-52c44a4edb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:01.207323 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa7f97-9eb6-404a-83c9-52c44a4edb7d None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:01.211723 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb178091-dae5-4821-a5bb-92461cd03957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:01.212620 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb178091-dae5-4821-a5bb-92461cd03957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:01.212900 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb178091-dae5-4821-a5bb-92461cd03957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:01.213171 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb178091-dae5-4821-a5bb-92461cd03957 admin admin] PATH_INFO: `/v3/users/2b33a516fa424ba99004418a8a2746d1` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:01.214350 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb178091-dae5-4821-a5bb-92461cd03957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b33a516fa424ba99004418a8a2746d1)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:01.216293 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb178091-dae5-4821-a5bb-92461cd03957 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:01.371352 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:34:01.372887 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-fb178091-dae5-4821-a5bb-92461cd03957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b33a516fa424ba99004418a8a2746d1'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:01.385076 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-fb178091-dae5-4821-a5bb-92461cd03957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b33a516fa424ba99004418a8a2746d1'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:01.391812 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-fb178091-dae5-4821-a5bb-92461cd03957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b33a516fa424ba99004418a8a2746d1'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:01.392669 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-fb178091-dae5-4821-a5bb-92461cd03957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b33a516fa424ba99004418a8a2746d1'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:01.393382 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-fb178091-dae5-4821-a5bb-92461cd03957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b33a516fa424ba99004418a8a2746d1'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:01.432954 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1426/2832] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:34:01 2022] DELETE /identity/v3/users/2b33a516fa424ba99004418a8a2746d1 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:34:01.727592 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83621400-d726-47c0-8faf-8aaf2f03e22e service glance] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:01.739252 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83621400-d726-47c0-8faf-8aaf2f03e22e service glance] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:01.801749 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12867f28-b397-43dc-8318-da9b07ef3eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:01.803670 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12867f28-b397-43dc-8318-da9b07ef3eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:01.803670 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12867f28-b397-43dc-8318-da9b07ef3eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:01.803981 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12867f28-b397-43dc-8318-da9b07ef3eab admin admin] PATH_INFO: `/v3/projects/1a50bd4c68c6485d87df5910a060fa6f` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:01.805425 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12867f28-b397-43dc-8318-da9b07ef3eab admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a50bd4c68c6485d87df5910a060fa6f)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:01.808289 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12867f28-b397-43dc-8318-da9b07ef3eab admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:01.841514 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:INSERT=3,keystone:DELETE=4,keystone:SELECT=93 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:34:01.937414 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-12867f28-b397-43dc-8318-da9b07ef3eab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a50bd4c68c6485d87df5910a060fa6f', 'request_id': 'req-12867f28-b397-43dc-8318-da9b07ef3eab'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:01.944225 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-12867f28-b397-43dc-8318-da9b07ef3eab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a50bd4c68c6485d87df5910a060fa6f', 'request_id': 'req-12867f28-b397-43dc-8318-da9b07ef3eab'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:02.074121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-12867f28-b397-43dc-8318-da9b07ef3eab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a50bd4c68c6485d87df5910a060fa6f', 'request_id': 'req-12867f28-b397-43dc-8318-da9b07ef3eab'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:02.085786 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-12867f28-b397-43dc-8318-da9b07ef3eab admin admin] The token cache is being invalidate because project 1a50bd4c68c6485d87df5910a060fa6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:34:02.086074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-12867f28-b397-43dc-8318-da9b07ef3eab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:02.086747 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-12867f28-b397-43dc-8318-da9b07ef3eab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:02.088329 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1407/2833] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:34:01 2022] DELETE /identity/v3/projects/1a50bd4c68c6485d87df5910a060fa6f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:34:02.092358 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb178091-dae5-4821-a5bb-92461cd03957 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:02.093764 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-fb178091-dae5-4821-a5bb-92461cd03957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:02.107639 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb178091-dae5-4821-a5bb-92461cd03957 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:02.169408 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94293201-249e-4908-ae50-c96e2bc677af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:02.170324 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94293201-249e-4908-ae50-c96e2bc677af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:02.170609 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94293201-249e-4908-ae50-c96e2bc677af admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:02.170892 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94293201-249e-4908-ae50-c96e2bc677af admin admin] PATH_INFO: `/v3/users/2402f28d28e84faa932e5ba325919ff0` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:02.172154 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94293201-249e-4908-ae50-c96e2bc677af admin admin] RBAC: Authorizing `identity:delete_user(user_id=2402f28d28e84faa932e5ba325919ff0)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:02.174168 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94293201-249e-4908-ae50-c96e2bc677af admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:02.346301 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-94293201-249e-4908-ae50-c96e2bc677af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2402f28d28e84faa932e5ba325919ff0'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:02.359128 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-94293201-249e-4908-ae50-c96e2bc677af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2402f28d28e84faa932e5ba325919ff0'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:02.366036 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-94293201-249e-4908-ae50-c96e2bc677af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2402f28d28e84faa932e5ba325919ff0'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:02.366840 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-94293201-249e-4908-ae50-c96e2bc677af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2402f28d28e84faa932e5ba325919ff0'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:02.367370 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-94293201-249e-4908-ae50-c96e2bc677af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2402f28d28e84faa932e5ba325919ff0'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:02.433859 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1427/2834] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:34:02 2022] DELETE /identity/v3/users/2402f28d28e84faa932e5ba325919ff0 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:34:02.761894 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12867f28-b397-43dc-8318-da9b07ef3eab admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:02.763336 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-12867f28-b397-43dc-8318-da9b07ef3eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:02.776650 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12867f28-b397-43dc-8318-da9b07ef3eab admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:02.849084 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8426e6-1f1c-41f2-b157-b1fb116107b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:02.849991 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8426e6-1f1c-41f2-b157-b1fb116107b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:02.850271 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8426e6-1f1c-41f2-b157-b1fb116107b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:02.850574 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8426e6-1f1c-41f2-b157-b1fb116107b1 admin admin] PATH_INFO: `/v3/projects/48528e443ed4420ebaa0924bc7e1cbf1` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:02.851781 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8426e6-1f1c-41f2-b157-b1fb116107b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48528e443ed4420ebaa0924bc7e1cbf1)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:02.853775 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8426e6-1f1c-41f2-b157-b1fb116107b1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:02.949706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7f8426e6-1f1c-41f2-b157-b1fb116107b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48528e443ed4420ebaa0924bc7e1cbf1', 'request_id': 'req-7f8426e6-1f1c-41f2-b157-b1fb116107b1'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:02.959277 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7f8426e6-1f1c-41f2-b157-b1fb116107b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48528e443ed4420ebaa0924bc7e1cbf1', 'request_id': 'req-7f8426e6-1f1c-41f2-b157-b1fb116107b1'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:03.016857 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7f8426e6-1f1c-41f2-b157-b1fb116107b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48528e443ed4420ebaa0924bc7e1cbf1', 'request_id': 'req-7f8426e6-1f1c-41f2-b157-b1fb116107b1'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:03.027901 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7f8426e6-1f1c-41f2-b157-b1fb116107b1 admin admin] The token cache is being invalidate because project 48528e443ed4420ebaa0924bc7e1cbf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:34:03.028202 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7f8426e6-1f1c-41f2-b157-b1fb116107b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:03.028826 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7f8426e6-1f1c-41f2-b157-b1fb116107b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:03.030386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1408/2835] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:34:02 2022] DELETE /identity/v3/projects/48528e443ed4420ebaa0924bc7e1cbf1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:34:03.035231 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887da6a-3e97-451c-a5ba-c6f6b654c41f None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:03.035613 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887da6a-3e97-451c-a5ba-c6f6b654c41f None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:03.035916 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887da6a-3e97-451c-a5ba-c6f6b654c41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:03.054298 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-d887da6a-3e97-451c-a5ba-c6f6b654c41f None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:34:03.055562 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-d887da6a-3e97-451c-a5ba-c6f6b654c41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:03.095143 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:34:03.130552 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1428/2836] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:34:03.139103 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba44e8-2bf5-4dd9-8283-be54e2d1d1ac None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:03.139393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba44e8-2bf5-4dd9-8283-be54e2d1d1ac None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:03.139670 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba44e8-2bf5-4dd9-8283-be54e2d1d1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:03.157993 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-07ba44e8-2bf5-4dd9-8283-be54e2d1d1ac None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:34:03.159190 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-07ba44e8-2bf5-4dd9-8283-be54e2d1d1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:03.167176 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1409/2837] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:34:03.171552 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887da6a-3e97-451c-a5ba-c6f6b654c41f None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:03.181904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887da6a-3e97-451c-a5ba-c6f6b654c41f None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:03.186988 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7f857-372f-4e7b-bfde-db184901a692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:03.187642 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7f857-372f-4e7b-bfde-db184901a692 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:03.187926 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7f857-372f-4e7b-bfde-db184901a692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:03.188242 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7f857-372f-4e7b-bfde-db184901a692 admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:03.188962 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7f857-372f-4e7b-bfde-db184901a692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:34:03.189303 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7f857-372f-4e7b-bfde-db184901a692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:03.191816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7f857-372f-4e7b-bfde-db184901a692 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:03.203510 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1429/2838] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:34:03.207721 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba44e8-2bf5-4dd9-8283-be54e2d1d1ac None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:03.216848 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba44e8-2bf5-4dd9-8283-be54e2d1d1ac None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:03.221463 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c0cee-ec6b-4fee-8f48-e8f026d6cd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:03.222636 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c0cee-ec6b-4fee-8f48-e8f026d6cd0b admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:03.222916 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c0cee-ec6b-4fee-8f48-e8f026d6cd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:03.223188 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c0cee-ec6b-4fee-8f48-e8f026d6cd0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:03.223881 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c0cee-ec6b-4fee-8f48-e8f026d6cd0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:03.225802 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c0cee-ec6b-4fee-8f48-e8f026d6cd0b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:03.301121 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1410/2839] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:34:03 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:34:03.303583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7f857-372f-4e7b-bfde-db184901a692 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:03.313633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7f857-372f-4e7b-bfde-db184901a692 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:03.370130 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760958cc-8626-408a-87b0-06f395b1a82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:03.370793 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760958cc-8626-408a-87b0-06f395b1a82a admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:03.371075 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760958cc-8626-408a-87b0-06f395b1a82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:03.371348 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760958cc-8626-408a-87b0-06f395b1a82a admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:03.372121 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760958cc-8626-408a-87b0-06f395b1a82a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:03.374559 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760958cc-8626-408a-87b0-06f395b1a82a admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:03.453461 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1430/2840] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:34:03 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:34:03.456491 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c0cee-ec6b-4fee-8f48-e8f026d6cd0b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:03.466955 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c0cee-ec6b-4fee-8f48-e8f026d6cd0b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:03.472313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e41467-9d67-4aa2-aced-0669f6c8722f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:03.473048 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e41467-9d67-4aa2-aced-0669f6c8722f admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:03.473303 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e41467-9d67-4aa2-aced-0669f6c8722f admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:03.473582 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e41467-9d67-4aa2-aced-0669f6c8722f admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:03.474315 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e41467-9d67-4aa2-aced-0669f6c8722f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:03.475947 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e41467-9d67-4aa2-aced-0669f6c8722f admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:03.486678 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1411/2841] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:34:03.491582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760958cc-8626-408a-87b0-06f395b1a82a admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:03.502175 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760958cc-8626-408a-87b0-06f395b1a82a admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:03.506944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c66ff-addc-4d59-8a16-719f4c507cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:03.507684 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c66ff-addc-4d59-8a16-719f4c507cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:03.507958 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c66ff-addc-4d59-8a16-719f4c507cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:03.511862 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c66ff-addc-4d59-8a16-719f4c507cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:03.511862 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c66ff-addc-4d59-8a16-719f4c507cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:03.511862 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c66ff-addc-4d59-8a16-719f4c507cf5 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:03.520981 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1431/2842] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:34:03.525159 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e41467-9d67-4aa2-aced-0669f6c8722f admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:03.530468 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:34:03.536403 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e41467-9d67-4aa2-aced-0669f6c8722f admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:03.541061 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fc68a-8078-4f45-b0ca-30e534bba98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:03.548273 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fc68a-8078-4f45-b0ca-30e534bba98a admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:03.548273 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fc68a-8078-4f45-b0ca-30e534bba98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:03.548273 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fc68a-8078-4f45-b0ca-30e534bba98a admin admin] PATH_INFO: `/v3/projects/ceac33af74ce4f529ef2ef3ee48047bf/users/a0eb09eb741a4f579d0e48ac7f2f9ec8/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:03.557276 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fc68a-8078-4f45-b0ca-30e534bba98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceac33af74ce4f529ef2ef3ee48047bf, user_id=a0eb09eb741a4f579d0e48ac7f2f9ec8, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:03.559903 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fc68a-8078-4f45-b0ca-30e534bba98a admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:03.628077 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1412/2843] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:34:03 2022] PUT /identity/v3/projects/ceac33af74ce4f529ef2ef3ee48047bf/users/a0eb09eb741a4f579d0e48ac7f2f9ec8/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:34:03.629694 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c9402-8db5-4afd-97a7-0abce14ef1dd None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:03.629988 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c9402-8db5-4afd-97a7-0abce14ef1dd None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:03.630322 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c9402-8db5-4afd-97a7-0abce14ef1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:03.659539 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-f69c9402-8db5-4afd-97a7-0abce14ef1dd None None] MFA Rules not processed for user `a0eb09eb741a4f579d0e48ac7f2f9ec8`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:34:03.661470 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-f69c9402-8db5-4afd-97a7-0abce14ef1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:03.728264 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1432/2844] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:34:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:34:03.739161 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fc68a-8078-4f45-b0ca-30e534bba98a admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:03.740893 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-dd4fc68a-8078-4f45-b0ca-30e534bba98a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:03.810074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fc68a-8078-4f45-b0ca-30e534bba98a admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:03.814605 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ee39d-34f6-40c2-b75b-a473abce5b81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:03.815371 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ee39d-34f6-40c2-b75b-a473abce5b81 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:03.815637 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ee39d-34f6-40c2-b75b-a473abce5b81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:03.815910 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ee39d-34f6-40c2-b75b-a473abce5b81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:03.824656 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ee39d-34f6-40c2-b75b-a473abce5b81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:03.826076 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ee39d-34f6-40c2-b75b-a473abce5b81 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:03.838258 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1413/2845] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:34:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:34:03.858692 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c9402-8db5-4afd-97a7-0abce14ef1dd None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:03.899757 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:34:03.922853 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c9402-8db5-4afd-97a7-0abce14ef1dd None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:03.929700 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cc9fd-f16b-469e-8722-ff6c6306b559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:03.930999 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cc9fd-f16b-469e-8722-ff6c6306b559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:03.931352 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cc9fd-f16b-469e-8722-ff6c6306b559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:03.931769 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cc9fd-f16b-469e-8722-ff6c6306b559 admin admin] PATH_INFO: `/v3/users/a0eb09eb741a4f579d0e48ac7f2f9ec8` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:03.933599 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cc9fd-f16b-469e-8722-ff6c6306b559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0eb09eb741a4f579d0e48ac7f2f9ec8)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:03.936817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cc9fd-f16b-469e-8722-ff6c6306b559 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:04.105414 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-e14cc9fd-f16b-469e-8722-ff6c6306b559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0eb09eb741a4f579d0e48ac7f2f9ec8'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:04.119662 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-e14cc9fd-f16b-469e-8722-ff6c6306b559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0eb09eb741a4f579d0e48ac7f2f9ec8'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:04.128731 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-e14cc9fd-f16b-469e-8722-ff6c6306b559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0eb09eb741a4f579d0e48ac7f2f9ec8'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:04.130086 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-e14cc9fd-f16b-469e-8722-ff6c6306b559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0eb09eb741a4f579d0e48ac7f2f9ec8'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:04.130778 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-e14cc9fd-f16b-469e-8722-ff6c6306b559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0eb09eb741a4f579d0e48ac7f2f9ec8'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:04.199942 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1433/2846] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:34:03 2022] DELETE /identity/v3/users/a0eb09eb741a4f579d0e48ac7f2f9ec8 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:34:04.204494 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2698488-95b2-4453-8776-f45888c0f18c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:04.204786 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2698488-95b2-4453-8776-f45888c0f18c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:04.205074 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2698488-95b2-4453-8776-f45888c0f18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:04.222449 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f2698488-95b2-4453-8776-f45888c0f18c None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:34:04.223644 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f2698488-95b2-4453-8776-f45888c0f18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:04.281677 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1414/2847] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:34:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:34:04.292341 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cc9fd-f16b-469e-8722-ff6c6306b559 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:04.293758 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-e14cc9fd-f16b-469e-8722-ff6c6306b559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:04.355723 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cc9fd-f16b-469e-8722-ff6c6306b559 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:04.359954 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8ade8-68c6-4f72-b3a4-f10409c43dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:04.360624 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8ade8-68c6-4f72-b3a4-f10409c43dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:04.360926 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8ade8-68c6-4f72-b3a4-f10409c43dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:04.361199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8ade8-68c6-4f72-b3a4-f10409c43dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:04.370928 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8ade8-68c6-4f72-b3a4-f10409c43dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:04.372395 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8ade8-68c6-4f72-b3a4-f10409c43dd6 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:04.382431 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1434/2848] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:34:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:34:04.850611 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2698488-95b2-4453-8776-f45888c0f18c None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:04.850611 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f2698488-95b2-4453-8776-f45888c0f18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:04.861023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2698488-95b2-4453-8776-f45888c0f18c None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:04.866484 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481019d-9641-40b4-a79a-7b25291f7c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:04.867349 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481019d-9641-40b4-a79a-7b25291f7c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:04.867763 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481019d-9641-40b4-a79a-7b25291f7c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:04.867895 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481019d-9641-40b4-a79a-7b25291f7c38 admin admin] PATH_INFO: `/v3/projects/ceac33af74ce4f529ef2ef3ee48047bf` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:04.869151 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481019d-9641-40b4-a79a-7b25291f7c38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceac33af74ce4f529ef2ef3ee48047bf)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:04.871044 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481019d-9641-40b4-a79a-7b25291f7c38 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:04.965088 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e481019d-9641-40b4-a79a-7b25291f7c38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceac33af74ce4f529ef2ef3ee48047bf', 'request_id': 'req-e481019d-9641-40b4-a79a-7b25291f7c38'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:04.971364 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e481019d-9641-40b4-a79a-7b25291f7c38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceac33af74ce4f529ef2ef3ee48047bf', 'request_id': 'req-e481019d-9641-40b4-a79a-7b25291f7c38'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:05.022855 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e481019d-9641-40b4-a79a-7b25291f7c38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceac33af74ce4f529ef2ef3ee48047bf', 'request_id': 'req-e481019d-9641-40b4-a79a-7b25291f7c38'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:05.034375 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e481019d-9641-40b4-a79a-7b25291f7c38 admin admin] The token cache is being invalidate because project ceac33af74ce4f529ef2ef3ee48047bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:34:05.034666 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e481019d-9641-40b4-a79a-7b25291f7c38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:05.035332 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e481019d-9641-40b4-a79a-7b25291f7c38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:05.037507 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1415/2849] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:34:04 2022] DELETE /identity/v3/projects/ceac33af74ce4f529ef2ef3ee48047bf => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:34:05.042889 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142e4c5-14d8-44b8-b69e-bee24c1324cf None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:05.043182 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142e4c5-14d8-44b8-b69e-bee24c1324cf None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:05.043465 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142e4c5-14d8-44b8-b69e-bee24c1324cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:05.062994 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-5142e4c5-14d8-44b8-b69e-bee24c1324cf None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:34:05.064286 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-5142e4c5-14d8-44b8-b69e-bee24c1324cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:05.117013 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:34:05.125582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1435/2850] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:34:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:34:05.133421 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c9a3f-c419-4074-85f6-eaf094a06284 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:05.133727 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c9a3f-c419-4074-85f6-eaf094a06284 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:05.134004 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c9a3f-c419-4074-85f6-eaf094a06284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:05.141302 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:34:05.152895 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-317c9a3f-c419-4074-85f6-eaf094a06284 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:34:05.154120 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-317c9a3f-c419-4074-85f6-eaf094a06284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:05.162692 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1416/2851] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:34:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:34:05.166971 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142e4c5-14d8-44b8-b69e-bee24c1324cf None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:05.178867 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142e4c5-14d8-44b8-b69e-bee24c1324cf None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:05.183878 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e98044-aa97-4972-aaa4-d2fa78a5341b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:05.185492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e98044-aa97-4972-aaa4-d2fa78a5341b admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:05.185492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e98044-aa97-4972-aaa4-d2fa78a5341b admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:05.185492 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e98044-aa97-4972-aaa4-d2fa78a5341b admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:05.185884 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e98044-aa97-4972-aaa4-d2fa78a5341b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:34:05.186191 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e98044-aa97-4972-aaa4-d2fa78a5341b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:05.187852 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e98044-aa97-4972-aaa4-d2fa78a5341b admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:05.209021 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1436/2852] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:34:05.218522 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c9a3f-c419-4074-85f6-eaf094a06284 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:05.228495 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c9a3f-c419-4074-85f6-eaf094a06284 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:05.233597 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26679f72-e619-41cf-8e36-6034796b7c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:05.234455 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26679f72-e619-41cf-8e36-6034796b7c78 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:05.234832 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26679f72-e619-41cf-8e36-6034796b7c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:05.235642 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26679f72-e619-41cf-8e36-6034796b7c78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:05.236461 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26679f72-e619-41cf-8e36-6034796b7c78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:05.238489 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26679f72-e619-41cf-8e36-6034796b7c78 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:05.303839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1417/2853] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:34:05 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:34:05.308191 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e98044-aa97-4972-aaa4-d2fa78a5341b admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:05.318339 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e98044-aa97-4972-aaa4-d2fa78a5341b admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:05.389741 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306db44-88a8-473b-8cc8-c3ddb119c5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:05.390333 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306db44-88a8-473b-8cc8-c3ddb119c5cd admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:05.390616 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306db44-88a8-473b-8cc8-c3ddb119c5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:05.390888 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306db44-88a8-473b-8cc8-c3ddb119c5cd admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:05.391577 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306db44-88a8-473b-8cc8-c3ddb119c5cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:05.393569 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306db44-88a8-473b-8cc8-c3ddb119c5cd admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:05.468196 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1437/2854] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:34:05 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:34:05.472413 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26679f72-e619-41cf-8e36-6034796b7c78 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:05.482686 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26679f72-e619-41cf-8e36-6034796b7c78 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:05.487470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f4706-890e-4487-9261-269cac0f54c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:05.490716 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f4706-890e-4487-9261-269cac0f54c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:05.490716 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f4706-890e-4487-9261-269cac0f54c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:05.490716 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f4706-890e-4487-9261-269cac0f54c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:05.490716 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f4706-890e-4487-9261-269cac0f54c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:05.491126 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f4706-890e-4487-9261-269cac0f54c2 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:05.501226 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1418/2855] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:34:05.505724 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306db44-88a8-473b-8cc8-c3ddb119c5cd admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:05.515690 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306db44-88a8-473b-8cc8-c3ddb119c5cd admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:05.521383 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f21e3a-31e5-4149-95d8-25647f87e46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:05.522050 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f21e3a-31e5-4149-95d8-25647f87e46e admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:05.522480 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f21e3a-31e5-4149-95d8-25647f87e46e admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:05.522604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f21e3a-31e5-4149-95d8-25647f87e46e admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:05.523327 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f21e3a-31e5-4149-95d8-25647f87e46e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:05.524969 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f21e3a-31e5-4149-95d8-25647f87e46e admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:05.536108 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1438/2856] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:34:05.540100 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f4706-890e-4487-9261-269cac0f54c2 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:05.550338 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f4706-890e-4487-9261-269cac0f54c2 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:05.555181 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd59208-cde5-4d5c-84e6-717c9467e2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:05.556101 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd59208-cde5-4d5c-84e6-717c9467e2cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:05.556387 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd59208-cde5-4d5c-84e6-717c9467e2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:05.556658 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd59208-cde5-4d5c-84e6-717c9467e2cc admin admin] PATH_INFO: `/v3/projects/72042319e3d248ba880e07362c70fbe1/users/6a83386c36a84b7f98109da660ec67eb/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:05.572590 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd59208-cde5-4d5c-84e6-717c9467e2cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=72042319e3d248ba880e07362c70fbe1, user_id=6a83386c36a84b7f98109da660ec67eb, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:05.575905 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd59208-cde5-4d5c-84e6-717c9467e2cc admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:05.656880 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1419/2857] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:34:05 2022] PUT /identity/v3/projects/72042319e3d248ba880e07362c70fbe1/users/6a83386c36a84b7f98109da660ec67eb/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:34:05.667123 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d0290-22ee-4652-9a30-1be9fc3b7d4f None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:05.667412 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d0290-22ee-4652-9a30-1be9fc3b7d4f None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:05.667849 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d0290-22ee-4652-9a30-1be9fc3b7d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:05.702582 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-e67d0290-22ee-4652-9a30-1be9fc3b7d4f None None] MFA Rules not processed for user `6a83386c36a84b7f98109da660ec67eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:34:05.703817 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-e67d0290-22ee-4652-9a30-1be9fc3b7d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:05.778429 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1439/2858] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:34:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:34:05.796697 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd59208-cde5-4d5c-84e6-717c9467e2cc admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:05.799702 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7bd59208-cde5-4d5c-84e6-717c9467e2cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:05.859799 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd59208-cde5-4d5c-84e6-717c9467e2cc admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:05.864337 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f11cc-9a17-40fb-b682-41eb006e36e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:05.865017 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f11cc-9a17-40fb-b682-41eb006e36e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:05.865360 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f11cc-9a17-40fb-b682-41eb006e36e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:05.865579 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f11cc-9a17-40fb-b682-41eb006e36e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:05.874904 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f11cc-9a17-40fb-b682-41eb006e36e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:05.876394 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f11cc-9a17-40fb-b682-41eb006e36e9 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:05.886037 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1420/2859] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:34:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:34:12.532348 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d0290-22ee-4652-9a30-1be9fc3b7d4f None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:12.598770 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:34:12.604309 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d0290-22ee-4652-9a30-1be9fc3b7d4f None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:12.608861 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e852c7-b2cf-4230-be10-404b8a7a731a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:12.609782 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e852c7-b2cf-4230-be10-404b8a7a731a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:12.610058 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e852c7-b2cf-4230-be10-404b8a7a731a admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:12.610327 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e852c7-b2cf-4230-be10-404b8a7a731a admin admin] PATH_INFO: `/v3/users/6a83386c36a84b7f98109da660ec67eb` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:12.611538 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e852c7-b2cf-4230-be10-404b8a7a731a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a83386c36a84b7f98109da660ec67eb)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:12.614040 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e852c7-b2cf-4230-be10-404b8a7a731a admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:12.819892 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-54e852c7-b2cf-4230-be10-404b8a7a731a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a83386c36a84b7f98109da660ec67eb'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:12.831796 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-54e852c7-b2cf-4230-be10-404b8a7a731a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a83386c36a84b7f98109da660ec67eb'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:12.838516 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-54e852c7-b2cf-4230-be10-404b8a7a731a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a83386c36a84b7f98109da660ec67eb'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:12.839181 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-54e852c7-b2cf-4230-be10-404b8a7a731a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a83386c36a84b7f98109da660ec67eb'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:12.839772 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-54e852c7-b2cf-4230-be10-404b8a7a731a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a83386c36a84b7f98109da660ec67eb'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:12.919162 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1440/2860] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:34:12 2022] DELETE /identity/v3/users/6a83386c36a84b7f98109da660ec67eb => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:34:12.923712 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba5c54-7370-4c95-a7f5-438e008a3390 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:12.924212 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba5c54-7370-4c95-a7f5-438e008a3390 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:12.924313 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba5c54-7370-4c95-a7f5-438e008a3390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:12.942158 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-66ba5c54-7370-4c95-a7f5-438e008a3390 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:34:12.943390 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-66ba5c54-7370-4c95-a7f5-438e008a3390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:13.139496 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1421/2861] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:34:13.150164 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e852c7-b2cf-4230-be10-404b8a7a731a admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:13.151731 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-54e852c7-b2cf-4230-be10-404b8a7a731a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:13.212038 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e852c7-b2cf-4230-be10-404b8a7a731a admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:13.215602 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b8e2d-361a-42ff-b38e-78f0cc652d41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:13.216278 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b8e2d-361a-42ff-b38e-78f0cc652d41 service neutron] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:13.216563 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b8e2d-361a-42ff-b38e-78f0cc652d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:13.216836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b8e2d-361a-42ff-b38e-78f0cc652d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:13.225784 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b8e2d-361a-42ff-b38e-78f0cc652d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:13.227199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b8e2d-361a-42ff-b38e-78f0cc652d41 service neutron] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:13.236589 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1441/2862] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:34:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:34:13.640558 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba5c54-7370-4c95-a7f5-438e008a3390 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:13.642130 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-66ba5c54-7370-4c95-a7f5-438e008a3390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:13.656950 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba5c54-7370-4c95-a7f5-438e008a3390 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:13.663158 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4899c7-7f0a-4115-80dd-293c3f692bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:13.664371 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4899c7-7f0a-4115-80dd-293c3f692bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:13.664544 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4899c7-7f0a-4115-80dd-293c3f692bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:13.664938 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4899c7-7f0a-4115-80dd-293c3f692bfd admin admin] PATH_INFO: `/v3/projects/72042319e3d248ba880e07362c70fbe1` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:13.666176 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4899c7-7f0a-4115-80dd-293c3f692bfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=72042319e3d248ba880e07362c70fbe1)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:13.674940 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4899c7-7f0a-4115-80dd-293c3f692bfd admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:13.765244 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:34:13.772778 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6c4899c7-7f0a-4115-80dd-293c3f692bfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72042319e3d248ba880e07362c70fbe1', 'request_id': 'req-6c4899c7-7f0a-4115-80dd-293c3f692bfd'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:13.778924 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6c4899c7-7f0a-4115-80dd-293c3f692bfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72042319e3d248ba880e07362c70fbe1', 'request_id': 'req-6c4899c7-7f0a-4115-80dd-293c3f692bfd'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:13.868011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6c4899c7-7f0a-4115-80dd-293c3f692bfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72042319e3d248ba880e07362c70fbe1', 'request_id': 'req-6c4899c7-7f0a-4115-80dd-293c3f692bfd'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:13.878523 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6c4899c7-7f0a-4115-80dd-293c3f692bfd admin admin] The token cache is being invalidate because project 72042319e3d248ba880e07362c70fbe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:34:13.878804 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6c4899c7-7f0a-4115-80dd-293c3f692bfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:13.879940 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6c4899c7-7f0a-4115-80dd-293c3f692bfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:13.881515 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1422/2863] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:34:13 2022] DELETE /identity/v3/projects/72042319e3d248ba880e07362c70fbe1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:34:13.886427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fa2c0-da6f-42cf-8578-82b7cf8e7c6b None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:13.886930 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fa2c0-da6f-42cf-8578-82b7cf8e7c6b None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:13.886930 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fa2c0-da6f-42cf-8578-82b7cf8e7c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:13.904700 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-f33fa2c0-da6f-42cf-8578-82b7cf8e7c6b None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:34:13.905904 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-f33fa2c0-da6f-42cf-8578-82b7cf8e7c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:13.964476 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1442/2864] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:34:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:34:14.025522 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1e7b5-a008-4760-bdf2-ed4f18ad699b None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:14.026153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1e7b5-a008-4760-bdf2-ed4f18ad699b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:14.026153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1e7b5-a008-4760-bdf2-ed4f18ad699b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:14.044337 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-88a1e7b5-a008-4760-bdf2-ed4f18ad699b None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:34:14.045516 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-88a1e7b5-a008-4760-bdf2-ed4f18ad699b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:14.054162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1423/2865] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:34:14.058832 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fa2c0-da6f-42cf-8578-82b7cf8e7c6b None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:14.069722 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fa2c0-da6f-42cf-8578-82b7cf8e7c6b None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:14.074409 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004fbd3-412b-4504-928c-9e11f6935af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:14.075093 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004fbd3-412b-4504-928c-9e11f6935af3 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:14.075380 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004fbd3-412b-4504-928c-9e11f6935af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:14.075661 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004fbd3-412b-4504-928c-9e11f6935af3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:14.076417 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b004fbd3-412b-4504-928c-9e11f6935af3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80608) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:34:14.076735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b004fbd3-412b-4504-928c-9e11f6935af3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:14.078336 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b004fbd3-412b-4504-928c-9e11f6935af3 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:14.089946 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1443/2866] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:34:14.094184 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1e7b5-a008-4760-bdf2-ed4f18ad699b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:14.103467 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1e7b5-a008-4760-bdf2-ed4f18ad699b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:14.108116 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4d3f3-5d73-4c61-a362-d78afbc22cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:14.108760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4d3f3-5d73-4c61-a362-d78afbc22cdf admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:14.109040 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4d3f3-5d73-4c61-a362-d78afbc22cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:14.109310 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4d3f3-5d73-4c61-a362-d78afbc22cdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:14.109996 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4d3f3-5d73-4c61-a362-d78afbc22cdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:14.111860 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4d3f3-5d73-4c61-a362-d78afbc22cdf admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:14.213273 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1424/2867] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:34:14 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:34:14.217816 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004fbd3-412b-4504-928c-9e11f6935af3 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:14.224583 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:34:14.228836 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004fbd3-412b-4504-928c-9e11f6935af3 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:14.291755 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9506c55-16f4-4b44-8fa5-2daeadf5657e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:14.292470 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9506c55-16f4-4b44-8fa5-2daeadf5657e admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:14.292758 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9506c55-16f4-4b44-8fa5-2daeadf5657e admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:14.293039 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9506c55-16f4-4b44-8fa5-2daeadf5657e admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:14.293727 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9506c55-16f4-4b44-8fa5-2daeadf5657e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:14.295674 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9506c55-16f4-4b44-8fa5-2daeadf5657e admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:14.371253 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1444/2868] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:34:14 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:34:14.375556 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4d3f3-5d73-4c61-a362-d78afbc22cdf admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:14.387379 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4d3f3-5d73-4c61-a362-d78afbc22cdf admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:14.396335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c94e7-f025-4774-b95f-ddbb3d55861b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:14.396335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c94e7-f025-4774-b95f-ddbb3d55861b admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:14.396335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c94e7-f025-4774-b95f-ddbb3d55861b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:14.396335 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c94e7-f025-4774-b95f-ddbb3d55861b admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:14.396857 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c94e7-f025-4774-b95f-ddbb3d55861b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:14.396857 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c94e7-f025-4774-b95f-ddbb3d55861b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:14.406097 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1425/2869] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:34:14.411097 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9506c55-16f4-4b44-8fa5-2daeadf5657e admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:14.420971 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9506c55-16f4-4b44-8fa5-2daeadf5657e admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:14.425533 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424da30d-545c-4b8b-96b2-6fca125481f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:14.427802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424da30d-545c-4b8b-96b2-6fca125481f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:14.427802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424da30d-545c-4b8b-96b2-6fca125481f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:14.427802 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424da30d-545c-4b8b-96b2-6fca125481f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:14.428148 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424da30d-545c-4b8b-96b2-6fca125481f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:14.429683 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424da30d-545c-4b8b-96b2-6fca125481f0 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:14.440565 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1445/2870] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:34:14.444789 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c94e7-f025-4774-b95f-ddbb3d55861b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:14.454584 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c94e7-f025-4774-b95f-ddbb3d55861b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:14.459128 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7d8ab-571b-4a02-adb7-fb71f24adec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:14.459979 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7d8ab-571b-4a02-adb7-fb71f24adec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:14.460283 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7d8ab-571b-4a02-adb7-fb71f24adec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:14.460557 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7d8ab-571b-4a02-adb7-fb71f24adec2 admin admin] PATH_INFO: `/v3/projects/efa5e8c35d694fa9b80a9315700e09c6/users/0cfe39f8fb8b457fa3ab7a491b857365/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:14.476030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7d8ab-571b-4a02-adb7-fb71f24adec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efa5e8c35d694fa9b80a9315700e09c6, user_id=0cfe39f8fb8b457fa3ab7a491b857365, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:14.478635 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7d8ab-571b-4a02-adb7-fb71f24adec2 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:14.545488 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1426/2871] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:34:14 2022] PUT /identity/v3/projects/efa5e8c35d694fa9b80a9315700e09c6/users/0cfe39f8fb8b457fa3ab7a491b857365/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:34:14.561054 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3c5b7-ba4f-4c53-b14c-68c657fd00d8 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:14.561343 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3c5b7-ba4f-4c53-b14c-68c657fd00d8 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:14.561621 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3c5b7-ba4f-4c53-b14c-68c657fd00d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:14.589682 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-d3e3c5b7-ba4f-4c53-b14c-68c657fd00d8 None None] MFA Rules not processed for user `0cfe39f8fb8b457fa3ab7a491b857365`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:34:14.590905 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-d3e3c5b7-ba4f-4c53-b14c-68c657fd00d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:14.655353 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1446/2872] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:34:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:34:14.660017 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7d8ab-571b-4a02-adb7-fb71f24adec2 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:14.722025 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7d8ab-571b-4a02-adb7-fb71f24adec2 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:14.726884 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08bf0e-83c0-4b60-baa0-c2bea2b6b84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:14.727546 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08bf0e-83c0-4b60-baa0-c2bea2b6b84b admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:14.727830 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08bf0e-83c0-4b60-baa0-c2bea2b6b84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:14.728153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08bf0e-83c0-4b60-baa0-c2bea2b6b84b admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:14.728852 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08bf0e-83c0-4b60-baa0-c2bea2b6b84b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:14.730746 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08bf0e-83c0-4b60-baa0-c2bea2b6b84b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:14.840794 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1427/2873] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:34:14 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:34:14.844818 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3c5b7-ba4f-4c53-b14c-68c657fd00d8 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:14.855528 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3c5b7-ba4f-4c53-b14c-68c657fd00d8 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:14.910961 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f5e59-41e3-444c-a48f-c02f89e0821b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:14.911613 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f5e59-41e3-444c-a48f-c02f89e0821b admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:14.911837 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f5e59-41e3-444c-a48f-c02f89e0821b admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:14.912118 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f5e59-41e3-444c-a48f-c02f89e0821b admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:14.912821 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f5e59-41e3-444c-a48f-c02f89e0821b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:14.914715 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f5e59-41e3-444c-a48f-c02f89e0821b admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:14.993101 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1447/2874] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:34:14 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:34:14.997030 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08bf0e-83c0-4b60-baa0-c2bea2b6b84b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:15.007162 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08bf0e-83c0-4b60-baa0-c2bea2b6b84b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:15.011696 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215704cf-5d3e-46e6-a4fc-6e7516e0d555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:15.012372 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215704cf-5d3e-46e6-a4fc-6e7516e0d555 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:15.013210 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215704cf-5d3e-46e6-a4fc-6e7516e0d555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:15.013210 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215704cf-5d3e-46e6-a4fc-6e7516e0d555 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:15.013658 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215704cf-5d3e-46e6-a4fc-6e7516e0d555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:15.015255 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215704cf-5d3e-46e6-a4fc-6e7516e0d555 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:15.025770 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1428/2875] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:34:15.029735 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f5e59-41e3-444c-a48f-c02f89e0821b admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:15.034910 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:34:15.040944 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f5e59-41e3-444c-a48f-c02f89e0821b admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:15.045489 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f7216-5377-4b60-bc1d-125b50d753c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:15.046208 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f7216-5377-4b60-bc1d-125b50d753c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:15.046490 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f7216-5377-4b60-bc1d-125b50d753c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:15.049951 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f7216-5377-4b60-bc1d-125b50d753c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:15.049951 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f7216-5377-4b60-bc1d-125b50d753c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:15.049951 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f7216-5377-4b60-bc1d-125b50d753c7 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:15.059441 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1448/2876] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:34:15.063637 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215704cf-5d3e-46e6-a4fc-6e7516e0d555 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:15.073767 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215704cf-5d3e-46e6-a4fc-6e7516e0d555 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:15.078684 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56ce92-40a4-47ba-9b0f-51d5c0ec679d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:15.079125 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56ce92-40a4-47ba-9b0f-51d5c0ec679d admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:15.079402 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56ce92-40a4-47ba-9b0f-51d5c0ec679d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:15.079672 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56ce92-40a4-47ba-9b0f-51d5c0ec679d admin admin] PATH_INFO: `/v3/projects/90846dd3dda14e868f15ee83c056b6c7/users/a2ff1559345b493faee4292523e8ffab/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:15.094370 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56ce92-40a4-47ba-9b0f-51d5c0ec679d admin admin] RBAC: Authorizing `identity:create_grant(project_id=90846dd3dda14e868f15ee83c056b6c7, user_id=a2ff1559345b493faee4292523e8ffab, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:15.097017 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56ce92-40a4-47ba-9b0f-51d5c0ec679d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:15.159194 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1429/2877] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:34:15 2022] PUT /identity/v3/projects/90846dd3dda14e868f15ee83c056b6c7/users/a2ff1559345b493faee4292523e8ffab/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:34:15.171327 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf8418-b207-412b-be98-0f947dedcbe4 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:15.171684 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf8418-b207-412b-be98-0f947dedcbe4 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:15.172082 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf8418-b207-412b-be98-0f947dedcbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:15.199626 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-3bcf8418-b207-412b-be98-0f947dedcbe4 None None] MFA Rules not processed for user `a2ff1559345b493faee4292523e8ffab`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:34:15.200852 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-3bcf8418-b207-412b-be98-0f947dedcbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:15.279535 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1449/2878] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:34:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:34:15.284097 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56ce92-40a4-47ba-9b0f-51d5c0ec679d admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:15.298512 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:34:15.349248 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56ce92-40a4-47ba-9b0f-51d5c0ec679d admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:15.354424 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f2599-32c3-496d-9505-2912fc167ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:15.355101 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f2599-32c3-496d-9505-2912fc167ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:15.355390 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f2599-32c3-496d-9505-2912fc167ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:15.355686 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f2599-32c3-496d-9505-2912fc167ea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:15.356414 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f2599-32c3-496d-9505-2912fc167ea1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:15.358319 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f2599-32c3-496d-9505-2912fc167ea1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:15.458855 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1430/2879] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:34:15 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:34:15.462938 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf8418-b207-412b-be98-0f947dedcbe4 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:15.473925 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf8418-b207-412b-be98-0f947dedcbe4 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:15.531190 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e717d-bdee-40ff-a064-861630170f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:15.531865 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e717d-bdee-40ff-a064-861630170f30 admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:15.532179 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e717d-bdee-40ff-a064-861630170f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:15.532449 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e717d-bdee-40ff-a064-861630170f30 admin admin] PATH_INFO: `/v3/users` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:15.533147 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e717d-bdee-40ff-a064-861630170f30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:15.535102 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e717d-bdee-40ff-a064-861630170f30 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:15.622705 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1450/2880] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:34:15 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:34:15.626582 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f2599-32c3-496d-9505-2912fc167ea1 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:15.637759 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f2599-32c3-496d-9505-2912fc167ea1 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:15.642561 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf97f2-ba69-45f3-b684-4fbb938f6f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:15.643136 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf97f2-ba69-45f3-b684-4fbb938f6f9e admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:15.643413 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf97f2-ba69-45f3-b684-4fbb938f6f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:15.643689 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf97f2-ba69-45f3-b684-4fbb938f6f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:15.644450 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf97f2-ba69-45f3-b684-4fbb938f6f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:15.646080 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf97f2-ba69-45f3-b684-4fbb938f6f9e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:15.656582 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1431/2881] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:34:15.661010 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e717d-bdee-40ff-a064-861630170f30 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:15.670848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e717d-bdee-40ff-a064-861630170f30 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:15.675455 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124dc261-88f6-4913-ae94-a1e789a4f3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:15.676886 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dc261-88f6-4913-ae94-a1e789a4f3f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:15.677166 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dc261-88f6-4913-ae94-a1e789a4f3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:15.677438 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dc261-88f6-4913-ae94-a1e789a4f3f7 admin admin] PATH_INFO: `/v3/projects/6a3e19440430439e8dce89b067b92c9f/users/afe00d3c53e643c5a59f74f83e071795/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:15.693152 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124dc261-88f6-4913-ae94-a1e789a4f3f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a3e19440430439e8dce89b067b92c9f, user_id=afe00d3c53e643c5a59f74f83e071795, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:15.695793 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124dc261-88f6-4913-ae94-a1e789a4f3f7 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:15.777161 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1451/2882] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:34:15 2022] PUT /identity/v3/projects/6a3e19440430439e8dce89b067b92c9f/users/afe00d3c53e643c5a59f74f83e071795/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:34:15.781320 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf97f2-ba69-45f3-b684-4fbb938f6f9e admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:15.791915 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf97f2-ba69-45f3-b684-4fbb938f6f9e admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:15.849691 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4a504-b5ea-488c-a81c-c945bb01b758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:15.850463 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4a504-b5ea-488c-a81c-c945bb01b758 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:15.850742 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4a504-b5ea-488c-a81c-c945bb01b758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:15.851013 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4a504-b5ea-488c-a81c-c945bb01b758 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:15.851734 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4a504-b5ea-488c-a81c-c945bb01b758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:15.853337 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4a504-b5ea-488c-a81c-c945bb01b758 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:15.864031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1432/2883] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:34:15.868310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124dc261-88f6-4913-ae94-a1e789a4f3f7 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:15.878685 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124dc261-88f6-4913-ae94-a1e789a4f3f7 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:15.884486 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d046a-cecc-4f34-9252-78718ab1c4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:15.885366 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d046a-cecc-4f34-9252-78718ab1c4df admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:15.885653 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d046a-cecc-4f34-9252-78718ab1c4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:15.885928 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d046a-cecc-4f34-9252-78718ab1c4df admin admin] PATH_INFO: `/v3/projects/6a3e19440430439e8dce89b067b92c9f/users/afe00d3c53e643c5a59f74f83e071795/roles/4588ca63994f4e2d9ce482d475edbabd` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:15.887901 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d046a-cecc-4f34-9252-78718ab1c4df admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a3e19440430439e8dce89b067b92c9f, user_id=afe00d3c53e643c5a59f74f83e071795, role_id=4588ca63994f4e2d9ce482d475edbabd)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:15.890751 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d046a-cecc-4f34-9252-78718ab1c4df admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:15.901210 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1452/2884] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:34:15 2022] PUT /identity/v3/projects/6a3e19440430439e8dce89b067b92c9f/users/afe00d3c53e643c5a59f74f83e071795/roles/4588ca63994f4e2d9ce482d475edbabd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:34:15.911894 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587ce1d-a2c2-4fbb-8195-1dd7141f92cf None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:15.912207 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587ce1d-a2c2-4fbb-8195-1dd7141f92cf None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:15.912477 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587ce1d-a2c2-4fbb-8195-1dd7141f92cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:15.938677 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-2587ce1d-a2c2-4fbb-8195-1dd7141f92cf None None] MFA Rules not processed for user `afe00d3c53e643c5a59f74f83e071795`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:34:15.940148 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2587ce1d-a2c2-4fbb-8195-1dd7141f92cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:16.007143 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1433/2885] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:34:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:34:16.018457 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d046a-cecc-4f34-9252-78718ab1c4df admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:16.020233 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-766d046a-cecc-4f34-9252-78718ab1c4df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:16.057815 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:34:16.078522 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d046a-cecc-4f34-9252-78718ab1c4df admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:16.082232 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61e614-1b93-43ae-996a-a8217a98ad6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:16.082878 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61e614-1b93-43ae-996a-a8217a98ad6c service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:16.083160 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61e614-1b93-43ae-996a-a8217a98ad6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:16.083429 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61e614-1b93-43ae-996a-a8217a98ad6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:16.139284 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61e614-1b93-43ae-996a-a8217a98ad6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:16.140778 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61e614-1b93-43ae-996a-a8217a98ad6c service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:16.149468 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1453/2886] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:34:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:34:18.030760 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587ce1d-a2c2-4fbb-8195-1dd7141f92cf None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:18.041280 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587ce1d-a2c2-4fbb-8195-1dd7141f92cf None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:18.048632 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857055f-086f-410c-9872-13e80ce441f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:18.048632 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857055f-086f-410c-9872-13e80ce441f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:18.048632 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857055f-086f-410c-9872-13e80ce441f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:18.048632 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857055f-086f-410c-9872-13e80ce441f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:18.052270 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:34:18.105124 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857055f-086f-410c-9872-13e80ce441f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:18.106640 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857055f-086f-410c-9872-13e80ce441f0 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:18.115558 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1434/2887] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:34:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:34:19.380652 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61e614-1b93-43ae-996a-a8217a98ad6c service cinder] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:19.389705 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61e614-1b93-43ae-996a-a8217a98ad6c service cinder] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:19.393397 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0bcd0-66a1-417d-9e5b-5c44d02910e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:19.394038 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0bcd0-66a1-417d-9e5b-5c44d02910e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:19.394319 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0bcd0-66a1-417d-9e5b-5c44d02910e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:19.394597 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0bcd0-66a1-417d-9e5b-5c44d02910e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:19.404207 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0bcd0-66a1-417d-9e5b-5c44d02910e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:19.405625 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0bcd0-66a1-417d-9e5b-5c44d02910e0 service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:19.415927 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1454/2888] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:34:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:34:23.963822 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857055f-086f-410c-9872-13e80ce441f0 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:24.028388 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857055f-086f-410c-9872-13e80ce441f0 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:24.033119 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8d71c-8be7-4666-98b9-8c5c392bfda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:24.034140 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8d71c-8be7-4666-98b9-8c5c392bfda5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:24.034414 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8d71c-8be7-4666-98b9-8c5c392bfda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:24.034772 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8d71c-8be7-4666-98b9-8c5c392bfda5 admin admin] PATH_INFO: `/v3/users/0cfe39f8fb8b457fa3ab7a491b857365` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:24.036086 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8d71c-8be7-4666-98b9-8c5c392bfda5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cfe39f8fb8b457fa3ab7a491b857365)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:24.038023 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8d71c-8be7-4666-98b9-8c5c392bfda5 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:24.166835 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-88e8d71c-8be7-4666-98b9-8c5c392bfda5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cfe39f8fb8b457fa3ab7a491b857365'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:24.173882 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-88e8d71c-8be7-4666-98b9-8c5c392bfda5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cfe39f8fb8b457fa3ab7a491b857365'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:24.174575 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-88e8d71c-8be7-4666-98b9-8c5c392bfda5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cfe39f8fb8b457fa3ab7a491b857365'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:24.175230 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-88e8d71c-8be7-4666-98b9-8c5c392bfda5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cfe39f8fb8b457fa3ab7a491b857365'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:24.188945 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-88e8d71c-8be7-4666-98b9-8c5c392bfda5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cfe39f8fb8b457fa3ab7a491b857365'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:24.262326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1435/2889] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:34:23 2022] DELETE /identity/v3/users/0cfe39f8fb8b457fa3ab7a491b857365 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:34:24.266932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784a70b-332e-4309-97e3-018839495ed4 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:24.267440 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784a70b-332e-4309-97e3-018839495ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:24.267559 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784a70b-332e-4309-97e3-018839495ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:24.284591 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-c784a70b-332e-4309-97e3-018839495ed4 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:34:24.285793 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c784a70b-332e-4309-97e3-018839495ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:24.344948 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1455/2890] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:34:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:34:24.355102 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8d71c-8be7-4666-98b9-8c5c392bfda5 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:24.356566 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-88e8d71c-8be7-4666-98b9-8c5c392bfda5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:24.386706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:34:24.412124 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8d71c-8be7-4666-98b9-8c5c392bfda5 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:24.422330 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244b38e-839e-4e81-958c-da16f1c8fea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:24.422330 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244b38e-839e-4e81-958c-da16f1c8fea9 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:24.422330 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244b38e-839e-4e81-958c-da16f1c8fea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:24.422330 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244b38e-839e-4e81-958c-da16f1c8fea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:24.427040 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244b38e-839e-4e81-958c-da16f1c8fea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:24.428487 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244b38e-839e-4e81-958c-da16f1c8fea9 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:24.438293 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1436/2891] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:34:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:34:25.071034 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784a70b-332e-4309-97e3-018839495ed4 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:25.075177 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-c784a70b-332e-4309-97e3-018839495ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:25.085677 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784a70b-332e-4309-97e3-018839495ed4 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:25.091649 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1898ac-dc77-48a6-9e6c-39a9dc7416fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:25.092620 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1898ac-dc77-48a6-9e6c-39a9dc7416fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:25.092901 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1898ac-dc77-48a6-9e6c-39a9dc7416fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:25.093174 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1898ac-dc77-48a6-9e6c-39a9dc7416fe admin admin] PATH_INFO: `/v3/projects/efa5e8c35d694fa9b80a9315700e09c6` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:25.094392 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1898ac-dc77-48a6-9e6c-39a9dc7416fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=efa5e8c35d694fa9b80a9315700e09c6)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:25.096396 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1898ac-dc77-48a6-9e6c-39a9dc7416fe admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:25.206871 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-7a1898ac-dc77-48a6-9e6c-39a9dc7416fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efa5e8c35d694fa9b80a9315700e09c6', 'request_id': 'req-7a1898ac-dc77-48a6-9e6c-39a9dc7416fe'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:25.267715 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-7a1898ac-dc77-48a6-9e6c-39a9dc7416fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efa5e8c35d694fa9b80a9315700e09c6', 'request_id': 'req-7a1898ac-dc77-48a6-9e6c-39a9dc7416fe'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:25.274307 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-7a1898ac-dc77-48a6-9e6c-39a9dc7416fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efa5e8c35d694fa9b80a9315700e09c6', 'request_id': 'req-7a1898ac-dc77-48a6-9e6c-39a9dc7416fe'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:25.282205 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:34:25.286830 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-7a1898ac-dc77-48a6-9e6c-39a9dc7416fe admin admin] The token cache is being invalidate because project efa5e8c35d694fa9b80a9315700e09c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:34:25.287123 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-7a1898ac-dc77-48a6-9e6c-39a9dc7416fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:25.287779 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-7a1898ac-dc77-48a6-9e6c-39a9dc7416fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:25.289401 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1456/2892] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:34:25 2022] DELETE /identity/v3/projects/efa5e8c35d694fa9b80a9315700e09c6 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:34:25.293347 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244b38e-839e-4e81-958c-da16f1c8fea9 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:25.302938 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244b38e-839e-4e81-958c-da16f1c8fea9 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:25.361031 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e8486-48af-4b4b-8788-1b82fda1ed9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:25.361906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e8486-48af-4b4b-8788-1b82fda1ed9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:25.362182 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e8486-48af-4b4b-8788-1b82fda1ed9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:25.362449 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e8486-48af-4b4b-8788-1b82fda1ed9f admin admin] PATH_INFO: `/v3/users/a2ff1559345b493faee4292523e8ffab` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:25.363746 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e8486-48af-4b4b-8788-1b82fda1ed9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2ff1559345b493faee4292523e8ffab)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:25.365949 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e8486-48af-4b4b-8788-1b82fda1ed9f admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:25.532357 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-900e8486-48af-4b4b-8788-1b82fda1ed9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2ff1559345b493faee4292523e8ffab'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:25.539011 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-900e8486-48af-4b4b-8788-1b82fda1ed9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2ff1559345b493faee4292523e8ffab'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:25.539689 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-900e8486-48af-4b4b-8788-1b82fda1ed9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2ff1559345b493faee4292523e8ffab'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:25.540311 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-900e8486-48af-4b4b-8788-1b82fda1ed9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2ff1559345b493faee4292523e8ffab'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:25.551963 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-900e8486-48af-4b4b-8788-1b82fda1ed9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2ff1559345b493faee4292523e8ffab'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:25.628298 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1437/2893] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:34:25 2022] DELETE /identity/v3/users/a2ff1559345b493faee4292523e8ffab => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:34:26.018216 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1898ac-dc77-48a6-9e6c-39a9dc7416fe admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:26.019635 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-7a1898ac-dc77-48a6-9e6c-39a9dc7416fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:26.033646 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1898ac-dc77-48a6-9e6c-39a9dc7416fe admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:26.118220 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f103f3-a962-43a3-a362-25a9d58e3e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:26.119795 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f103f3-a962-43a3-a362-25a9d58e3e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:26.119795 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f103f3-a962-43a3-a362-25a9d58e3e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:26.119795 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f103f3-a962-43a3-a362-25a9d58e3e0a admin admin] PATH_INFO: `/v3/projects/90846dd3dda14e868f15ee83c056b6c7` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:26.120946 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f103f3-a962-43a3-a362-25a9d58e3e0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=90846dd3dda14e868f15ee83c056b6c7)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:26.122903 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f103f3-a962-43a3-a362-25a9d58e3e0a admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:26.262794 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-e6f103f3-a962-43a3-a362-25a9d58e3e0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90846dd3dda14e868f15ee83c056b6c7', 'request_id': 'req-e6f103f3-a962-43a3-a362-25a9d58e3e0a'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:26.336906 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-e6f103f3-a962-43a3-a362-25a9d58e3e0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90846dd3dda14e868f15ee83c056b6c7', 'request_id': 'req-e6f103f3-a962-43a3-a362-25a9d58e3e0a'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:26.342991 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-e6f103f3-a962-43a3-a362-25a9d58e3e0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90846dd3dda14e868f15ee83c056b6c7', 'request_id': 'req-e6f103f3-a962-43a3-a362-25a9d58e3e0a'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:26.356452 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-e6f103f3-a962-43a3-a362-25a9d58e3e0a admin admin] The token cache is being invalidate because project 90846dd3dda14e868f15ee83c056b6c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:34:26.356738 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-e6f103f3-a962-43a3-a362-25a9d58e3e0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:26.357393 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-e6f103f3-a962-43a3-a362-25a9d58e3e0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:26.359445 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1457/2894] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:34:26 2022] DELETE /identity/v3/projects/90846dd3dda14e868f15ee83c056b6c7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:34:26.363906 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e8486-48af-4b4b-8788-1b82fda1ed9f admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:26.365578 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-900e8486-48af-4b4b-8788-1b82fda1ed9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:26.380851 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e8486-48af-4b4b-8788-1b82fda1ed9f admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:26.427258 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:34:26.438645 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105652f4-aa0b-4f55-b8c0-4cd13eb9569e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:26.439507 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105652f4-aa0b-4f55-b8c0-4cd13eb9569e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:26.440084 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105652f4-aa0b-4f55-b8c0-4cd13eb9569e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:26.440357 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105652f4-aa0b-4f55-b8c0-4cd13eb9569e admin admin] PATH_INFO: `/v3/users/afe00d3c53e643c5a59f74f83e071795` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:26.441524 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105652f4-aa0b-4f55-b8c0-4cd13eb9569e admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe00d3c53e643c5a59f74f83e071795)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:26.443471 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105652f4-aa0b-4f55-b8c0-4cd13eb9569e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:26.670040 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-105652f4-aa0b-4f55-b8c0-4cd13eb9569e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe00d3c53e643c5a59f74f83e071795'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:26.676801 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-105652f4-aa0b-4f55-b8c0-4cd13eb9569e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe00d3c53e643c5a59f74f83e071795'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:26.677473 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-105652f4-aa0b-4f55-b8c0-4cd13eb9569e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe00d3c53e643c5a59f74f83e071795'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:26.678080 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-105652f4-aa0b-4f55-b8c0-4cd13eb9569e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe00d3c53e643c5a59f74f83e071795'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:26.690620 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-105652f4-aa0b-4f55-b8c0-4cd13eb9569e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe00d3c53e643c5a59f74f83e071795'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:26.760078 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1438/2895] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:34:26 2022] DELETE /identity/v3/users/afe00d3c53e643c5a59f74f83e071795 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:34:27.240947 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f103f3-a962-43a3-a362-25a9d58e3e0a admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:27.243160 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-e6f103f3-a962-43a3-a362-25a9d58e3e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:27.256172 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f103f3-a962-43a3-a362-25a9d58e3e0a admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:27.316604 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4d6bb-3acc-45b9-9d0e-0ae0cf160cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:27.317474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4d6bb-3acc-45b9-9d0e-0ae0cf160cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:27.317755 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4d6bb-3acc-45b9-9d0e-0ae0cf160cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:27.318033 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4d6bb-3acc-45b9-9d0e-0ae0cf160cbb admin admin] PATH_INFO: `/v3/projects/6a3e19440430439e8dce89b067b92c9f` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:27.319704 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4d6bb-3acc-45b9-9d0e-0ae0cf160cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a3e19440430439e8dce89b067b92c9f)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:27.321227 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4d6bb-3acc-45b9-9d0e-0ae0cf160cbb admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:27.393020 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:34:27.410482 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cad4d6bb-3acc-45b9-9d0e-0ae0cf160cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a3e19440430439e8dce89b067b92c9f', 'request_id': 'req-cad4d6bb-3acc-45b9-9d0e-0ae0cf160cbb'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:27.479420 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cad4d6bb-3acc-45b9-9d0e-0ae0cf160cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a3e19440430439e8dce89b067b92c9f', 'request_id': 'req-cad4d6bb-3acc-45b9-9d0e-0ae0cf160cbb'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:27.485906 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cad4d6bb-3acc-45b9-9d0e-0ae0cf160cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a3e19440430439e8dce89b067b92c9f', 'request_id': 'req-cad4d6bb-3acc-45b9-9d0e-0ae0cf160cbb'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:27.496995 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cad4d6bb-3acc-45b9-9d0e-0ae0cf160cbb admin admin] The token cache is being invalidate because project 6a3e19440430439e8dce89b067b92c9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:34:27.497283 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cad4d6bb-3acc-45b9-9d0e-0ae0cf160cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:27.497921 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cad4d6bb-3acc-45b9-9d0e-0ae0cf160cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:27.499468 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1458/2896] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:34:27 2022] DELETE /identity/v3/projects/6a3e19440430439e8dce89b067b92c9f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:34:27.505449 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdea7be-f51a-4242-977c-800691d84cb7 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:27.505969 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdea7be-f51a-4242-977c-800691d84cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:27.505969 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdea7be-f51a-4242-977c-800691d84cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:27.526295 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-8bdea7be-f51a-4242-977c-800691d84cb7 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:34:27.527539 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8bdea7be-f51a-4242-977c-800691d84cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:27.595665 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1439/2897] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:34:27.604212 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c8df3-7035-4c78-9eef-431c03a10a31 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:27.604508 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c8df3-7035-4c78-9eef-431c03a10a31 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:27.604787 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c8df3-7035-4c78-9eef-431c03a10a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:27.624959 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-e97c8df3-7035-4c78-9eef-431c03a10a31 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:34:27.626189 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-e97c8df3-7035-4c78-9eef-431c03a10a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:27.634214 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1459/2898] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:34:27.638627 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdea7be-f51a-4242-977c-800691d84cb7 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:27.649145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdea7be-f51a-4242-977c-800691d84cb7 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:27.653932 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236d68f-27b0-4395-a77b-39af96f9b136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:27.654537 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236d68f-27b0-4395-a77b-39af96f9b136 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:27.654820 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236d68f-27b0-4395-a77b-39af96f9b136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:27.655096 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236d68f-27b0-4395-a77b-39af96f9b136 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:27.655817 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236d68f-27b0-4395-a77b-39af96f9b136 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:34:27.656156 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236d68f-27b0-4395-a77b-39af96f9b136 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:27.657737 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236d68f-27b0-4395-a77b-39af96f9b136 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:27.670131 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1440/2899] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jun 2 19:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:34:27.675410 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c8df3-7035-4c78-9eef-431c03a10a31 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:27.685010 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c8df3-7035-4c78-9eef-431c03a10a31 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:27.690027 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9562382-728d-43e7-b676-ca262832020c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:27.690678 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9562382-728d-43e7-b676-ca262832020c admin admin] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:27.690961 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9562382-728d-43e7-b676-ca262832020c admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:27.691260 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9562382-728d-43e7-b676-ca262832020c admin admin] PATH_INFO: `/v3/projects` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:27.691940 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9562382-728d-43e7-b676-ca262832020c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:27.693878 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9562382-728d-43e7-b676-ca262832020c admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:27.807089 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1460/2900] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jun 2 19:34:27 2022] POST /identity/v3/projects => generated 391 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:34:27.811268 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236d68f-27b0-4395-a77b-39af96f9b136 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:27.821922 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236d68f-27b0-4395-a77b-39af96f9b136 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:27.871054 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:34:27.877673 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c550f-0b5f-4b81-ab05-3a6e73a7ad0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:27.878331 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c550f-0b5f-4b81-ab05-3a6e73a7ad0b admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:27.878608 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c550f-0b5f-4b81-ab05-3a6e73a7ad0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:27.878879 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c550f-0b5f-4b81-ab05-3a6e73a7ad0b admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:27.879564 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c550f-0b5f-4b81-ab05-3a6e73a7ad0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:27.881470 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c550f-0b5f-4b81-ab05-3a6e73a7ad0b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:27.949326 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1441/2901] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jun 2 19:34:27 2022] POST /identity/v3/users => generated 296 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:34:27.953826 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9562382-728d-43e7-b676-ca262832020c admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:27.965238 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9562382-728d-43e7-b676-ca262832020c admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:27.970250 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0ae43-f2e1-4ee4-9fdf-098f1e99e2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:27.973488 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0ae43-f2e1-4ee4-9fdf-098f1e99e2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:27.973488 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0ae43-f2e1-4ee4-9fdf-098f1e99e2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:27.973488 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0ae43-f2e1-4ee4-9fdf-098f1e99e2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:27.973488 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0ae43-f2e1-4ee4-9fdf-098f1e99e2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:27.973930 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0ae43-f2e1-4ee4-9fdf-098f1e99e2a7 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:27.985848 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1461/2902] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:34:27.990845 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c550f-0b5f-4b81-ab05-3a6e73a7ad0b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:28.001237 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c550f-0b5f-4b81-ab05-3a6e73a7ad0b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:28.006073 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdeea7-d817-4321-a38c-51e1c2899dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:28.006731 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdeea7-d817-4321-a38c-51e1c2899dfd admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:28.007009 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdeea7-d817-4321-a38c-51e1c2899dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:28.007278 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdeea7-d817-4321-a38c-51e1c2899dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:28.008596 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdeea7-d817-4321-a38c-51e1c2899dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:28.010223 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdeea7-d817-4321-a38c-51e1c2899dfd admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:28.021706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1442/2903] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jun 2 19:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:34:28.026243 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0ae43-f2e1-4ee4-9fdf-098f1e99e2a7 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:28.036425 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0ae43-f2e1-4ee4-9fdf-098f1e99e2a7 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:28.041050 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa9542-3fb8-4b54-ae1d-fbe5c9d7c777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:28.041923 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa9542-3fb8-4b54-ae1d-fbe5c9d7c777 admin admin] REQUEST_METHOD: `PUT` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:28.042199 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa9542-3fb8-4b54-ae1d-fbe5c9d7c777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:28.042512 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa9542-3fb8-4b54-ae1d-fbe5c9d7c777 admin admin] PATH_INFO: `/v3/projects/c2abe90dd8b643fc8f6b9576a351f138/users/be608d95bcad418898305ec8ce1d0e24/roles/75723f2a7ead4f5cb2885e7b63680b08` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:28.059239 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa9542-3fb8-4b54-ae1d-fbe5c9d7c777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2abe90dd8b643fc8f6b9576a351f138, user_id=be608d95bcad418898305ec8ce1d0e24, role_id=75723f2a7ead4f5cb2885e7b63680b08)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:28.061993 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa9542-3fb8-4b54-ae1d-fbe5c9d7c777 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:28.172134 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1462/2904] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jun 2 19:34:28 2022] PUT /identity/v3/projects/c2abe90dd8b643fc8f6b9576a351f138/users/be608d95bcad418898305ec8ce1d0e24/roles/75723f2a7ead4f5cb2885e7b63680b08 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:34:28.184211 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38019a-c789-4ee8-9549-377e0baf2254 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:28.189006 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38019a-c789-4ee8-9549-377e0baf2254 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:28.189006 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38019a-c789-4ee8-9549-377e0baf2254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:28.212684 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-bc38019a-c789-4ee8-9549-377e0baf2254 None None] MFA Rules not processed for user `be608d95bcad418898305ec8ce1d0e24`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:34:28.213948 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-bc38019a-c789-4ee8-9549-377e0baf2254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:28.278872 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1443/2905] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:34:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:34:28.290198 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa9542-3fb8-4b54-ae1d-fbe5c9d7c777 admin admin] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:28.291980 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-07aa9542-3fb8-4b54-ae1d-fbe5c9d7c777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:28.348241 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa9542-3fb8-4b54-ae1d-fbe5c9d7c777 admin admin] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:28.351860 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11787ba2-b3d1-4429-945d-002f72ddc662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb1dec309904b009271f36cd9157511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:28.352641 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11787ba2-b3d1-4429-945d-002f72ddc662 service cinder] REQUEST_METHOD: `GET` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:28.352924 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11787ba2-b3d1-4429-945d-002f72ddc662 service cinder] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:28.353195 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11787ba2-b3d1-4429-945d-002f72ddc662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:28.361344 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11787ba2-b3d1-4429-945d-002f72ddc662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:28.362757 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11787ba2-b3d1-4429-945d-002f72ddc662 service cinder] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:28.371932 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1463/2906] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:34:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:34:28.619019 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38019a-c789-4ee8-9549-377e0baf2254 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:28.620514 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-bc38019a-c789-4ee8-9549-377e0baf2254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:28.683883 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38019a-c789-4ee8-9549-377e0baf2254 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:28.688706 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1cf3f-ffd7-4aed-bd48-5257c581faa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:28.689580 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1cf3f-ffd7-4aed-bd48-5257c581faa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:28.690128 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1cf3f-ffd7-4aed-bd48-5257c581faa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:28.690406 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1cf3f-ffd7-4aed-bd48-5257c581faa2 admin admin] PATH_INFO: `/v3/users/27eb7569a5164c2e883508db4a4f2892` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:28.691839 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1cf3f-ffd7-4aed-bd48-5257c581faa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27eb7569a5164c2e883508db4a4f2892)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:28.693803 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1cf3f-ffd7-4aed-bd48-5257c581faa2 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:28.904502 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-19c1cf3f-ffd7-4aed-bd48-5257c581faa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27eb7569a5164c2e883508db4a4f2892'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:28.911419 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-19c1cf3f-ffd7-4aed-bd48-5257c581faa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27eb7569a5164c2e883508db4a4f2892'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:28.912215 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-19c1cf3f-ffd7-4aed-bd48-5257c581faa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27eb7569a5164c2e883508db4a4f2892'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:28.912922 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-19c1cf3f-ffd7-4aed-bd48-5257c581faa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27eb7569a5164c2e883508db4a4f2892'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:28.919830 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:34:28.925235 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-19c1cf3f-ffd7-4aed-bd48-5257c581faa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27eb7569a5164c2e883508db4a4f2892'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:29.017362 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1444/2907] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:34:28 2022] DELETE /identity/v3/users/27eb7569a5164c2e883508db4a4f2892 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:34:29.021894 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31122b0-cbc2-4b7b-a15e-ecbeaf318067 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:29.022374 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31122b0-cbc2-4b7b-a15e-ecbeaf318067 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:29.022474 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31122b0-cbc2-4b7b-a15e-ecbeaf318067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:29.043685 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-f31122b0-cbc2-4b7b-a15e-ecbeaf318067 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:34:29.044135 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-f31122b0-cbc2-4b7b-a15e-ecbeaf318067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:29.097823 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:34:29.107960 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1464/2908] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:34:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:34:29.117861 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1cf3f-ffd7-4aed-bd48-5257c581faa2 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:29.119862 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-19c1cf3f-ffd7-4aed-bd48-5257c581faa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:29.182735 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1cf3f-ffd7-4aed-bd48-5257c581faa2 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:29.186324 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdcd95-29e8-4f35-a36d-29a53490c99f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:29.193339 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdcd95-29e8-4f35-a36d-29a53490c99f service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:29.193339 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdcd95-29e8-4f35-a36d-29a53490c99f service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:29.193339 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdcd95-29e8-4f35-a36d-29a53490c99f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:29.197099 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fdcd95-29e8-4f35-a36d-29a53490c99f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:29.198568 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fdcd95-29e8-4f35-a36d-29a53490c99f service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:29.208902 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1445/2909] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:34:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:34:29.623427 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31122b0-cbc2-4b7b-a15e-ecbeaf318067 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:29.624969 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-f31122b0-cbc2-4b7b-a15e-ecbeaf318067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:29.638160 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31122b0-cbc2-4b7b-a15e-ecbeaf318067 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:29.642854 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd5d38-0b39-4ceb-b812-b1af3867d47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:29.643723 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd5d38-0b39-4ceb-b812-b1af3867d47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:29.644037 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd5d38-0b39-4ceb-b812-b1af3867d47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:29.644310 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd5d38-0b39-4ceb-b812-b1af3867d47c admin admin] PATH_INFO: `/v3/projects/0dbf230525284371bab891250f74f13e` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:29.646002 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd5d38-0b39-4ceb-b812-b1af3867d47c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dbf230525284371bab891250f74f13e)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:29.647907 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd5d38-0b39-4ceb-b812-b1af3867d47c admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:29.748633 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-39dd5d38-0b39-4ceb-b812-b1af3867d47c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dbf230525284371bab891250f74f13e', 'request_id': 'req-39dd5d38-0b39-4ceb-b812-b1af3867d47c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:29.799223 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-39dd5d38-0b39-4ceb-b812-b1af3867d47c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dbf230525284371bab891250f74f13e', 'request_id': 'req-39dd5d38-0b39-4ceb-b812-b1af3867d47c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:29.807351 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-39dd5d38-0b39-4ceb-b812-b1af3867d47c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dbf230525284371bab891250f74f13e', 'request_id': 'req-39dd5d38-0b39-4ceb-b812-b1af3867d47c'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:29.818794 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-39dd5d38-0b39-4ceb-b812-b1af3867d47c admin admin] The token cache is being invalidate because project 0dbf230525284371bab891250f74f13e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:34:29.819085 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-39dd5d38-0b39-4ceb-b812-b1af3867d47c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:29.819727 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-39dd5d38-0b39-4ceb-b812-b1af3867d47c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:29.821294 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1465/2910] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:34:29 2022] DELETE /identity/v3/projects/0dbf230525284371bab891250f74f13e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:34:39.204192 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=31,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:34:39.815755 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:34:39.884145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdcd95-29e8-4f35-a36d-29a53490c99f service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:39.885622 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-22fdcd95-29e8-4f35-a36d-29a53490c99f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:39.963386 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdcd95-29e8-4f35-a36d-29a53490c99f service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:40.020642 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad89e3-9c08-40de-8da3-629b162f64ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:40.021549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad89e3-9c08-40de-8da3-629b162f64ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:40.021828 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad89e3-9c08-40de-8da3-629b162f64ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:40.022086 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad89e3-9c08-40de-8da3-629b162f64ca admin admin] PATH_INFO: `/v3/users/be608d95bcad418898305ec8ce1d0e24` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:40.023559 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad89e3-9c08-40de-8da3-629b162f64ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=be608d95bcad418898305ec8ce1d0e24)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:40.025486 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad89e3-9c08-40de-8da3-629b162f64ca admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:40.205393 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d3ad89e3-9c08-40de-8da3-629b162f64ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be608d95bcad418898305ec8ce1d0e24'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:40.212732 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d3ad89e3-9c08-40de-8da3-629b162f64ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be608d95bcad418898305ec8ce1d0e24'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:40.213444 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d3ad89e3-9c08-40de-8da3-629b162f64ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be608d95bcad418898305ec8ce1d0e24'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:40.214052 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d3ad89e3-9c08-40de-8da3-629b162f64ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be608d95bcad418898305ec8ce1d0e24'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:40.225717 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d3ad89e3-9c08-40de-8da3-629b162f64ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be608d95bcad418898305ec8ce1d0e24'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:40.301596 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1446/2911] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jun 2 19:34:39 2022] DELETE /identity/v3/users/be608d95bcad418898305ec8ce1d0e24 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:34:40.306338 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6f3e6-a019-4fd0-ba8d-462304ee6b31 None None] REQUEST_METHOD: `POST` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:40.306625 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6f3e6-a019-4fd0-ba8d-462304ee6b31 None None] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:40.306902 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6f3e6-a019-4fd0-ba8d-462304ee6b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:40.334140 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.auth.core [None req-74c6f3e6-a019-4fd0-ba8d-462304ee6b31 None None] MFA Rules not processed for user `1a0014c58c4c4ce1bf436c7c1e5d03c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80608) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:34:40.335426 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-74c6f3e6-a019-4fd0-ba8d-462304ee6b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:40.393998 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1466/2912] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jun 2 19:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:34:40.404695 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad89e3-9c08-40de-8da3-629b162f64ca admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:40.406137 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d3ad89e3-9c08-40de-8da3-629b162f64ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:40.430745 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:34:40.501793 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad89e3-9c08-40de-8da3-629b162f64ca admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:40.505502 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5caefae-6a99-490c-bd07-3160947fa967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2efd679ca9314c8591cabbca15f8c61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:40.506145 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caefae-6a99-490c-bd07-3160947fa967 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:40.506425 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caefae-6a99-490c-bd07-3160947fa967 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:40.506694 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caefae-6a99-490c-bd07-3160947fa967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:40.515833 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5caefae-6a99-490c-bd07-3160947fa967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:40.517292 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5caefae-6a99-490c-bd07-3160947fa967 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:40.527173 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1447/2913] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:34:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:34:40.909098 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6f3e6-a019-4fd0-ba8d-462304ee6b31 None None] Authenticating user token {{(pid=80608) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:34:40.910699 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.fernet_utils [None req-74c6f3e6-a019-4fd0-ba8d-462304ee6b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80608) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:34:40.923478 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6f3e6-a019-4fd0-ba8d-462304ee6b31 None None] Validating token access rules against request {{(pid=80608) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:34:40.927825 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45d29e-c007-4607-80be-5c30b9506937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0014c58c4c4ce1bf436c7c1e5d03c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc622f67162c4bdeb3f3fd1a3419d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80608) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:34:40.928797 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45d29e-c007-4607-80be-5c30b9506937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:34:40.929075 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45d29e-c007-4607-80be-5c30b9506937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:34:40.930229 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45d29e-c007-4607-80be-5c30b9506937 admin admin] PATH_INFO: `/v3/projects/c2abe90dd8b643fc8f6b9576a351f138` {{(pid=80608) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:34:40.931353 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45d29e-c007-4607-80be-5c30b9506937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2abe90dd8b643fc8f6b9576a351f138)` {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:34:40.933317 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45d29e-c007-4607-80be-5c30b9506937 admin admin] RBAC: Authorization granted {{(pid=80608) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:34:41.028026 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cf45d29e-c007-4607-80be-5c30b9506937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2abe90dd8b643fc8f6b9576a351f138', 'request_id': 'req-cf45d29e-c007-4607-80be-5c30b9506937'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:41.073017 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cf45d29e-c007-4607-80be-5c30b9506937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2abe90dd8b643fc8f6b9576a351f138', 'request_id': 'req-cf45d29e-c007-4607-80be-5c30b9506937'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:41.079217 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cf45d29e-c007-4607-80be-5c30b9506937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2abe90dd8b643fc8f6b9576a351f138', 'request_id': 'req-cf45d29e-c007-4607-80be-5c30b9506937'} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:41.091254 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cf45d29e-c007-4607-80be-5c30b9506937 admin admin] The token cache is being invalidate because project c2abe90dd8b643fc8f6b9576a351f138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80608) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:34:41.091544 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cf45d29e-c007-4607-80be-5c30b9506937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:41.092222 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG keystone.notifications [None req-cf45d29e-c007-4607-80be-5c30b9506937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80608) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:34:41.093827 dv-cinder-797608-28-smb devstack@keystone.service[80608]: [pid: 80608|app: 0|req: 1467/2914] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jun 2 19:34:40 2022] DELETE /identity/v3/projects/c2abe90dd8b643fc8f6b9576a351f138 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:34:50.530153 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=34 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:34:51.087972 dv-cinder-797608-28-smb devstack@keystone.service[80608]: DEBUG dbcounter [-] [80608] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:47.906549 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5caefae-6a99-490c-bd07-3160947fa967 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:47.907969 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f5caefae-6a99-490c-bd07-3160947fa967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:48.005124 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5caefae-6a99-490c-bd07-3160947fa967 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:48.069283 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f7ef4-95e6-48fc-b0d2-e2868e428756 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ebc95c1b3284c1d8321900cf442a811', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b11b7e66a993492d8163097bce955c0b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:48.069850 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f7ef4-95e6-48fc-b0d2-e2868e428756 service placement] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:48.070130 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f7ef4-95e6-48fc-b0d2-e2868e428756 service placement] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:48.070409 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f7ef4-95e6-48fc-b0d2-e2868e428756 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:48.072243 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d28f7ef4-95e6-48fc-b0d2-e2868e428756 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:48.083438 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f7ef4-95e6-48fc-b0d2-e2868e428756 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:48.085063 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f7ef4-95e6-48fc-b0d2-e2868e428756 service placement] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:48.095286 dv-cinder-797608-28-smb devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1448/2915] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jun 2 19:36:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:36:58.091350 dv-cinder-797608-28-smb devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=67 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}